Jul 01 19:21:32.872780 ip-10-0-140-188 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:21:33.316040 ip-10-0-140-188 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:21:33.316040 ip-10-0-140-188 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:21:33.316040 ip-10-0-140-188 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:21:33.316040 ip-10-0-140-188 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:21:33.316040 ip-10-0-140-188 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:21:33.318848 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.318762 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:21:33.323734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323718 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:21:33.323734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323734 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323738 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323743 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323746 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323749 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323752 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323756 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323759 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323762 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323765 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323768 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323771 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323774 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323782 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323785 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323787 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323790 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323792 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323795 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323797 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:21:33.323796 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323800 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323803 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323806 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323808 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323811 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323814 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323816 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323819 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323821 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323824 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323826 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323829 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323832 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323834 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323837 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323839 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323842 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323844 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323846 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323849 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:21:33.324260 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323852 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323854 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323856 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323859 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323861 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323864 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323868 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323870 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323873 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323875 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323877 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323880 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323882 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323885 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323889 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323891 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323895 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323897 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323900 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:21:33.324844 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323902 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323905 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323907 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323910 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323913 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323915 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323918 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323920 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323923 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323925 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323928 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323931 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323933 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323936 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323938 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323941 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323943 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323947 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323951 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:21:33.325289 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323954 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323957 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323960 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323963 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323966 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323968 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323973 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323976 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323981 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323984 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323987 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323990 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323992 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323995 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.323998 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324001 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324003 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324007 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324010 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:21:33.325749 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324013 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324758 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324766 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324770 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324773 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324776 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324779 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324782 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324785 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324788 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324790 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324793 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324795 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324798 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324800 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324803 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324805 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324808 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324810 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324813 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:21:33.326212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324815 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324819 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324822 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324825 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324827 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324830 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324832 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324835 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324870 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324890 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324895 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324899 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324905 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324910 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324914 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324917 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324920 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324923 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324926 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:21:33.326697 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324929 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324932 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324934 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324937 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324939 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324942 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324945 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324947 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324950 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324952 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324955 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324958 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324961 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324963 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324966 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324968 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324971 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324973 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324976 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324978 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:21:33.327176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324981 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324984 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324988 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324991 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324993 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324996 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.324998 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325001 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325003 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325006 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325009 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325011 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325016 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325019 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325021 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325024 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325027 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325032 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325035 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:21:33.327656 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325037 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325040 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325042 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325045 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325047 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325050 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325053 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325055 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325057 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325060 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325063 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325065 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325068 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325071 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325074 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325077 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325080 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325083 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325085 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325089 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:21:33.328127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325093 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325577 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325584 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325587 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325591 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325594 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325597 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325599 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325602 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325605 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325607 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325610 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325612 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325615 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325618 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325621 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325623 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325626 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325629 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325631 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:21:33.328655 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325634 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325636 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325639 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325642 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325644 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325647 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325652 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325656 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325658 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325661 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325663 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325666 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325668 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325671 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325673 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325676 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325680 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325683 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325685 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:21:33.329127 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325688 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325691 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325693 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325696 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325699 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325701 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325704 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325706 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325708 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325713 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325716 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325718 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325721 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325725 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325728 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325730 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325732 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325735 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325737 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325741 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:21:33.329579 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325743 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325746 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325749 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325752 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325755 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325758 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325760 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325763 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325765 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325768 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325770 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325773 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325777 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325780 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325783 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325786 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325788 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325791 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325793 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325796 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:21:33.330043 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325798 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325802 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325804 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325807 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325809 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325812 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325814 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325817 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325819 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325822 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325826 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325831 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325833 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325837 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325840 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325843 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325845 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325848 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325850 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:21:33.330524 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325853 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.325855 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325928 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325938 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325948 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325959 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325964 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325967 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325971 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325975 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325979 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325981 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325985 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325988 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325991 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325995 2577 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.325997 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326000 2577 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326003 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326006 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326011 2577 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326013 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326016 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326019 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:21:33.330971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326024 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326028 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326031 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326034 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326038 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326041 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326044 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326047 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326050 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326053 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326057 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326060 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326063 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326066 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326069 2577 flags.go:64] FLAG: --enable-server="true" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326072 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326077 2577 flags.go:64] FLAG: --event-burst="100" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326080 2577 flags.go:64] FLAG: --event-qps="50" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326083 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326086 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326089 2577 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326092 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326095 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326098 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326101 2577 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:21:33.331555 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326104 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326107 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326110 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326113 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326116 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326119 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326121 2577 flags.go:64] FLAG: --feature-gates="" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326126 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326130 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326133 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326136 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326140 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326143 2577 flags.go:64] FLAG: --help="false" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326146 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326150 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326153 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326155 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326159 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326162 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326165 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326168 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326170 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326173 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:21:33.332138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326176 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326179 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326182 2577 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326185 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326198 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326201 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326204 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326206 2577 flags.go:64] FLAG: --lock-file="" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326209 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326212 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326215 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326220 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326224 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326226 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326229 2577 flags.go:64] FLAG: --logging-format="text" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326232 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326237 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326240 2577 flags.go:64] FLAG: --manifest-url="" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326243 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326248 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326251 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326255 2577 flags.go:64] FLAG: --max-pods="110" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326258 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326261 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326264 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:21:33.332767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326267 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326270 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326273 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326275 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326283 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326286 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326289 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326292 2577 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326295 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326300 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326302 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326306 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326309 2577 flags.go:64] FLAG: --port="10250" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326311 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326316 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b981048a01f83566" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326319 2577 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326322 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326325 2577 flags.go:64] FLAG: --register-node="true" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326328 2577 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326331 2577 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326334 2577 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326337 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326340 2577 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326344 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326347 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:21:33.333356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326350 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326353 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326356 2577 flags.go:64] FLAG: --runonce="false" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326359 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326362 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326365 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326368 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326371 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326374 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326376 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326379 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326382 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326385 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326388 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326390 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326393 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326396 2577 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326399 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326404 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326407 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326409 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326415 2577 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326417 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326420 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326423 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:21:33.333968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326426 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326429 2577 flags.go:64] FLAG: --v="2" Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326432 2577 flags.go:64] FLAG: --version="false" Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326437 2577 flags.go:64] FLAG: --vmodule="" Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326440 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.326444 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326567 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326570 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326574 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326577 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326579 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326582 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326585 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326588 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326591 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326594 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326596 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326599 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326602 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326605 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326607 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:21:33.334568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326610 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326613 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326615 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326618 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326621 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326624 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326626 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326630 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326632 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326635 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326638 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326641 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326643 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326646 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326648 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326651 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326655 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326658 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326661 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326664 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326666 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:21:33.335081 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326669 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326671 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326674 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326678 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326682 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326685 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326688 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326691 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326693 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326696 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326699 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326701 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326705 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326709 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326712 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326715 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326718 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326722 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326727 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:21:33.335583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326730 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326733 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326736 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326739 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326742 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326744 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326747 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326750 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326753 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326756 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326759 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326761 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326764 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326767 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326769 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326772 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326775 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326777 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326780 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:21:33.336048 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326783 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326786 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326788 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326791 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326793 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326796 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326798 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326801 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326803 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326806 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326808 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326811 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326815 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326817 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326820 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326823 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326825 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326828 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326831 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:21:33.336531 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326833 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326836 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326839 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326842 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326844 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.326847 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.327836 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.334631 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.334652 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.334671 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.334685 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334746 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334752 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334755 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334758 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:21:33.337072 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334762 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334764 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334767 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334769 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334772 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334775 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334777 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334780 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334783 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334787 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334790 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334793 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334795 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334798 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334801 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334803 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334806 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334808 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334811 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334813 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:21:33.337436 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334816 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334819 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334821 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334843 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334847 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334857 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334860 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334863 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334866 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334869 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334872 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334875 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334878 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334881 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334883 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334886 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334889 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334900 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334903 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:21:33.338133 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334905 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334908 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334911 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334913 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334916 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334920 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334923 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334926 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334929 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334932 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334935 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334938 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334940 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334943 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334946 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334948 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334951 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334953 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334956 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334964 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:21:33.338595 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334967 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334970 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334972 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334975 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334977 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334980 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334982 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334986 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334989 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.334992 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335000 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335004 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335006 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335009 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335012 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335014 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335017 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335020 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335023 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335025 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:21:33.339065 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335028 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335030 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335033 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335035 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335038 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335040 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335043 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335045 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335048 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335050 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335053 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335056 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335064 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335066 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335069 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:21:33.339553 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335072 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.335077 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335220 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335225 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335228 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335231 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335233 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335236 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335239 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335241 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335244 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335246 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335249 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335251 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335254 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:21:33.339925 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335256 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335259 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335261 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335264 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335266 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335269 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335271 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335274 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335276 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335279 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335282 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335285 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335287 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335290 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335293 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335301 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335304 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335307 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335309 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335312 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335314 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:21:33.340282 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335317 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335319 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335321 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335324 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335328 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335332 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335334 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335337 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335339 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335342 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335345 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335347 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335350 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335352 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335355 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335357 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335359 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335362 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335366 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:21:33.340838 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335369 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335372 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335375 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335378 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335380 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335383 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335385 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335388 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335396 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335399 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335401 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335404 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335406 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335409 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335411 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335413 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335416 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335419 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335421 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:21:33.341284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335424 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335426 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335429 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335431 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335434 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335437 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335439 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335442 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335444 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335447 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335449 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335451 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335454 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335456 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335459 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335461 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335464 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335467 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335470 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:21:33.341734 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335473 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335476 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335478 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335487 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335490 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335505 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335509 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:33.335511 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.335517 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.335635 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.339402 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.340859 2577 server.go:1019] "Starting client certificate rotation" Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.340960 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:21:33.342176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.340994 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:21:33.343539 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.343525 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:21:33.344758 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.344744 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:21:33.358337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.358317 2577 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:21:33.360896 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.360877 2577 log.go:25] "Validated CRI v1 image API" Jul 01 19:21:33.361742 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.361715 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:21:33.365239 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.365211 2577 fs.go:135] Filesystem UUIDs: map[0aaaac5f-9c8e-4cb3-8615-70221277a464:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b6e572b6-5191-437a-a269-7c05a5c22da3:/dev/nvme0n1p4] Jul 01 19:21:33.365313 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.365238 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:21:33.367282 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.367264 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:21:33.372377 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.372265 2577 manager.go:216] Machine: {Timestamp:2026-07-01 19:21:33.369532719 +0000 UTC m=+0.373438721 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111058 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c68bf804b3a2510ccd309cf3905a SystemUUID:ec22c68b-f804-b3a2-510c-cd309cf3905a BootID:92cf8502-e121-40d6-b93f-0e49f70d4372 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:92:7c:32:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:92:7c:32:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:48:45:41:af:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:21:33.372377 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.372371 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:21:33.372485 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.372469 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:21:33.375831 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.375801 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:21:33.375995 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.375841 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:21:33.377610 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.377599 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:21:33.377651 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.377613 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:21:33.377651 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.377621 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:21:33.377651 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.377639 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:21:33.378681 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.378671 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:21:33.381710 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381698 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:21:33.381853 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381843 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:21:33.381907 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381899 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:21:33.381962 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381918 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:21:33.381962 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381935 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:21:33.381962 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381958 2577 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:21:33.382087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.381967 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:21:33.382378 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.382366 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:21:33.382407 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.382384 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:21:33.386588 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.386566 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:21:33.388046 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388033 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:21:33.388089 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388063 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:21:33.388784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388774 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:21:33.388827 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388789 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:21:33.388827 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388796 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:21:33.388827 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388801 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:21:33.388827 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388810 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:21:33.388827 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.388815 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:21:33.389021 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389013 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:21:33.389054 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389022 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:21:33.389054 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389029 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:21:33.389054 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389035 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:21:33.389054 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389049 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:21:33.389152 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389058 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:21:33.389904 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389895 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:21:33.389935 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.389904 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:21:33.391747 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.391728 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fsptc" Jul 01 19:21:33.393132 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.393113 2577 server.go:1268] "Started kubelet" Jul 01 19:21:33.393235 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.393205 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:21:33.393398 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.393340 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:21:33.393512 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.393481 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:21:33.393749 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.393731 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:21:33.393883 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.393857 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:21:33.393883 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.393874 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:21:33.394097 ip-10-0-140-188 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:21:33.395240 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.395222 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:21:33.395556 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.395543 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:21:33.397816 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.397800 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fsptc" Jul 01 19:21:33.400055 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.400035 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:21:33.400563 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.398815 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-188.ec2.internal.18be40bf6cc52f05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-188.ec2.internal,UID:ip-10-0-140-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-188.ec2.internal,},FirstTimestamp:2026-07-01 19:21:33.393088261 +0000 UTC m=+0.396994312,LastTimestamp:2026-07-01 19:21:33.393088261 +0000 UTC m=+0.396994312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-188.ec2.internal,}" Jul 01 19:21:33.402709 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.402693 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:21:33.402709 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.402704 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:21:33.402840 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.402819 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.403345 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.403329 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:21:33.403452 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.403441 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:21:33.403548 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.403329 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:21:33.403684 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.403671 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:21:33.403684 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.403685 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:21:33.403998 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.403982 2577 factory.go:55] Registering systemd factory Jul 01 19:21:33.404058 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.404001 2577 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:21:33.404268 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.404251 2577 factory.go:153] Registering CRI-O factory Jul 01 19:21:33.404327 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.404287 2577 factory.go:223] Registration of the crio container factory successfully Jul 01 19:21:33.404368 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.404348 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:21:33.404368 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.404367 2577 factory.go:103] Registering Raw factory Jul 01 19:21:33.404459 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.404377 2577 manager.go:1196] Started watching for new ooms in manager Jul 01 19:21:33.405013 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.404969 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:21:33.405106 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.405071 2577 manager.go:349] Starting recovery of all containers Jul 01 19:21:33.405173 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.405129 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:21:33.417062 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.417043 2577 manager.go:354] Recovery completed Jul 01 19:21:33.422216 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.422203 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.424148 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424130 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.424214 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424162 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.424214 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424173 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.424763 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424750 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:21:33.424763 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424763 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:21:33.424854 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424772 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.424854 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.424782 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:21:33.425971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.425679 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.425971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.425714 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.425971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.425727 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.427766 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.427752 2577 policy_none.go:49] "None policy: Start" Jul 01 19:21:33.427766 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.427767 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:21:33.427865 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.427778 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:21:33.428891 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.428881 2577 policy_none.go:47] "Start" Jul 01 19:21:33.470298 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470101 2577 manager.go:337] "Starting Device Plugin manager" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.470326 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470342 2577 server.go:87] "Starting device plugin registration server" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470661 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470674 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470779 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470872 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.470888 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.471406 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.471459 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.481800 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.483164 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.483203 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.483224 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.483263 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:21:33.488118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.485576 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:21:33.571123 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.571022 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.573598 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.573579 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.573714 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.573612 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.573714 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.573628 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.573714 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.573667 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.582372 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.582354 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.582459 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.582379 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-188.ec2.internal\": node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.583385 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.583367 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal"] Jul 01 19:21:33.583442 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.583431 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.584320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.584305 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.584422 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.584336 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.584422 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.584351 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.585724 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.585709 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.585812 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.585803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.585860 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.585841 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.586465 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.586450 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.586553 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.586473 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.586553 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.586483 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.586655 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.586553 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.586655 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.586576 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.586655 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.586590 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.587809 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.587793 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.587889 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.587823 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:21:33.588566 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.588551 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:21:33.588664 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.588578 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:21:33.588664 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.588592 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:21:33.602066 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.602042 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-188.ec2.internal\" not found" node="ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.604620 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.604603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43c2028bb0769ca652aa3d0222a48a4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal\" (UID: \"43c2028bb0769ca652aa3d0222a48a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.604715 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.604635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43c2028bb0769ca652aa3d0222a48a4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal\" (UID: \"43c2028bb0769ca652aa3d0222a48a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.604715 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.604664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5bd03072a955915507969a2e0aed7f92-config\") pod \"kube-apiserver-proxy-ip-10-0-140-188.ec2.internal\" (UID: \"5bd03072a955915507969a2e0aed7f92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.606084 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.606068 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.606185 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.606166 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-188.ec2.internal\" not found" node="ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.705405 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.705376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43c2028bb0769ca652aa3d0222a48a4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal\" (UID: \"43c2028bb0769ca652aa3d0222a48a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.705573 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.705411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5bd03072a955915507969a2e0aed7f92-config\") pod \"kube-apiserver-proxy-ip-10-0-140-188.ec2.internal\" (UID: \"5bd03072a955915507969a2e0aed7f92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.705573 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.705432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43c2028bb0769ca652aa3d0222a48a4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal\" (UID: \"43c2028bb0769ca652aa3d0222a48a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.705573 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.705463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5bd03072a955915507969a2e0aed7f92-config\") pod \"kube-apiserver-proxy-ip-10-0-140-188.ec2.internal\" (UID: \"5bd03072a955915507969a2e0aed7f92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.705573 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.705472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43c2028bb0769ca652aa3d0222a48a4f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal\" (UID: \"43c2028bb0769ca652aa3d0222a48a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.705573 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.705513 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43c2028bb0769ca652aa3d0222a48a4f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal\" (UID: \"43c2028bb0769ca652aa3d0222a48a4f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.706435 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.706417 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.806729 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.806702 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.905690 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.905614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:33.907271 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:33.907253 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:33.909949 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:33.909932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" Jul 01 19:21:34.007644 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.007607 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.108673 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.108635 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.209461 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.209382 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.310318 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.310269 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.341844 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.341811 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:21:34.342288 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.341977 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:21:34.402519 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.402442 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:16:33 +0000 UTC" deadline="2027-12-19 02:40:59.725042787 +0000 UTC" Jul 01 19:21:34.402519 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.402492 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12847h19m25.322554589s" Jul 01 19:21:34.410764 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.410738 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.511556 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.511447 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.605789 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.605763 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:21:34.612126 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:34.612103 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-188.ec2.internal\" not found" Jul 01 19:21:34.693515 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:34.693482 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd03072a955915507969a2e0aed7f92.slice/crio-9e6e1a088db923466f32e4d8c156a72a8f2455394decc215dd54e5a28b53fa5a WatchSource:0}: Error finding container 9e6e1a088db923466f32e4d8c156a72a8f2455394decc215dd54e5a28b53fa5a: Status 404 returned error can't find the container with id 9e6e1a088db923466f32e4d8c156a72a8f2455394decc215dd54e5a28b53fa5a Jul 01 19:21:34.698194 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.698178 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:21:34.699144 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.699129 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:21:34.703833 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.703817 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" Jul 01 19:21:34.716329 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.716307 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:21:34.718433 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.718418 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" Jul 01 19:21:34.725993 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.725972 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:21:34.759063 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:34.759035 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:21:34.928054 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:34.928026 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c2028bb0769ca652aa3d0222a48a4f.slice/crio-7eff477d17632eed06e928c1f7b457cb787a1fe2674abbe5bff218bbb7d2cf2a WatchSource:0}: Error finding container 7eff477d17632eed06e928c1f7b457cb787a1fe2674abbe5bff218bbb7d2cf2a: Status 404 returned error can't find the container with id 7eff477d17632eed06e928c1f7b457cb787a1fe2674abbe5bff218bbb7d2cf2a Jul 01 19:21:35.383764 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.383660 2577 apiserver.go:52] "Watching apiserver" Jul 01 19:21:35.393774 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.393743 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:21:35.394227 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.394193 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qz4lv","openshift-dns/node-resolver-7v7b7","openshift-image-registry/node-ca-f6m72","openshift-multus/multus-ks8tz","openshift-multus/network-metrics-daemon-56gcg","openshift-network-diagnostics/network-check-target-h9bmp","openshift-network-operator/iptables-alerter-cphkp","openshift-ovn-kubernetes/ovnkube-node-f8jjd","kube-system/global-pull-secret-syncer-ll98k","kube-system/konnectivity-agent-l9tmc","kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal","openshift-multus/multus-additional-cni-plugins-l5jgl"] Jul 01 19:21:35.395956 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.395932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.397557 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.397534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.398653 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.398627 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.399543 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.399508 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:21:35.399861 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.399841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.401317 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.401297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:35.401456 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.401429 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:35.401565 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.401548 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9jt9m\"" Jul 01 19:21:35.401761 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.401743 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:21:35.401822 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.401749 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.402726 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.402709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.403786 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404105 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fwn8b\"" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404278 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404438 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404550 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404704 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j2vqf\"" Jul 01 19:21:35.405626 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.404903 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:21:35.406082 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.405758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.408114 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.407430 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:21:35.408114 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.407786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.408114 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.407859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:21:35.408114 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.408063 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:21:35.408114 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.408082 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t8cgn\"" Jul 01 19:21:35.410336 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.409643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.410336 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.410119 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.410704 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.410746 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411011 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411075 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411271 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411279 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411516 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411714 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mtdhx\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411831 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411870 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d2gr7\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.411925 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fc8ph\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.412012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.412072 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.412149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.412208 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.412235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.412349 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.412617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.412520 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jxnzp\"" Jul 01 19:21:35.413634 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.413094 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:21:35.413634 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.413154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:35.413634 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.413219 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:35.415322 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.415301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cn587\"" Jul 01 19:21:35.415717 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.415698 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:21:35.417265 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.416630 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:21:35.417265 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.417105 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7e63629-7610-47af-9d26-ab628d916015-serviceca\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419209 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysctl-d\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-host\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovnkube-script-lib\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7e63629-7610-47af-9d26-ab628d916015-host\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-run-netns\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-hostroot\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-conf-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-daemon-config\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4506ecc-840e-499e-a1f8-8262c71abd35-konnectivity-ca\") pod \"konnectivity-agent-l9tmc\" (UID: \"f4506ecc-840e-499e-a1f8-8262c71abd35\") " pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-modprobe-d\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-system-cni-dir\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-var-lib-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.422784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-cni-bin\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-sys-fs\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-systemd\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.419901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-socket-dir-parent\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-etc-kubernetes\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-registration-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-env-overrides\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-os-release\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-cni-bin\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-run\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-lib-modules\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gkf\" (UniqueName: \"kubernetes.io/projected/7fa1cca5-71a8-41f0-af8c-84ff7014d131-kube-api-access-78gkf\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-slash\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.423631 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-systemd\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovnkube-config\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-cni-multus\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-kubelet\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-kubelet\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.420877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-ovn\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-multus-certs\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-socket-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4506ecc-840e-499e-a1f8-8262c71abd35-agent-certs\") pod \"konnectivity-agent-l9tmc\" (UID: \"f4506ecc-840e-499e-a1f8-8262c71abd35\") " pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vmm\" (UniqueName: \"kubernetes.io/projected/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-kube-api-access-74vmm\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-cni-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-cni-netd\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysctl-conf\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.424236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kbxz\" (UniqueName: \"kubernetes.io/projected/c7e63629-7610-47af-9d26-ab628d916015-kube-api-access-9kbxz\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-systemd-units\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-log-socket\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-sys\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j2k2\" (UniqueName: \"kubernetes.io/projected/4ce39f68-291d-4fa7-aa72-acc4334715c4-kube-api-access-5j2k2\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-system-cni-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cnibin\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.421992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-os-release\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-cnibin\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-device-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-kubernetes\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fa1cca5-71a8-41f0-af8c-84ff7014d131-tmp\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.422939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb2rp\" (UniqueName: \"kubernetes.io/projected/9d065d01-69d8-4b2d-9359-8fd46eed1caf-kube-api-access-nb2rp\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-cni-binary-copy\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.425031 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-etc-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovn-node-metrics-cert\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423261 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-netns\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htblq\" (UniqueName: \"kubernetes.io/projected/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-kube-api-access-htblq\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423445 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k69dp\" (UniqueName: \"kubernetes.io/projected/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-kube-api-access-k69dp\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysconfig\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-var-lib-kubelet\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-tuned\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-node-log\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.425656 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.423717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-k8s-cni-cncf-io\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.429692 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.429670 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:21:35.458456 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.458218 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w9frj" Jul 01 19:21:35.472556 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.472530 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w9frj" Jul 01 19:21:35.490145 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.490085 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" event={"ID":"43c2028bb0769ca652aa3d0222a48a4f","Type":"ContainerStarted","Data":"7eff477d17632eed06e928c1f7b457cb787a1fe2674abbe5bff218bbb7d2cf2a"} Jul 01 19:21:35.491533 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.491504 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" event={"ID":"5bd03072a955915507969a2e0aed7f92","Type":"ContainerStarted","Data":"9e6e1a088db923466f32e4d8c156a72a8f2455394decc215dd54e5a28b53fa5a"} Jul 01 19:21:35.504995 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.504972 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:21:35.525020 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.524961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-cni-binary-copy\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.525020 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-etc-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovn-node-metrics-cert\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-netns\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htblq\" (UniqueName: \"kubernetes.io/projected/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-kube-api-access-htblq\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k69dp\" (UniqueName: \"kubernetes.io/projected/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-kube-api-access-k69dp\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e2cb84b-b822-4d3b-9358-41076175c222-kubelet-config\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysconfig\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.525228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-var-lib-kubelet\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-tuned\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-node-log\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-k8s-cni-cncf-io\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e4f15b3-7d74-4722-867b-7e03e738c6ce-tmp-dir\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7e63629-7610-47af-9d26-ab628d916015-serviceca\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e4f15b3-7d74-4722-867b-7e03e738c6ce-hosts-file\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysctl-d\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-host\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovnkube-script-lib\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7e63629-7610-47af-9d26-ab628d916015-host\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-run-netns\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-host\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.525678 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysconfig\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-hostroot\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-conf-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-daemon-config\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4506ecc-840e-499e-a1f8-8262c71abd35-konnectivity-ca\") pod \"konnectivity-agent-l9tmc\" (UID: \"f4506ecc-840e-499e-a1f8-8262c71abd35\") " pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-modprobe-d\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525891 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7e63629-7610-47af-9d26-ab628d916015-host\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-system-cni-dir\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-var-lib-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-run-netns\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-cni-bin\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.525999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-sys-fs\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-systemd\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.526627 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-socket-dir-parent\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7e63629-7610-47af-9d26-ab628d916015-serviceca\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-etc-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-modprobe-d\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-etc-kubernetes\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-registration-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526268 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-var-lib-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-iptables-alerter-script\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-cni-bin\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-host-slash\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-cni-binary-copy\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-env-overrides\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovnkube-script-lib\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-os-release\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-cni-bin\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.527482 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-run\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-k8s-cni-cncf-io\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526472 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-netns\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-lib-modules\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4506ecc-840e-499e-a1f8-8262c71abd35-konnectivity-ca\") pod \"konnectivity-agent-l9tmc\" (UID: \"f4506ecc-840e-499e-a1f8-8262c71abd35\") " pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526519 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78gkf\" (UniqueName: \"kubernetes.io/projected/7fa1cca5-71a8-41f0-af8c-84ff7014d131-kube-api-access-78gkf\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526527 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-sys-fs\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-slash\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-systemd\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-lib-modules\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-system-cni-dir\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-node-log\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-systemd\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-slash\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-var-lib-kubelet\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-systemd\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.528337 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-hostroot\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-etc-kubernetes\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovnkube-config\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-cni-multus\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-kubelet\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-kubelet\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-ovn\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.526998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysctl-d\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-multus-certs\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527036 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-cni-bin\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527051 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-cni-multus\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-socket-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527101 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-openvswitch\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qq4j\" (UniqueName: \"kubernetes.io/projected/3e4f15b3-7d74-4722-867b-7e03e738c6ce-kube-api-access-2qq4j\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.529228 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4506ecc-840e-499e-a1f8-8262c71abd35-agent-certs\") pod \"konnectivity-agent-l9tmc\" (UID: \"f4506ecc-840e-499e-a1f8-8262c71abd35\") " pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vmm\" (UniqueName: \"kubernetes.io/projected/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-kube-api-access-74vmm\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527237 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-os-release\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-daemon-config\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-cni-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527343 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-socket-dir-parent\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.527345 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527371 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdr98\" (UniqueName: \"kubernetes.io/projected/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-kube-api-access-zdr98\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-cni-netd\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e2cb84b-b822-4d3b-9358-41076175c222-dbus\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527468 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysctl-conf\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kbxz\" (UniqueName: \"kubernetes.io/projected/c7e63629-7610-47af-9d26-ab628d916015-kube-api-access-9kbxz\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-env-overrides\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.527550 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:36.027514554 +0000 UTC m=+3.031420564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-registration-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.530087 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-systemd-units\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-var-lib-kubelet\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-log-socket\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-socket-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527725 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-sys\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-conf-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j2k2\" (UniqueName: \"kubernetes.io/projected/4ce39f68-291d-4fa7-aa72-acc4334715c4-kube-api-access-5j2k2\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-system-cni-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527824 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-cni-netd\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cnibin\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.527932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cnibin\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528001 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-systemd-units\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-multus-cni-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528044 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-sys\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-os-release\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.530988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-sysctl-conf\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528132 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-cnibin\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528186 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-host-run-multus-certs\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-device-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-system-cni-dir\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-kubernetes\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovnkube-config\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-kubernetes\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-cnibin\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fa1cca5-71a8-41f0-af8c-84ff7014d131-run\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-kubelet\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fa1cca5-71a8-41f0-af8c-84ff7014d131-tmp\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9d065d01-69d8-4b2d-9359-8fd46eed1caf-device-dir\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-log-socket\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.531898 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-run-ovn\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.532793 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb2rp\" (UniqueName: \"kubernetes.io/projected/9d065d01-69d8-4b2d-9359-8fd46eed1caf-kube-api-access-nb2rp\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.532793 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528556 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-os-release\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.532793 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ce39f68-291d-4fa7-aa72-acc4334715c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.532793 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.528683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.533012 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.532862 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fa1cca5-71a8-41f0-af8c-84ff7014d131-etc-tuned\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.533302 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.533145 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4506ecc-840e-499e-a1f8-8262c71abd35-agent-certs\") pod \"konnectivity-agent-l9tmc\" (UID: \"f4506ecc-840e-499e-a1f8-8262c71abd35\") " pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.533639 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.533461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ce39f68-291d-4fa7-aa72-acc4334715c4-ovn-node-metrics-cert\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.535702 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.535678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fa1cca5-71a8-41f0-af8c-84ff7014d131-tmp\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.537460 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.537322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htblq\" (UniqueName: \"kubernetes.io/projected/a6669e6a-96f3-4c76-adb0-130a1a5c1d10-kube-api-access-htblq\") pod \"multus-ks8tz\" (UID: \"a6669e6a-96f3-4c76-adb0-130a1a5c1d10\") " pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.539376 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.539324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k69dp\" (UniqueName: \"kubernetes.io/projected/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-kube-api-access-k69dp\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:35.542356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.541987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vmm\" (UniqueName: \"kubernetes.io/projected/fdf0e61f-92a2-4a9e-be15-32c16367d8f3-kube-api-access-74vmm\") pod \"multus-additional-cni-plugins-l5jgl\" (UID: \"fdf0e61f-92a2-4a9e-be15-32c16367d8f3\") " pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.543713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.543068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j2k2\" (UniqueName: \"kubernetes.io/projected/4ce39f68-291d-4fa7-aa72-acc4334715c4-kube-api-access-5j2k2\") pod \"ovnkube-node-f8jjd\" (UID: \"4ce39f68-291d-4fa7-aa72-acc4334715c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.544085 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.544030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kbxz\" (UniqueName: \"kubernetes.io/projected/c7e63629-7610-47af-9d26-ab628d916015-kube-api-access-9kbxz\") pod \"node-ca-f6m72\" (UID: \"c7e63629-7610-47af-9d26-ab628d916015\") " pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.545025 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.544995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb2rp\" (UniqueName: \"kubernetes.io/projected/9d065d01-69d8-4b2d-9359-8fd46eed1caf-kube-api-access-nb2rp\") pod \"aws-ebs-csi-driver-node-x6vmb\" (UID: \"9d065d01-69d8-4b2d-9359-8fd46eed1caf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.545464 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.545442 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gkf\" (UniqueName: \"kubernetes.io/projected/7fa1cca5-71a8-41f0-af8c-84ff7014d131-kube-api-access-78gkf\") pod \"tuned-qz4lv\" (UID: \"7fa1cca5-71a8-41f0-af8c-84ff7014d131\") " pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.629859 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.629691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-iptables-alerter-script\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.629859 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.629736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-host-slash\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.629859 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.629788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qq4j\" (UniqueName: \"kubernetes.io/projected/3e4f15b3-7d74-4722-867b-7e03e738c6ce-kube-api-access-2qq4j\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.630191 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.629863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-host-slash\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.630191 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:35.630191 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdr98\" (UniqueName: \"kubernetes.io/projected/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-kube-api-access-zdr98\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.630191 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e2cb84b-b822-4d3b-9358-41076175c222-dbus\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.630191 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.630458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e2cb84b-b822-4d3b-9358-41076175c222-kubelet-config\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.630458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e4f15b3-7d74-4722-867b-7e03e738c6ce-tmp-dir\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.630458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e4f15b3-7d74-4722-867b-7e03e738c6ce-hosts-file\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.630458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e4f15b3-7d74-4722-867b-7e03e738c6ce-hosts-file\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.630458 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.630430 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:35.630754 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-iptables-alerter-script\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.630754 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e2cb84b-b822-4d3b-9358-41076175c222-dbus\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.630754 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.630495 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:36.13047562 +0000 UTC m=+3.134381624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:35.630754 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e2cb84b-b822-4d3b-9358-41076175c222-kubelet-config\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:35.630976 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.630805 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e4f15b3-7d74-4722-867b-7e03e738c6ce-tmp-dir\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.639088 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.638973 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:21:35.639088 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.639003 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:21:35.639088 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.639017 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:35.639382 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:35.639093 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:21:36.139072748 +0000 UTC m=+3.142978741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:35.639382 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.639170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qq4j\" (UniqueName: \"kubernetes.io/projected/3e4f15b3-7d74-4722-867b-7e03e738c6ce-kube-api-access-2qq4j\") pod \"node-resolver-7v7b7\" (UID: \"3e4f15b3-7d74-4722-867b-7e03e738c6ce\") " pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.642652 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.642302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdr98\" (UniqueName: \"kubernetes.io/projected/b6ec83d0-4da2-4873-a27e-8bfedbf4d174-kube-api-access-zdr98\") pod \"iptables-alerter-cphkp\" (UID: \"b6ec83d0-4da2-4873-a27e-8bfedbf4d174\") " pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:35.712794 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.712754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:35.723484 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.723454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" Jul 01 19:21:35.723668 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:35.723642 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4506ecc_840e_499e_a1f8_8262c71abd35.slice/crio-3cdc5c229cfe414c880aef36bf4158be6c4cbc53ca1d617241dab9e47fd7d55b WatchSource:0}: Error finding container 3cdc5c229cfe414c880aef36bf4158be6c4cbc53ca1d617241dab9e47fd7d55b: Status 404 returned error can't find the container with id 3cdc5c229cfe414c880aef36bf4158be6c4cbc53ca1d617241dab9e47fd7d55b Jul 01 19:21:35.733416 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.733231 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f6m72" Jul 01 19:21:35.743495 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.743297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ks8tz" Jul 01 19:21:35.743495 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:35.743376 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e63629_7610_47af_9d26_ab628d916015.slice/crio-e8d0c7d89becf6f6582be56944439cc291bdaccf664b376029ea3716c8a64b39 WatchSource:0}: Error finding container e8d0c7d89becf6f6582be56944439cc291bdaccf664b376029ea3716c8a64b39: Status 404 returned error can't find the container with id e8d0c7d89becf6f6582be56944439cc291bdaccf664b376029ea3716c8a64b39 Jul 01 19:21:35.752360 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.752334 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" Jul 01 19:21:35.752552 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:35.752526 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6669e6a_96f3_4c76_adb0_130a1a5c1d10.slice/crio-76e4c9be7e808b63b65f32c741b6631e04a8f2f241f9f6c84ea0595f66ea5e3b WatchSource:0}: Error finding container 76e4c9be7e808b63b65f32c741b6631e04a8f2f241f9f6c84ea0595f66ea5e3b: Status 404 returned error can't find the container with id 76e4c9be7e808b63b65f32c741b6631e04a8f2f241f9f6c84ea0595f66ea5e3b Jul 01 19:21:35.760590 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.760553 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:21:35.769654 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.769631 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" Jul 01 19:21:35.775958 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.775935 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:21:35.778151 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.778122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7v7b7" Jul 01 19:21:35.785006 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:35.784981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cphkp" Jul 01 19:21:36.034562 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.034499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:36.034748 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.034723 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:36.034819 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.034804 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:37.034782972 +0000 UTC m=+4.038688967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:36.135347 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.135309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:36.135497 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.135449 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:36.135567 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.135520 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:37.135503933 +0000 UTC m=+4.139409927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:36.236033 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.235991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:36.236246 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.236213 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:21:36.236246 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.236248 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:21:36.236417 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.236265 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:36.236417 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:36.236337 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:21:37.236317188 +0000 UTC m=+4.240223197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:36.475712 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.475616 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:16:35 +0000 UTC" deadline="2028-01-17 19:15:38.022647909 +0000 UTC" Jul 01 19:21:36.475712 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.475657 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13559h54m1.546995756s" Jul 01 19:21:36.495041 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.495001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f6m72" event={"ID":"c7e63629-7610-47af-9d26-ab628d916015","Type":"ContainerStarted","Data":"e8d0c7d89becf6f6582be56944439cc291bdaccf664b376029ea3716c8a64b39"} Jul 01 19:21:36.496340 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.496307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" event={"ID":"7fa1cca5-71a8-41f0-af8c-84ff7014d131","Type":"ContainerStarted","Data":"26fc7dfb593ad8a949106c7370c9a016ffa764420a49f2871940aaedf647c2f8"} Jul 01 19:21:36.497488 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.497457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l9tmc" event={"ID":"f4506ecc-840e-499e-a1f8-8262c71abd35","Type":"ContainerStarted","Data":"3cdc5c229cfe414c880aef36bf4158be6c4cbc53ca1d617241dab9e47fd7d55b"} Jul 01 19:21:36.498612 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:36.498591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ks8tz" event={"ID":"a6669e6a-96f3-4c76-adb0-130a1a5c1d10","Type":"ContainerStarted","Data":"76e4c9be7e808b63b65f32c741b6631e04a8f2f241f9f6c84ea0595f66ea5e3b"} Jul 01 19:21:36.806690 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:36.806626 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf0e61f_92a2_4a9e_be15_32c16367d8f3.slice/crio-78c12ab4003174676fe11b87d2ce67ec74e55815f272dfd1da655803747f47ed WatchSource:0}: Error finding container 78c12ab4003174676fe11b87d2ce67ec74e55815f272dfd1da655803747f47ed: Status 404 returned error can't find the container with id 78c12ab4003174676fe11b87d2ce67ec74e55815f272dfd1da655803747f47ed Jul 01 19:21:36.813284 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:36.813261 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce39f68_291d_4fa7_aa72_acc4334715c4.slice/crio-7fc21d8efd491bb13424207e7c3e8102b4282d3086c436218b7fc1886ca6e1d6 WatchSource:0}: Error finding container 7fc21d8efd491bb13424207e7c3e8102b4282d3086c436218b7fc1886ca6e1d6: Status 404 returned error can't find the container with id 7fc21d8efd491bb13424207e7c3e8102b4282d3086c436218b7fc1886ca6e1d6 Jul 01 19:21:36.814908 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:36.814884 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d065d01_69d8_4b2d_9359_8fd46eed1caf.slice/crio-9b08594227d02f9beca67d7ffec113dc7b01f26299ff2840d81b8787f65b9742 WatchSource:0}: Error finding container 9b08594227d02f9beca67d7ffec113dc7b01f26299ff2840d81b8787f65b9742: Status 404 returned error can't find the container with id 9b08594227d02f9beca67d7ffec113dc7b01f26299ff2840d81b8787f65b9742 Jul 01 19:21:36.816198 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:21:36.816174 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4f15b3_7d74_4722_867b_7e03e738c6ce.slice/crio-fa5853224c7277386cf342159cd3a9d5efdb164ea4180e24d4e44cea670a2f93 WatchSource:0}: Error finding container fa5853224c7277386cf342159cd3a9d5efdb164ea4180e24d4e44cea670a2f93: Status 404 returned error can't find the container with id fa5853224c7277386cf342159cd3a9d5efdb164ea4180e24d4e44cea670a2f93 Jul 01 19:21:37.042617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.042181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:37.042617 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.042517 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:37.042840 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.042623 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:39.042601044 +0000 UTC m=+6.046507043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:37.143313 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.143129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:37.144063 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.143568 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:37.144063 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.143677 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:39.143654704 +0000 UTC m=+6.147560718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:37.244468 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.244439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:37.244688 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.244672 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:21:37.244758 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.244695 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:21:37.244758 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.244708 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:37.244860 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.244766 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:21:39.244747503 +0000 UTC m=+6.248653498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:37.476239 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.476115 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:16:35 +0000 UTC" deadline="2028-01-29 08:52:20.718028116 +0000 UTC" Jul 01 19:21:37.476239 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.476160 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13837h30m43.241872708s" Jul 01 19:21:37.493527 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.491214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:37.493527 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.491214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:37.493527 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.491382 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:37.493527 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.491469 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:37.493527 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.491223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:37.493527 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:37.491625 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:37.516897 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.516233 2577 generic.go:356] "Generic (PLEG): container finished" podID="43c2028bb0769ca652aa3d0222a48a4f" containerID="7a0adf3f7277d6f6157e8938bbf0139d27eebb78e41cded3d1fe2b5c1522749a" exitCode=0 Jul 01 19:21:37.516897 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.516549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" event={"ID":"43c2028bb0769ca652aa3d0222a48a4f","Type":"ContainerDied","Data":"7a0adf3f7277d6f6157e8938bbf0139d27eebb78e41cded3d1fe2b5c1522749a"} Jul 01 19:21:37.537585 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.537551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" event={"ID":"5bd03072a955915507969a2e0aed7f92","Type":"ContainerStarted","Data":"34184cb15000f1f0bb960366e8ddd21ba9a1ec426182a54b89e59daa0ef53bef"} Jul 01 19:21:37.556838 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.556808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" event={"ID":"9d065d01-69d8-4b2d-9359-8fd46eed1caf","Type":"ContainerStarted","Data":"9b08594227d02f9beca67d7ffec113dc7b01f26299ff2840d81b8787f65b9742"} Jul 01 19:21:37.584282 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.584241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cphkp" event={"ID":"b6ec83d0-4da2-4873-a27e-8bfedbf4d174","Type":"ContainerStarted","Data":"d408a6bfc52969c521430382632316690aebf0bda1a8c6f2380b052cd01ec71b"} Jul 01 19:21:37.593273 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.593111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7v7b7" event={"ID":"3e4f15b3-7d74-4722-867b-7e03e738c6ce","Type":"ContainerStarted","Data":"fa5853224c7277386cf342159cd3a9d5efdb164ea4180e24d4e44cea670a2f93"} Jul 01 19:21:37.602697 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.602661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"7fc21d8efd491bb13424207e7c3e8102b4282d3086c436218b7fc1886ca6e1d6"} Jul 01 19:21:37.613619 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:37.613586 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerStarted","Data":"78c12ab4003174676fe11b87d2ce67ec74e55815f272dfd1da655803747f47ed"} Jul 01 19:21:38.629352 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:38.629093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" event={"ID":"43c2028bb0769ca652aa3d0222a48a4f","Type":"ContainerStarted","Data":"13b22a87415abaff66e22efd17a391f5de167e1e0ba1732bfd6cc8701d80c005"} Jul 01 19:21:38.643057 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:38.642986 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-188.ec2.internal" podStartSLOduration=4.642964379 podStartE2EDuration="4.642964379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:37.556658784 +0000 UTC m=+4.560564797" watchObservedRunningTime="2026-07-01 19:21:38.642964379 +0000 UTC m=+5.646870393" Jul 01 19:21:39.060940 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:39.060287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:39.060940 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.060466 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:39.060940 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.060544 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:43.060525861 +0000 UTC m=+10.064431865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:39.161177 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:39.161139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:39.161363 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.161305 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:39.161425 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.161369 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:43.161350146 +0000 UTC m=+10.165256141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:39.261690 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:39.261653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:39.261886 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.261866 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:21:39.261947 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.261889 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:21:39.261947 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.261905 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:39.262043 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.261965 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:21:43.261947237 +0000 UTC m=+10.265853231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:39.484732 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:39.484654 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:39.484894 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.484794 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:39.485211 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:39.485188 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:39.485312 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.485285 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:39.485484 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:39.485464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:39.485581 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:39.485561 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:41.484784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:41.484265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:41.484784 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:41.484414 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:41.484784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:41.484559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:41.484784 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:41.484648 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:41.484784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:41.484694 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:41.484784 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:41.484755 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:43.093640 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:43.093598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:43.094096 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.093793 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:43.094096 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.093878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:51.09385704 +0000 UTC m=+18.097763053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:43.194950 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:43.194911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:43.195166 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.195055 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:43.195166 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.195127 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:21:51.195105115 +0000 UTC m=+18.199011144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:43.296426 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:43.296285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:43.296633 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.296473 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:21:43.296633 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.296510 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:21:43.296633 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.296523 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:43.296633 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.296601 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:21:51.296568558 +0000 UTC m=+18.300474562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:43.485060 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:43.484554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:43.485060 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:43.484651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:43.485060 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.484669 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:43.485060 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.484764 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:43.485060 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:43.484787 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:43.485060 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:43.484880 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:45.484190 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:45.483722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:45.484190 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:45.483741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:45.484190 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:45.483722 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:45.484190 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:45.483856 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:45.484190 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:45.483975 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:45.484190 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:45.484061 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:47.483834 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:47.483797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:47.484260 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:47.483797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:47.484260 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:47.483927 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:47.484260 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:47.483934 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:47.484260 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:47.483998 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:47.484260 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:47.484070 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:49.483759 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:49.483720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:49.484177 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:49.483727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:49.484177 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:49.483867 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:49.484177 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:49.483727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:49.484177 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:49.483918 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:49.484177 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:49.483985 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:51.155968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:51.155909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:51.156555 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.156107 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:51.156555 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.156193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:07.156172561 +0000 UTC m=+34.160078550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:21:51.257280 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:51.257241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:51.257471 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.257365 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:51.257471 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.257423 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:07.257404225 +0000 UTC m=+34.261310221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:21:51.357873 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:51.357832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:51.358049 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.357983 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:21:51.358049 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.357998 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:21:51.358049 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.358007 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:51.358198 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.358072 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:07.358051564 +0000 UTC m=+34.361957576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:21:51.484440 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:51.484359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:51.484612 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:51.484359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:51.484612 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.484515 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:51.484612 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:51.484365 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:51.484612 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.484570 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:51.484769 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:51.484642 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:53.485020 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:53.484986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:53.485576 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:53.485099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:53.485576 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:53.485108 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:53.485576 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:53.485182 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:53.485576 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:53.485198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:53.485576 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:53.485300 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:55.484008 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.483914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:55.484449 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.483914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:55.484449 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:55.484054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:55.484449 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.483914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:55.484449 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:55.484146 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:55.484449 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:55.484234 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:55.665647 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.665615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f6m72" event={"ID":"c7e63629-7610-47af-9d26-ab628d916015","Type":"ContainerStarted","Data":"ffc2706164e02f6b15267949f6b007052e0147d7d396e734537c4a09e970790f"} Jul 01 19:21:55.667092 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.667063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" event={"ID":"7fa1cca5-71a8-41f0-af8c-84ff7014d131","Type":"ContainerStarted","Data":"3e2681f4c5393b42e9622eae1dc876a90920c7af8d7b3d8e6b3a0b17ec2b8b1e"} Jul 01 19:21:55.668367 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.668327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l9tmc" event={"ID":"f4506ecc-840e-499e-a1f8-8262c71abd35","Type":"ContainerStarted","Data":"c442635aecbd1cef935964ab64248fbd699aef21a337bad01bff2b1c9cc672b6"} Jul 01 19:21:55.669959 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.669774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" event={"ID":"9d065d01-69d8-4b2d-9359-8fd46eed1caf","Type":"ContainerStarted","Data":"370031ff9a685afed64cdf5845c1c943827b0961202a7f714e97b30c0fe5acd6"} Jul 01 19:21:55.671305 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.671242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7v7b7" event={"ID":"3e4f15b3-7d74-4722-867b-7e03e738c6ce","Type":"ContainerStarted","Data":"90795fec3e9b665cca0054f2d9ddc51d0931584f11509fae044a6e2d96d1144c"} Jul 01 19:21:55.672867 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.672847 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ks8tz" event={"ID":"a6669e6a-96f3-4c76-adb0-130a1a5c1d10","Type":"ContainerStarted","Data":"36522e0168f2771b19c965a955f7595315bbc10c3bc1c453245d56aebb3adbdd"} Jul 01 19:21:55.674345 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.674325 2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0e61f-92a2-4a9e-be15-32c16367d8f3" containerID="0b9bf97df86bdc0c76ad84ffb0b5c4ad79e1da5ee5ab927d299fe00948a42994" exitCode=0 Jul 01 19:21:55.674413 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.674354 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerDied","Data":"0b9bf97df86bdc0c76ad84ffb0b5c4ad79e1da5ee5ab927d299fe00948a42994"} Jul 01 19:21:55.684809 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.684763 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-188.ec2.internal" podStartSLOduration=21.684732228 podStartE2EDuration="21.684732228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:38.644168609 +0000 UTC m=+5.648074621" watchObservedRunningTime="2026-07-01 19:21:55.684732228 +0000 UTC m=+22.688638236" Jul 01 19:21:55.685097 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.685071 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f6m72" podStartSLOduration=3.336623027 podStartE2EDuration="22.68506247s" totalImagesPullingTime="19.348439443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:55.684843866 +0000 UTC m=+22.688749876" watchObservedRunningTime="2026-07-01 19:21:55.68506247 +0000 UTC m=+22.688968482" Jul 01 19:21:55.724828 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.724768 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l9tmc" podStartSLOduration=11.598694584 podStartE2EDuration="22.724746972s" totalImagesPullingTime="11.126052388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:55.702319419 +0000 UTC m=+22.706225428" watchObservedRunningTime="2026-07-01 19:21:55.724746972 +0000 UTC m=+22.728652984" Jul 01 19:21:55.743713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.743667 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ks8tz" podStartSLOduration=3.356454802 podStartE2EDuration="22.743653773s" totalImagesPullingTime="19.387198971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:55.743534911 +0000 UTC m=+22.747440922" watchObservedRunningTime="2026-07-01 19:21:55.743653773 +0000 UTC m=+22.747559784" Jul 01 19:21:55.744400 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.744297 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qz4lv" podStartSLOduration=3.363542609 podStartE2EDuration="22.744288884s" totalImagesPullingTime="19.380746275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:55.724417838 +0000 UTC m=+22.728323843" watchObservedRunningTime="2026-07-01 19:21:55.744288884 +0000 UTC m=+22.748194894" Jul 01 19:21:55.788409 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:55.788351 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7v7b7" podStartSLOduration=3.492486302 podStartE2EDuration="21.788335758s" totalImagesPullingTime="18.295849456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:55.787970697 +0000 UTC m=+22.791876709" watchObservedRunningTime="2026-07-01 19:21:55.788335758 +0000 UTC m=+22.792241769" Jul 01 19:21:56.673278 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.673099 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:21:56.678625 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.678596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" event={"ID":"9d065d01-69d8-4b2d-9359-8fd46eed1caf","Type":"ContainerStarted","Data":"4c738e6b847ecec48c159b10b65d55c7300d9e5846dcb9b317989f1a55d58a6f"} Jul 01 19:21:56.680144 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.680090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cphkp" event={"ID":"b6ec83d0-4da2-4873-a27e-8bfedbf4d174","Type":"ContainerStarted","Data":"8ce4e9e62f39caa4c2004d6bdeec5c16b8717a35ad7fd74280a30516fe583204"} Jul 01 19:21:56.684771 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.683925 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:21:56.684771 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.684272 2577 generic.go:356] "Generic (PLEG): container finished" podID="4ce39f68-291d-4fa7-aa72-acc4334715c4" containerID="0dd0c1c3076b170b3796244e65229a28401a6555bbb8c6e46dbd8fbbb4238d35" exitCode=1 Jul 01 19:21:56.684942 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.684899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"5f1a26cbf086fd82a50e46bf160f939de848a937ef8154a06cebd78ebe025621"} Jul 01 19:21:56.685077 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.685054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"fc182952f1b86182ac19d7ebdb3aa1968440f6c6421c10875026dfdecdb4d9e0"} Jul 01 19:21:56.685185 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.685132 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"eb0e2a394e63a3cb9883439e5b3aaea69b2b314f8a3fe89eecdc2fc49dc7142d"} Jul 01 19:21:56.685239 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.685195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"e267a0df6a753f0ffe7268cef47d11f380a85946cff9ba2c036f1f5712906a61"} Jul 01 19:21:56.685290 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.685258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerDied","Data":"0dd0c1c3076b170b3796244e65229a28401a6555bbb8c6e46dbd8fbbb4238d35"} Jul 01 19:21:56.685336 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.685321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"efed97f4857120d5719a65fb4345f90378f61022634d2cb15a207707fc50edbd"} Jul 01 19:21:56.695885 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:56.695844 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cphkp" podStartSLOduration=4.42249027 podStartE2EDuration="22.695830392s" totalImagesPullingTime="18.273340122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:56.695563603 +0000 UTC m=+23.699469614" watchObservedRunningTime="2026-07-01 19:21:56.695830392 +0000 UTC m=+23.699736403" Jul 01 19:21:57.484352 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:57.484321 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:57.484662 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:57.484321 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:57.484662 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:57.484455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:57.484662 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:57.484451 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:57.484662 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:57.484537 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:57.484662 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:57.484602 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:57.484934 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:57.484670 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:21:56.673265436Z","UUID":"ed8edcde-0eb9-4c3b-9ec7-685c17b1d899","Handler":null,"Name":"","Endpoint":""} Jul 01 19:21:57.486357 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:57.486334 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:21:57.486518 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:57.486426 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:21:58.693889 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:58.693857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:21:58.694385 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:58.694347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"ea3735076f45578ca0c0294c567f8117a8f424c032d297f0b86ad75fa4a2253f"} Jul 01 19:21:58.696884 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:58.696851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" event={"ID":"9d065d01-69d8-4b2d-9359-8fd46eed1caf","Type":"ContainerStarted","Data":"0b92189ce675175e7abda11cb9022a6d5362c295664f100bae7219ad4dde7262"} Jul 01 19:21:58.729176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:58.729125 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6vmb" podStartSLOduration=5.283315232 podStartE2EDuration="25.729104241s" totalImagesPullingTime="20.445789009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:21:58.728964844 +0000 UTC m=+25.732870858" watchObservedRunningTime="2026-07-01 19:21:58.729104241 +0000 UTC m=+25.733010255" Jul 01 19:21:59.484167 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:59.483961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:21:59.484356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:59.483981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:21:59.484356 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:59.484322 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:21:59.484356 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:59.484004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:21:59.484544 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:59.484368 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:21:59.484544 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:21:59.484458 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:21:59.967204 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:59.967122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:21:59.967790 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:21:59.967767 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:22:00.703010 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:00.702983 2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0e61f-92a2-4a9e-be15-32c16367d8f3" containerID="b771a51b46c508a2103cd94414d00aa4582db1f8b836d8f17f54a8c2ff93edf8" exitCode=0 Jul 01 19:22:00.703151 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:00.703071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerDied","Data":"b771a51b46c508a2103cd94414d00aa4582db1f8b836d8f17f54a8c2ff93edf8"} Jul 01 19:22:00.703345 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:00.703324 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:22:00.703958 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:00.703860 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l9tmc" Jul 01 19:22:01.483842 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:01.483643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:01.484548 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:01.483648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:01.484548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:01.483944 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:22:01.484548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:01.483976 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:22:01.484548 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:01.483672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:01.484548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:01.484068 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:22:01.708366 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:01.708338 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:22:01.708773 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:01.708751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"a4e3eedf83c9b49dd1a3357b9db306e25e84c3b1dff7d1b39f84b42092eed7dc"} Jul 01 19:22:01.709234 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:01.709218 2577 scope.go:117] "RemoveContainer" containerID="0dd0c1c3076b170b3796244e65229a28401a6555bbb8c6e46dbd8fbbb4238d35" Jul 01 19:22:02.714434 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.714407 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:22:02.714937 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.714838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" event={"ID":"4ce39f68-291d-4fa7-aa72-acc4334715c4","Type":"ContainerStarted","Data":"47dfbe15cefbe964027d49ccda9eb3324b87b048603bd9b64671383faab8f4b4"} Jul 01 19:22:02.715073 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.715045 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:22:02.715222 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.715120 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:22:02.715222 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.715170 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:22:02.717639 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.717613 2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0e61f-92a2-4a9e-be15-32c16367d8f3" containerID="0ef7b183295dfbf34a1a57978919ee3946f5bdb0317d90510f2d15724fd27f23" exitCode=0 Jul 01 19:22:02.717768 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.717725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerDied","Data":"0ef7b183295dfbf34a1a57978919ee3946f5bdb0317d90510f2d15724fd27f23"} Jul 01 19:22:02.732331 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.732306 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:22:02.732466 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.732416 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:22:02.748016 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.747956 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" podStartSLOduration=10.934630266 podStartE2EDuration="29.7479403s" totalImagesPullingTime="18.813310034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:02.747512068 +0000 UTC m=+29.751418080" watchObservedRunningTime="2026-07-01 19:22:02.7479403 +0000 UTC m=+29.751846311" Jul 01 19:22:02.990715 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.990599 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ll98k"] Jul 01 19:22:02.990866 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.990744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:02.990866 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:02.990854 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:22:02.991321 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.991300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-56gcg"] Jul 01 19:22:02.991435 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.991408 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:02.991546 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:02.991523 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:22:02.991971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.991949 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h9bmp"] Jul 01 19:22:02.992075 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:02.992058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:02.992175 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:02.992146 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:22:04.483771 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:04.483586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:04.484154 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:04.483619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:04.484154 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:04.483842 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:22:04.484154 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:04.483920 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:22:04.726084 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:04.726049 2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0e61f-92a2-4a9e-be15-32c16367d8f3" containerID="bcce26afc9018bd39e2a38c5cf7eaf016251026e5ad9580aa07629b7578d8945" exitCode=0 Jul 01 19:22:04.726396 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:04.726233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerDied","Data":"bcce26afc9018bd39e2a38c5cf7eaf016251026e5ad9580aa07629b7578d8945"} Jul 01 19:22:05.484296 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:05.484265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:05.484836 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:05.484400 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:22:06.484235 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:06.484197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:06.484441 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:06.484197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:06.484441 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:06.484335 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:22:06.484441 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:06.484414 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:22:07.169300 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:07.169264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:07.169560 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.169452 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:07.169560 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.169549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:39.1695287 +0000 UTC m=+66.173434705 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:07.270123 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:07.270022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:07.270293 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.270194 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:07.270293 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.270275 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret podName:7e2cb84b-b822-4d3b-9358-41076175c222 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:39.270256129 +0000 UTC m=+66.274162133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret") pod "global-pull-secret-syncer-ll98k" (UID: "7e2cb84b-b822-4d3b-9358-41076175c222") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:07.370926 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:07.370890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:07.371126 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.371076 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:07.371126 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.371098 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:07.371126 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.371109 2577 projected.go:196] Error preparing data for projected volume kube-api-access-dmvk6 for pod openshift-network-diagnostics/network-check-target-h9bmp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:07.371270 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.371168 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6 podName:0efd8352-f5b2-4110-aa85-7b2f7d8b908c nodeName:}" failed. No retries permitted until 2026-07-01 19:22:39.371149716 +0000 UTC m=+66.375055732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dmvk6" (UniqueName: "kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6") pod "network-check-target-h9bmp" (UID: "0efd8352-f5b2-4110-aa85-7b2f7d8b908c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:07.483839 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:07.483747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:07.484022 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:07.483904 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:22:08.483544 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:08.483509 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:08.484068 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:08.483636 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9bmp" podUID="0efd8352-f5b2-4110-aa85-7b2f7d8b908c" Jul 01 19:22:08.484068 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:08.483690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:08.484068 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:08.483788 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ll98k" podUID="7e2cb84b-b822-4d3b-9358-41076175c222" Jul 01 19:22:09.315202 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.315170 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-188.ec2.internal" event="NodeReady" Jul 01 19:22:09.315390 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.315378 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:22:09.375958 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.375924 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8zvff"] Jul 01 19:22:09.378163 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.377833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.378449 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.378404 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6j55h"] Jul 01 19:22:09.380353 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.380331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.380969 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.380947 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:22:09.381070 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.380955 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2g8hv\"" Jul 01 19:22:09.381967 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.381950 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:22:09.383522 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.382774 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:22:09.383522 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.383198 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:22:09.383522 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.383301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:22:09.385475 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.384103 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rk24x\"" Jul 01 19:22:09.395784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.395762 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j55h"] Jul 01 19:22:09.403949 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.403923 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zvff"] Jul 01 19:22:09.484133 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:09.484777 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzf2t\" (UniqueName: \"kubernetes.io/projected/165eb356-87b4-4773-8a08-cae5f93355b6-kube-api-access-qzf2t\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.484777 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1faf5b-8b45-4b73-865d-65773613e758-cert\") pod \"ingress-canary-6j55h\" (UID: \"ae1faf5b-8b45-4b73-865d-65773613e758\") " pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.484777 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd8ns\" (UniqueName: \"kubernetes.io/projected/ae1faf5b-8b45-4b73-865d-65773613e758-kube-api-access-jd8ns\") pod \"ingress-canary-6j55h\" (UID: \"ae1faf5b-8b45-4b73-865d-65773613e758\") " pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.484777 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.484777 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/165eb356-87b4-4773-8a08-cae5f93355b6-config-volume\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.484777 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.484676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/165eb356-87b4-4773-8a08-cae5f93355b6-tmp-dir\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.486414 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.486390 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tjdnw\"" Jul 01 19:22:09.486825 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.486807 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:22:09.585403 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/165eb356-87b4-4773-8a08-cae5f93355b6-config-volume\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.585403 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/165eb356-87b4-4773-8a08-cae5f93355b6-tmp-dir\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.585630 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzf2t\" (UniqueName: \"kubernetes.io/projected/165eb356-87b4-4773-8a08-cae5f93355b6-kube-api-access-qzf2t\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.585630 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1faf5b-8b45-4b73-865d-65773613e758-cert\") pod \"ingress-canary-6j55h\" (UID: \"ae1faf5b-8b45-4b73-865d-65773613e758\") " pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.585630 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd8ns\" (UniqueName: \"kubernetes.io/projected/ae1faf5b-8b45-4b73-865d-65773613e758-kube-api-access-jd8ns\") pod \"ingress-canary-6j55h\" (UID: \"ae1faf5b-8b45-4b73-865d-65773613e758\") " pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.585630 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.585836 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:09.585632 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:09.585836 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:09.585699 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:10.085682664 +0000 UTC m=+37.089588655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:09.585836 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.585780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/165eb356-87b4-4773-8a08-cae5f93355b6-tmp-dir\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.586074 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.586054 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/165eb356-87b4-4773-8a08-cae5f93355b6-config-volume\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.589453 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.589435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1faf5b-8b45-4b73-865d-65773613e758-cert\") pod \"ingress-canary-6j55h\" (UID: \"ae1faf5b-8b45-4b73-865d-65773613e758\") " pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.600551 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.600522 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd8ns\" (UniqueName: \"kubernetes.io/projected/ae1faf5b-8b45-4b73-865d-65773613e758-kube-api-access-jd8ns\") pod \"ingress-canary-6j55h\" (UID: \"ae1faf5b-8b45-4b73-865d-65773613e758\") " pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.602330 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.602307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzf2t\" (UniqueName: \"kubernetes.io/projected/165eb356-87b4-4773-8a08-cae5f93355b6-kube-api-access-qzf2t\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:09.696120 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.696085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j55h" Jul 01 19:22:09.739949 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.739916 2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0e61f-92a2-4a9e-be15-32c16367d8f3" containerID="82c451f3fef7b97e55aaa23c0a1859c9a7bf406edea02096f1955ed2d672c4d9" exitCode=0 Jul 01 19:22:09.740107 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.739958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerDied","Data":"82c451f3fef7b97e55aaa23c0a1859c9a7bf406edea02096f1955ed2d672c4d9"} Jul 01 19:22:09.840163 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:09.839980 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j55h"] Jul 01 19:22:09.843997 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:22:09.843961 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1faf5b_8b45_4b73_865d_65773613e758.slice/crio-e5ccae493fde8b2a3d11c7e56f34b38f1d0cab700d3b93ed0ebc71ba7cea885f WatchSource:0}: Error finding container e5ccae493fde8b2a3d11c7e56f34b38f1d0cab700d3b93ed0ebc71ba7cea885f: Status 404 returned error can't find the container with id e5ccae493fde8b2a3d11c7e56f34b38f1d0cab700d3b93ed0ebc71ba7cea885f Jul 01 19:22:10.089559 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.089432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:10.089771 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:10.089624 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:10.089771 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:10.089703 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:11.089679675 +0000 UTC m=+38.093585691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:10.483973 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.483884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:10.484152 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.483884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:10.486855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.486827 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:22:10.486855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.486849 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27xv5\"" Jul 01 19:22:10.487027 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.486836 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:22:10.487027 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.486878 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:22:10.746437 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.746340 2577 generic.go:356] "Generic (PLEG): container finished" podID="fdf0e61f-92a2-4a9e-be15-32c16367d8f3" containerID="cbdb83cdea158969822fd749e94c9c1f6b8e6fa03e745bcd0bfdd7c36c6a8d94" exitCode=0 Jul 01 19:22:10.746437 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.746416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerDied","Data":"cbdb83cdea158969822fd749e94c9c1f6b8e6fa03e745bcd0bfdd7c36c6a8d94"} Jul 01 19:22:10.748082 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:10.748051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j55h" event={"ID":"ae1faf5b-8b45-4b73-865d-65773613e758","Type":"ContainerStarted","Data":"e5ccae493fde8b2a3d11c7e56f34b38f1d0cab700d3b93ed0ebc71ba7cea885f"} Jul 01 19:22:11.097988 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:11.097731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:11.098137 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:11.097876 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:11.098137 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:11.098096 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:13.098076176 +0000 UTC m=+40.101982168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:11.754265 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:11.754221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" event={"ID":"fdf0e61f-92a2-4a9e-be15-32c16367d8f3","Type":"ContainerStarted","Data":"51d86eb9f6dec94298d3d8de392833f6c5d430a3105cf5b872cf85efb936a0b1"} Jul 01 19:22:11.792296 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:11.792236 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l5jgl" podStartSLOduration=9.132375459 podStartE2EDuration="38.792213996s" totalImagesPullingTime="29.659838537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:11.791311186 +0000 UTC m=+38.795217199" watchObservedRunningTime="2026-07-01 19:22:11.792213996 +0000 UTC m=+38.796120010" Jul 01 19:22:12.758103 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:12.758017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j55h" event={"ID":"ae1faf5b-8b45-4b73-865d-65773613e758","Type":"ContainerStarted","Data":"1bdf38f05a609b8bad594966903c26e90897dc3f06e2025795c6dc5a35b3e20b"} Jul 01 19:22:12.800277 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:12.800224 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6j55h" podStartSLOduration=1.3230541869999999 podStartE2EDuration="3.80020701s" totalImagesPullingTime="2.477152823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:12.799924333 +0000 UTC m=+39.803830345" watchObservedRunningTime="2026-07-01 19:22:12.80020701 +0000 UTC m=+39.804113021" Jul 01 19:22:13.111465 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:13.111373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:13.111639 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:13.111539 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:13.111639 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:13.111602 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:17.111585477 +0000 UTC m=+44.115491466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:17.142242 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:17.142206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:17.142643 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:17.142358 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:17.142643 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:17.142422 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:25.142406663 +0000 UTC m=+52.146312657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:19.557065 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.557024 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq"] Jul 01 19:22:19.601112 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.601073 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq"] Jul 01 19:22:19.601273 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.601165 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.609191 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.609169 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 19:22:19.609326 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.609267 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 19:22:19.609326 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.609281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 19:22:19.609326 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.609270 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 19:22:19.609326 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.609300 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mbkdm\"" Jul 01 19:22:19.725164 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.725134 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h"] Jul 01 19:22:19.746284 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.746262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.750759 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.750733 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h"] Jul 01 19:22:19.753022 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.753003 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 19:22:19.753137 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.753096 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 19:22:19.753559 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.753543 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 19:22:19.753661 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.753590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 19:22:19.762168 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.762145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8q6f\" (UniqueName: \"kubernetes.io/projected/e5ac1480-efd1-486a-80b4-51ef90061a9d-kube-api-access-t8q6f\") pod \"managed-serviceaccount-addon-agent-9d87544c8-z9vcq\" (UID: \"e5ac1480-efd1-486a-80b4-51ef90061a9d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.762272 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.762204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ac1480-efd1-486a-80b4-51ef90061a9d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d87544c8-z9vcq\" (UID: \"e5ac1480-efd1-486a-80b4-51ef90061a9d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.863544 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5vb\" (UniqueName: \"kubernetes.io/projected/dd45f0d3-6786-4103-8e02-1f9ea1474914-kube-api-access-7v5vb\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.863723 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.863723 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-hub\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.863723 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.863886 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-ca\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.863886 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8q6f\" (UniqueName: \"kubernetes.io/projected/e5ac1480-efd1-486a-80b4-51ef90061a9d-kube-api-access-t8q6f\") pod \"managed-serviceaccount-addon-agent-9d87544c8-z9vcq\" (UID: \"e5ac1480-efd1-486a-80b4-51ef90061a9d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.863886 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ac1480-efd1-486a-80b4-51ef90061a9d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d87544c8-z9vcq\" (UID: \"e5ac1480-efd1-486a-80b4-51ef90061a9d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.863886 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.863852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd45f0d3-6786-4103-8e02-1f9ea1474914-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.868268 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.868238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ac1480-efd1-486a-80b4-51ef90061a9d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d87544c8-z9vcq\" (UID: \"e5ac1480-efd1-486a-80b4-51ef90061a9d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.873657 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.873629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8q6f\" (UniqueName: \"kubernetes.io/projected/e5ac1480-efd1-486a-80b4-51ef90061a9d-kube-api-access-t8q6f\") pod \"managed-serviceaccount-addon-agent-9d87544c8-z9vcq\" (UID: \"e5ac1480-efd1-486a-80b4-51ef90061a9d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.917901 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.917870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:22:19.964742 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.964700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-ca\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.964901 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.964842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd45f0d3-6786-4103-8e02-1f9ea1474914-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.964901 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.964874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5vb\" (UniqueName: \"kubernetes.io/projected/dd45f0d3-6786-4103-8e02-1f9ea1474914-kube-api-access-7v5vb\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.965011 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.964905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.965011 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.964928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-hub\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.965011 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.964946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.965609 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.965581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd45f0d3-6786-4103-8e02-1f9ea1474914-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.967391 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.967361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.967548 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.967532 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.967721 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.967703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-ca\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.967795 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.967775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd45f0d3-6786-4103-8e02-1f9ea1474914-hub\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:19.976510 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:19.976466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5vb\" (UniqueName: \"kubernetes.io/projected/dd45f0d3-6786-4103-8e02-1f9ea1474914-kube-api-access-7v5vb\") pod \"cluster-proxy-proxy-agent-5747b4b6ff-sx54h\" (UID: \"dd45f0d3-6786-4103-8e02-1f9ea1474914\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:20.055883 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:20.055847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:22:20.059739 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:20.059719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq"] Jul 01 19:22:20.061989 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:22:20.061965 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5ac1480_efd1_486a_80b4_51ef90061a9d.slice/crio-2a2097ff09cb72337608c011dcb9043e102c7d7fed373d8de530433037f15395 WatchSource:0}: Error finding container 2a2097ff09cb72337608c011dcb9043e102c7d7fed373d8de530433037f15395: Status 404 returned error can't find the container with id 2a2097ff09cb72337608c011dcb9043e102c7d7fed373d8de530433037f15395 Jul 01 19:22:20.222765 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:20.222720 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h"] Jul 01 19:22:20.225907 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:22:20.225882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd45f0d3_6786_4103_8e02_1f9ea1474914.slice/crio-29ed8beb1d2cba74ac01b4965e6ed255ace9ade46d54fdf234b0a42bb5897705 WatchSource:0}: Error finding container 29ed8beb1d2cba74ac01b4965e6ed255ace9ade46d54fdf234b0a42bb5897705: Status 404 returned error can't find the container with id 29ed8beb1d2cba74ac01b4965e6ed255ace9ade46d54fdf234b0a42bb5897705 Jul 01 19:22:20.777643 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:20.777608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" event={"ID":"dd45f0d3-6786-4103-8e02-1f9ea1474914","Type":"ContainerStarted","Data":"29ed8beb1d2cba74ac01b4965e6ed255ace9ade46d54fdf234b0a42bb5897705"} Jul 01 19:22:20.778740 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:20.778720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" event={"ID":"e5ac1480-efd1-486a-80b4-51ef90061a9d","Type":"ContainerStarted","Data":"2a2097ff09cb72337608c011dcb9043e102c7d7fed373d8de530433037f15395"} Jul 01 19:22:23.789816 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:23.789770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" event={"ID":"e5ac1480-efd1-486a-80b4-51ef90061a9d","Type":"ContainerStarted","Data":"e4fe2ae54ac33e09efae407eb87cc6fbaedc4e96b58c729967ec4ab2a8376254"} Jul 01 19:22:23.805835 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:23.805774 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" podStartSLOduration=1.699316053 podStartE2EDuration="4.805753474s" totalImagesPullingTime="3.106437421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:23.805447355 +0000 UTC m=+50.809353367" watchObservedRunningTime="2026-07-01 19:22:23.805753474 +0000 UTC m=+50.809659481" Jul 01 19:22:25.207758 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:25.207718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:25.208302 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:25.207857 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:25.208302 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:25.207939 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:41.207919634 +0000 UTC m=+68.211825624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:26.800984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:26.800946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" event={"ID":"dd45f0d3-6786-4103-8e02-1f9ea1474914","Type":"ContainerStarted","Data":"3ffa9e1902a6d2e356690af204395fc051b61bce66060be450c1cb010deb086e"} Jul 01 19:22:26.800984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:26.800990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" event={"ID":"dd45f0d3-6786-4103-8e02-1f9ea1474914","Type":"ContainerStarted","Data":"bf4f29435a3a98aa5684fb15ef348caad0abbbf3cdc32d93723989d0f0f36fc2"} Jul 01 19:22:26.801403 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:26.801002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" event={"ID":"dd45f0d3-6786-4103-8e02-1f9ea1474914","Type":"ContainerStarted","Data":"a7acf16899bb719ea360cab6019ff66e0a0f1740044146f7ccda608a221b72c5"} Jul 01 19:22:26.829282 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:26.829227 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" podStartSLOduration=1.7007783029999999 podStartE2EDuration="7.829210868s" totalImagesPullingTime="6.128432565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:26.828794817 +0000 UTC m=+53.832700829" watchObservedRunningTime="2026-07-01 19:22:26.829210868 +0000 UTC m=+53.833116878" Jul 01 19:22:34.743059 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:34.743019 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8jjd" Jul 01 19:22:39.208739 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.208705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:22:39.212321 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.211921 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:22:39.219362 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:39.219338 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:22:39.219428 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:39.219417 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:43.21939953 +0000 UTC m=+130.223305522 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : secret "metrics-daemon-secret" not found Jul 01 19:22:39.309354 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.309311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:39.311876 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.311859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:22:39.321861 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.321830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e2cb84b-b822-4d3b-9358-41076175c222-original-pull-secret\") pod \"global-pull-secret-syncer-ll98k\" (UID: \"7e2cb84b-b822-4d3b-9358-41076175c222\") " pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:39.410050 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.409996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:39.412640 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.412623 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:22:39.423027 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.423012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:22:39.433401 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.433373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmvk6\" (UniqueName: \"kubernetes.io/projected/0efd8352-f5b2-4110-aa85-7b2f7d8b908c-kube-api-access-dmvk6\") pod \"network-check-target-h9bmp\" (UID: \"0efd8352-f5b2-4110-aa85-7b2f7d8b908c\") " pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:39.598143 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.598064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27xv5\"" Jul 01 19:22:39.601404 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.601377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ll98k" Jul 01 19:22:39.606568 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.606552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:39.738563 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.738529 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ll98k"] Jul 01 19:22:39.741181 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:22:39.741156 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2cb84b_b822_4d3b_9358_41076175c222.slice/crio-84ada75a3f3a91fbff74c62549049e93dcee59630e851de67809ebd384ea94c2 WatchSource:0}: Error finding container 84ada75a3f3a91fbff74c62549049e93dcee59630e851de67809ebd384ea94c2: Status 404 returned error can't find the container with id 84ada75a3f3a91fbff74c62549049e93dcee59630e851de67809ebd384ea94c2 Jul 01 19:22:39.751617 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.751594 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h9bmp"] Jul 01 19:22:39.754009 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:22:39.753985 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efd8352_f5b2_4110_aa85_7b2f7d8b908c.slice/crio-ece9858561597716d65c28f5314514fee3a4369767a78ed4404e944cb249561a WatchSource:0}: Error finding container ece9858561597716d65c28f5314514fee3a4369767a78ed4404e944cb249561a: Status 404 returned error can't find the container with id ece9858561597716d65c28f5314514fee3a4369767a78ed4404e944cb249561a Jul 01 19:22:39.833195 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.833160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ll98k" event={"ID":"7e2cb84b-b822-4d3b-9358-41076175c222","Type":"ContainerStarted","Data":"84ada75a3f3a91fbff74c62549049e93dcee59630e851de67809ebd384ea94c2"} Jul 01 19:22:39.834209 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:39.834189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h9bmp" event={"ID":"0efd8352-f5b2-4110-aa85-7b2f7d8b908c","Type":"ContainerStarted","Data":"ece9858561597716d65c28f5314514fee3a4369767a78ed4404e944cb249561a"} Jul 01 19:22:41.224787 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:41.224749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:22:41.225213 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:41.224939 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:22:41.225213 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:22:41.225022 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:13.225001974 +0000 UTC m=+100.228907968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:22:44.850636 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:44.850548 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ll98k" event={"ID":"7e2cb84b-b822-4d3b-9358-41076175c222","Type":"ContainerStarted","Data":"6391b6c0b728b9af4b4c2416ccbd34bd8660cf0a49e804d61195e7becd0ef7c4"} Jul 01 19:22:44.851837 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:44.851813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h9bmp" event={"ID":"0efd8352-f5b2-4110-aa85-7b2f7d8b908c","Type":"ContainerStarted","Data":"7f551ca96be69ae28db72a1a4bd1bf9a64c73abeffa3e2fe2c9f52a7739a22e2"} Jul 01 19:22:44.851963 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:44.851933 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:22:44.870388 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:44.870346 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ll98k" podStartSLOduration=66.01242614 podStartE2EDuration="1m10.870332646s" totalImagesPullingTime="4.857906506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:44.869961646 +0000 UTC m=+71.873867658" watchObservedRunningTime="2026-07-01 19:22:44.870332646 +0000 UTC m=+71.874238656" Jul 01 19:22:44.892862 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:22:44.892821 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h9bmp" podStartSLOduration=66.051753949 podStartE2EDuration="1m10.892809285s" totalImagesPullingTime="4.841055336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:22:44.892655724 +0000 UTC m=+71.896561726" watchObservedRunningTime="2026-07-01 19:22:44.892809285 +0000 UTC m=+71.896715296" Jul 01 19:23:13.244101 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:23:13.244052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:23:13.244608 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:23:13.244204 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:13.244608 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:23:13.244282 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:17.244265042 +0000 UTC m=+164.248171036 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:23:15.858625 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:23:15.858592 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h9bmp" Jul 01 19:23:43.251249 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:23:43.251208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:23:43.251746 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:23:43.251329 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:23:43.251746 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:23:43.251393 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:25:45.251379624 +0000 UTC m=+252.255285614 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : secret "metrics-daemon-secret" not found Jul 01 19:24:12.391373 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:24:12.391339 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8zvff" podUID="165eb356-87b4-4773-8a08-cae5f93355b6" Jul 01 19:24:12.492997 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:24:12.492941 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:24:13.107891 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:13.107862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zvff" Jul 01 19:24:17.296922 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:17.296878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:24:17.297340 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:24:17.297026 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:24:17.297340 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:24:17.297092 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls podName:165eb356-87b4-4773-8a08-cae5f93355b6 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:19.297076448 +0000 UTC m=+286.300982436 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls") pod "dns-default-8zvff" (UID: "165eb356-87b4-4773-8a08-cae5f93355b6") : secret "dns-default-metrics-tls" not found Jul 01 19:24:24.139145 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:24.139107 2577 generic.go:356] "Generic (PLEG): container finished" podID="e5ac1480-efd1-486a-80b4-51ef90061a9d" containerID="e4fe2ae54ac33e09efae407eb87cc6fbaedc4e96b58c729967ec4ab2a8376254" exitCode=255 Jul 01 19:24:24.139598 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:24.139167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" event={"ID":"e5ac1480-efd1-486a-80b4-51ef90061a9d","Type":"ContainerDied","Data":"e4fe2ae54ac33e09efae407eb87cc6fbaedc4e96b58c729967ec4ab2a8376254"} Jul 01 19:24:24.139598 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:24.139447 2577 scope.go:117] "RemoveContainer" containerID="e4fe2ae54ac33e09efae407eb87cc6fbaedc4e96b58c729967ec4ab2a8376254" Jul 01 19:24:25.144557 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:25.144517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" event={"ID":"e5ac1480-efd1-486a-80b4-51ef90061a9d","Type":"ContainerStarted","Data":"008906489c6375c68497b0eb2f6f60757ed3884473550f47da1b6270a33d22f1"} Jul 01 19:24:25.484073 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:24:25.483989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:25:45.314653 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:25:45.314609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:25:45.315141 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:25:45.314736 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:25:45.315141 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:25:45.314788 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs podName:3e8c0a6f-a0a7-4884-94f0-cad4e7555877 nodeName:}" failed. No retries permitted until 2026-07-01 19:27:47.314773787 +0000 UTC m=+374.318679776 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs") pod "network-metrics-daemon-56gcg" (UID: "3e8c0a6f-a0a7-4884-94f0-cad4e7555877") : secret "metrics-daemon-secret" not found Jul 01 19:26:04.484281 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.484204 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9x8mw"] Jul 01 19:26:04.486331 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.486315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.489281 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.489259 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:26:04.489524 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.489492 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:26:04.489977 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.489961 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:26:04.490036 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.489993 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nqzwd\"" Jul 01 19:26:04.490036 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.490018 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:26:04.503771 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.503744 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9x8mw"] Jul 01 19:26:04.649398 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.649340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6nvm\" (UniqueName: \"kubernetes.io/projected/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-api-access-s6nvm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.649398 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.649400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8a7e79-6415-4b32-8a8a-6f04f1852341-crio-socket\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.649398 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.649419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.649697 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.649490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.649697 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.649559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8a7e79-6415-4b32-8a8a-6f04f1852341-data-volume\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750438 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750352 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6nvm\" (UniqueName: \"kubernetes.io/projected/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-api-access-s6nvm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750438 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8a7e79-6415-4b32-8a8a-6f04f1852341-crio-socket\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750438 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750484 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8a7e79-6415-4b32-8a8a-6f04f1852341-crio-socket\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:04.750534 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8a7e79-6415-4b32-8a8a-6f04f1852341-data-volume\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:04.750629 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:04.750683 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:05.250664216 +0000 UTC m=+272.254570213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : secret "insights-runtime-extractor-tls" not found Jul 01 19:26:04.750698 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:04.750703 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:05.250693784 +0000 UTC m=+272.254599772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : configmap "kube-rbac-proxy" not found Jul 01 19:26:04.750968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.750854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8a7e79-6415-4b32-8a8a-6f04f1852341-data-volume\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:04.759055 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:04.759032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6nvm\" (UniqueName: \"kubernetes.io/projected/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-api-access-s6nvm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:05.254974 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:05.254906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:05.254974 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:05.254981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:05.255228 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:05.255074 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:26:05.255228 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:05.255081 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:26:05.255228 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:05.255138 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:06.255124249 +0000 UTC m=+273.259030238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : configmap "kube-rbac-proxy" not found Jul 01 19:26:05.255228 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:05.255150 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:06.255144749 +0000 UTC m=+273.259050737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : secret "insights-runtime-extractor-tls" not found Jul 01 19:26:06.262510 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:06.262457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:06.262973 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:06.262580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:06.262973 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:06.262594 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:26:06.262973 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:06.262675 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:26:06.262973 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:06.262688 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:08.262665266 +0000 UTC m=+275.266571256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : configmap "kube-rbac-proxy" not found Jul 01 19:26:06.262973 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:06.262713 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:08.262702499 +0000 UTC m=+275.266608488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : secret "insights-runtime-extractor-tls" not found Jul 01 19:26:07.067576 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:07.067549 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7v7b7_3e4f15b3-7d74-4722-867b-7e03e738c6ce/dns-node-resolver/0.log" Jul 01 19:26:08.066874 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:08.066848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f6m72_c7e63629-7610-47af-9d26-ab628d916015/node-ca/0.log" Jul 01 19:26:08.275352 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:08.275321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:08.275352 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:08.275357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:08.275548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:08.275453 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:26:08.275548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:08.275456 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:26:08.275548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:08.275520 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:12.275491281 +0000 UTC m=+279.279397269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : secret "insights-runtime-extractor-tls" not found Jul 01 19:26:08.275548 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:08.275540 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:12.275531125 +0000 UTC m=+279.279437119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : configmap "kube-rbac-proxy" not found Jul 01 19:26:08.866727 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:08.866697 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j55h_ae1faf5b-8b45-4b73-865d-65773613e758/serve-healthcheck-canary/0.log" Jul 01 19:26:12.302203 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:12.302152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:12.302203 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:12.302208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:12.302696 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:12.302298 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:26:12.302696 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:12.302311 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:26:12.302696 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:12.302368 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:20.302355128 +0000 UTC m=+287.306261122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : configmap "kube-rbac-proxy" not found Jul 01 19:26:12.302696 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:12.302382 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:20.30237607 +0000 UTC m=+287.306282058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : secret "insights-runtime-extractor-tls" not found Jul 01 19:26:16.108336 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:16.108297 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8zvff" podUID="165eb356-87b4-4773-8a08-cae5f93355b6" Jul 01 19:26:16.473214 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:16.473134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zvff" Jul 01 19:26:19.356279 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:19.356235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:26:19.358842 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:19.358809 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/165eb356-87b4-4773-8a08-cae5f93355b6-metrics-tls\") pod \"dns-default-8zvff\" (UID: \"165eb356-87b4-4773-8a08-cae5f93355b6\") " pod="openshift-dns/dns-default-8zvff" Jul 01 19:26:19.476676 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:19.476641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2g8hv\"" Jul 01 19:26:19.485267 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:19.485235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8zvff" Jul 01 19:26:19.612142 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:19.612066 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8zvff"] Jul 01 19:26:19.614949 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:26:19.614921 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165eb356_87b4_4773_8a08_cae5f93355b6.slice/crio-858e50fc088b078f2a42967eb0bdd08dc172350c1fba480679874e8c76d57faa WatchSource:0}: Error finding container 858e50fc088b078f2a42967eb0bdd08dc172350c1fba480679874e8c76d57faa: Status 404 returned error can't find the container with id 858e50fc088b078f2a42967eb0bdd08dc172350c1fba480679874e8c76d57faa Jul 01 19:26:20.365313 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:20.365276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:20.365780 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:20.365393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:20.365780 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:20.365520 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:26:20.365780 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:20.365590 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls podName:ba8a7e79-6415-4b32-8a8a-6f04f1852341 nodeName:}" failed. No retries permitted until 2026-07-01 19:26:36.365569006 +0000 UTC m=+303.369474997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9x8mw" (UID: "ba8a7e79-6415-4b32-8a8a-6f04f1852341") : secret "insights-runtime-extractor-tls" not found Jul 01 19:26:20.365913 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:20.365884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8a7e79-6415-4b32-8a8a-6f04f1852341-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:20.484385 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:20.484351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zvff" event={"ID":"165eb356-87b4-4773-8a08-cae5f93355b6","Type":"ContainerStarted","Data":"858e50fc088b078f2a42967eb0bdd08dc172350c1fba480679874e8c76d57faa"} Jul 01 19:26:21.489320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:21.489282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zvff" event={"ID":"165eb356-87b4-4773-8a08-cae5f93355b6","Type":"ContainerStarted","Data":"6b8912ed618a4ee37774a52f70e0e2949004c95406e5983387eaa17904c9d9b2"} Jul 01 19:26:21.489712 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:21.489343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8zvff" event={"ID":"165eb356-87b4-4773-8a08-cae5f93355b6","Type":"ContainerStarted","Data":"973589dfcd966145daa435ee7d7da5c376f2af178b4533558522124512f72d9a"} Jul 01 19:26:21.489712 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:21.489415 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8zvff" Jul 01 19:26:24.504373 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:24.504281 2577 generic.go:356] "Generic (PLEG): container finished" podID="e5ac1480-efd1-486a-80b4-51ef90061a9d" containerID="008906489c6375c68497b0eb2f6f60757ed3884473550f47da1b6270a33d22f1" exitCode=255 Jul 01 19:26:24.504373 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:24.504356 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" event={"ID":"e5ac1480-efd1-486a-80b4-51ef90061a9d","Type":"ContainerDied","Data":"008906489c6375c68497b0eb2f6f60757ed3884473550f47da1b6270a33d22f1"} Jul 01 19:26:24.504897 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:24.504403 2577 scope.go:117] "RemoveContainer" containerID="e4fe2ae54ac33e09efae407eb87cc6fbaedc4e96b58c729967ec4ab2a8376254" Jul 01 19:26:24.504897 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:24.504801 2577 scope.go:117] "RemoveContainer" containerID="008906489c6375c68497b0eb2f6f60757ed3884473550f47da1b6270a33d22f1" Jul 01 19:26:24.505001 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:24.504966 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-9d87544c8-z9vcq_open-cluster-management-agent-addon(e5ac1480-efd1-486a-80b4-51ef90061a9d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" podUID="e5ac1480-efd1-486a-80b4-51ef90061a9d" Jul 01 19:26:24.528488 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:24.528429 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8zvff" podStartSLOduration=254.132861062 podStartE2EDuration="4m15.528412663s" totalImagesPullingTime="1.395551601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:21.506665012 +0000 UTC m=+288.510571024" watchObservedRunningTime="2026-07-01 19:26:24.528412663 +0000 UTC m=+291.532318674" Jul 01 19:26:28.485281 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:28.485242 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-56gcg" podUID="3e8c0a6f-a0a7-4884-94f0-cad4e7555877" Jul 01 19:26:29.918613 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:29.918579 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" Jul 01 19:26:29.918990 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:29.918892 2577 scope.go:117] "RemoveContainer" containerID="008906489c6375c68497b0eb2f6f60757ed3884473550f47da1b6270a33d22f1" Jul 01 19:26:29.919043 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:29.919025 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-9d87544c8-z9vcq_open-cluster-management-agent-addon(e5ac1480-efd1-486a-80b4-51ef90061a9d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" podUID="e5ac1480-efd1-486a-80b4-51ef90061a9d" Jul 01 19:26:30.057900 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:30.057857 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" podUID="dd45f0d3-6786-4103-8e02-1f9ea1474914" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 01 19:26:31.495784 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:31.495754 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8zvff" Jul 01 19:26:33.413280 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:33.413246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:26:33.414109 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:33.414090 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:26:33.418559 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:33.418540 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:26:36.377655 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:36.377597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:36.379867 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:36.379846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8a7e79-6415-4b32-8a8a-6f04f1852341-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9x8mw\" (UID: \"ba8a7e79-6415-4b32-8a8a-6f04f1852341\") " pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:36.596970 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:36.596935 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nqzwd\"" Jul 01 19:26:36.605735 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:36.605708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9x8mw" Jul 01 19:26:36.727586 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:36.727553 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9x8mw"] Jul 01 19:26:36.730414 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:26:36.730384 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8a7e79_6415_4b32_8a8a_6f04f1852341.slice/crio-b7349fc816e5af6ffd8c052a522beaeec3ba88c3e66191d2574fe0215ea3645b WatchSource:0}: Error finding container b7349fc816e5af6ffd8c052a522beaeec3ba88c3e66191d2574fe0215ea3645b: Status 404 returned error can't find the container with id b7349fc816e5af6ffd8c052a522beaeec3ba88c3e66191d2574fe0215ea3645b Jul 01 19:26:36.731705 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:36.731683 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:26:37.544268 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:37.544228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x8mw" event={"ID":"ba8a7e79-6415-4b32-8a8a-6f04f1852341","Type":"ContainerStarted","Data":"b7349fc816e5af6ffd8c052a522beaeec3ba88c3e66191d2574fe0215ea3645b"} Jul 01 19:26:40.057882 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:40.057844 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" podUID="dd45f0d3-6786-4103-8e02-1f9ea1474914" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 01 19:26:41.559423 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:41.559390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x8mw" event={"ID":"ba8a7e79-6415-4b32-8a8a-6f04f1852341","Type":"ContainerStarted","Data":"586f59f8a2967a95bcd22228ce1cf3c317f352142bc257b76acb534ed18ee205"} Jul 01 19:26:41.559816 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:41.559449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x8mw" event={"ID":"ba8a7e79-6415-4b32-8a8a-6f04f1852341","Type":"ContainerStarted","Data":"cb08f6b098891adbab68aeaf89bcd2f58c61875f8e0488f0a66829822b7b53d5"} Jul 01 19:26:42.484023 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:42.483994 2577 scope.go:117] "RemoveContainer" containerID="008906489c6375c68497b0eb2f6f60757ed3884473550f47da1b6270a33d22f1" Jul 01 19:26:42.565614 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:42.565574 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d87544c8-z9vcq" event={"ID":"e5ac1480-efd1-486a-80b4-51ef90061a9d","Type":"ContainerStarted","Data":"6032947cfbe7d26d28a5cc61066a79c58b8c3c2aeb0110e9649d84bb6b8f7005"} Jul 01 19:26:43.486215 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:43.486181 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:26:44.573577 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.573536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9x8mw" event={"ID":"ba8a7e79-6415-4b32-8a8a-6f04f1852341","Type":"ContainerStarted","Data":"46bef2055c747cbededa4e12a606ed6d8e00fa330ee2ed0270bab168ab5328e0"} Jul 01 19:26:44.598668 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.598620 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9x8mw" podStartSLOduration=33.510498002 podStartE2EDuration="40.598604669s" totalImagesPullingTime="7.088106667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:26:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:44.597918235 +0000 UTC m=+311.601824247" watchObservedRunningTime="2026-07-01 19:26:44.598604669 +0000 UTC m=+311.602510680" Jul 01 19:26:44.951717 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.951682 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7"] Jul 01 19:26:44.954772 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.954752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:44.957906 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.957872 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:26:44.957906 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.957885 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5h9hp\"" Jul 01 19:26:44.957906 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.957891 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:26:44.958178 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.958164 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:26:44.958686 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.958670 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 19:26:44.958761 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.958692 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:26:44.979595 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.979569 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7"] Jul 01 19:26:44.999006 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:44.998976 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-b584p"] Jul 01 19:26:45.001968 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.001951 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.004347 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.004327 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wtxg4\"" Jul 01 19:26:45.005249 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.005232 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 19:26:45.006142 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.006124 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:26:45.006142 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.006125 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 19:26:45.010291 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.010267 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8kg57"] Jul 01 19:26:45.013199 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.013182 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.015586 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.015569 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r7ct4\"" Jul 01 19:26:45.015662 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.015569 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:26:45.015662 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.015607 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:26:45.015833 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.015821 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:26:45.022434 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.022415 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-b584p"] Jul 01 19:26:45.039922 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.039896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.040047 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.039939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.040047 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.039964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.040047 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.039981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.040047 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.040023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-metrics-client-ca\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.040047 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.040041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn4c9\" (UniqueName: \"kubernetes.io/projected/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-api-access-zn4c9\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.040320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.040081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt22x\" (UniqueName: \"kubernetes.io/projected/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-kube-api-access-tt22x\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.040320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.040125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.040320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.040148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.040320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.040170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.141341 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-root\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141341 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-metrics-client-ca\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141575 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrqk6\" (UniqueName: \"kubernetes.io/projected/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-kube-api-access-lrqk6\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141575 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt22x\" (UniqueName: \"kubernetes.io/projected/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-kube-api-access-tt22x\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.141575 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141575 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.141575 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-sys\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141575 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-tls\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-textfile\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-wtmp\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.141855 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.142201 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.142201 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:45.141963 2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 19:26:45.142201 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.142201 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:26:45.142043 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-tls podName:b1bfaba8-57b0-4b29-ae11-7aed9934c20f nodeName:}" failed. No retries permitted until 2026-07-01 19:26:45.642021089 +0000 UTC m=+312.645927081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-p65b7" (UID: "b1bfaba8-57b0-4b29-ae11-7aed9934c20f") : secret "openshift-state-metrics-tls" not found Jul 01 19:26:45.142201 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.142135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.142458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.142300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.142458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.141999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-metrics-client-ca\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.142458 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.142359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn4c9\" (UniqueName: \"kubernetes.io/projected/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-api-access-zn4c9\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.142624 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.142486 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.142891 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.142865 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-metrics-client-ca\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.144202 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.144173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.144339 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.144267 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.144543 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.144526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.151400 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.151379 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt22x\" (UniqueName: \"kubernetes.io/projected/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-kube-api-access-tt22x\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.154916 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.154892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn4c9\" (UniqueName: \"kubernetes.io/projected/7535e331-d7c7-4e5e-ab1d-5b94c2f667a2-kube-api-access-zn4c9\") pod \"kube-state-metrics-845b954455-b584p\" (UID: \"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2\") " pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.243703 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-textfile\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243703 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-wtmp\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243876 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-wtmp\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243876 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243876 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-root\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-metrics-client-ca\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrqk6\" (UniqueName: \"kubernetes.io/projected/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-kube-api-access-lrqk6\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-textfile\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-root\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.243984 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.243972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-sys\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.244231 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.244013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-sys\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.244231 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.244014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-tls\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.244434 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.244408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-accelerators-collector-config\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.244592 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.244440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-metrics-client-ca\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.246187 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.246170 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.246331 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.246302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-node-exporter-tls\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.253956 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.253935 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrqk6\" (UniqueName: \"kubernetes.io/projected/4446c0d7-7fbb-46be-aaa4-5d5ac8a96102-kube-api-access-lrqk6\") pod \"node-exporter-8kg57\" (UID: \"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102\") " pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.311016 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.310978 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" Jul 01 19:26:45.321323 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.321295 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8kg57" Jul 01 19:26:45.330995 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:26:45.330967 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4446c0d7_7fbb_46be_aaa4_5d5ac8a96102.slice/crio-053011ecfaad9b157cd405a11249e76cfa773547bac49c99459fe46a59a8412e WatchSource:0}: Error finding container 053011ecfaad9b157cd405a11249e76cfa773547bac49c99459fe46a59a8412e: Status 404 returned error can't find the container with id 053011ecfaad9b157cd405a11249e76cfa773547bac49c99459fe46a59a8412e Jul 01 19:26:45.446897 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.446753 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-b584p"] Jul 01 19:26:45.448756 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:26:45.448723 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7535e331_d7c7_4e5e_ab1d_5b94c2f667a2.slice/crio-6e10fdad46041458ead9b1cc7329cc106ff0419198cb1bc6939ee6f50173d304 WatchSource:0}: Error finding container 6e10fdad46041458ead9b1cc7329cc106ff0419198cb1bc6939ee6f50173d304: Status 404 returned error can't find the container with id 6e10fdad46041458ead9b1cc7329cc106ff0419198cb1bc6939ee6f50173d304 Jul 01 19:26:45.577993 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.577903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kg57" event={"ID":"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102","Type":"ContainerStarted","Data":"053011ecfaad9b157cd405a11249e76cfa773547bac49c99459fe46a59a8412e"} Jul 01 19:26:45.579007 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.578984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" event={"ID":"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2","Type":"ContainerStarted","Data":"6e10fdad46041458ead9b1cc7329cc106ff0419198cb1bc6939ee6f50173d304"} Jul 01 19:26:45.647861 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.647229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.651798 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.651767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1bfaba8-57b0-4b29-ae11-7aed9934c20f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-p65b7\" (UID: \"b1bfaba8-57b0-4b29-ae11-7aed9934c20f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.864306 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.864274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" Jul 01 19:26:45.996957 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:45.996933 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7"] Jul 01 19:26:45.999240 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:26:45.999210 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bfaba8_57b0_4b29_ae11_7aed9934c20f.slice/crio-66df79a93001c757280698a08d2106535afcff65d046713dd54d002f8a303012 WatchSource:0}: Error finding container 66df79a93001c757280698a08d2106535afcff65d046713dd54d002f8a303012: Status 404 returned error can't find the container with id 66df79a93001c757280698a08d2106535afcff65d046713dd54d002f8a303012 Jul 01 19:26:46.584691 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:46.584611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" event={"ID":"b1bfaba8-57b0-4b29-ae11-7aed9934c20f","Type":"ContainerStarted","Data":"303fcaea5a182bbd7129e2d326c4a31b8d063057a6cf93bf2304c4beaa4fe8fa"} Jul 01 19:26:46.584691 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:46.584673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" event={"ID":"b1bfaba8-57b0-4b29-ae11-7aed9934c20f","Type":"ContainerStarted","Data":"6754e68808916bff6c1a3a9474051929cb7cc384b23291897a6e96a164866a5d"} Jul 01 19:26:46.585182 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:46.584696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" event={"ID":"b1bfaba8-57b0-4b29-ae11-7aed9934c20f","Type":"ContainerStarted","Data":"66df79a93001c757280698a08d2106535afcff65d046713dd54d002f8a303012"} Jul 01 19:26:47.590692 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.590662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" event={"ID":"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2","Type":"ContainerStarted","Data":"a2970140b38ff8e49ea3727178b8996a7dea6db1d87d451ee52bb1921c95b44c"} Jul 01 19:26:47.591096 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.590723 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" event={"ID":"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2","Type":"ContainerStarted","Data":"fc416218f7754f0c65d340ac620235a9cb5e264ce18baa619505823ace9665a3"} Jul 01 19:26:47.591096 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.590743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" event={"ID":"7535e331-d7c7-4e5e-ab1d-5b94c2f667a2","Type":"ContainerStarted","Data":"596323971f28f23cdf881104423350d33162b5c6683d7bd49327284422a09f97"} Jul 01 19:26:47.592600 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.592556 2577 generic.go:356] "Generic (PLEG): container finished" podID="4446c0d7-7fbb-46be-aaa4-5d5ac8a96102" containerID="a68e8d23dcffc930ee9394dbaa04958d1b98624139e7921db533227fd05ae35e" exitCode=0 Jul 01 19:26:47.592774 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.592644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kg57" event={"ID":"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102","Type":"ContainerDied","Data":"a68e8d23dcffc930ee9394dbaa04958d1b98624139e7921db533227fd05ae35e"} Jul 01 19:26:47.594942 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.594916 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" event={"ID":"b1bfaba8-57b0-4b29-ae11-7aed9934c20f","Type":"ContainerStarted","Data":"1a4694ac36bc875b2450fd93aad80b84164e644cba30aac2e673603a33d03053"} Jul 01 19:26:47.611953 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.611900 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-b584p" podStartSLOduration=1.707391865 podStartE2EDuration="3.611882569s" totalImagesPullingTime="1.904490704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:47.611324556 +0000 UTC m=+314.615230571" watchObservedRunningTime="2026-07-01 19:26:47.611882569 +0000 UTC m=+314.615788580" Jul 01 19:26:47.633243 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:47.633197 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-p65b7" podStartSLOduration=2.400714961 podStartE2EDuration="3.633181775s" totalImagesPullingTime="1.232466814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:47.632602533 +0000 UTC m=+314.636508548" watchObservedRunningTime="2026-07-01 19:26:47.633181775 +0000 UTC m=+314.637087786" Jul 01 19:26:48.600248 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:48.600208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kg57" event={"ID":"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102","Type":"ContainerStarted","Data":"a4b5a91216b0449e4f8b928aa91009145a5a8549543b4aa0868cc624b299eba3"} Jul 01 19:26:48.600616 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:48.600271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8kg57" event={"ID":"4446c0d7-7fbb-46be-aaa4-5d5ac8a96102","Type":"ContainerStarted","Data":"eb56e5d95a5fe21a4d2424b0b5cdf22144d6d6417583c6f264ef83762007260b"} Jul 01 19:26:48.620769 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:48.620692 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8kg57" podStartSLOduration=3.294454032 podStartE2EDuration="4.620676022s" totalImagesPullingTime="1.256784154s" totalInitContainerRuntime="69.437836ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:48.620085794 +0000 UTC m=+315.623991805" watchObservedRunningTime="2026-07-01 19:26:48.620676022 +0000 UTC m=+315.624582033" Jul 01 19:26:50.057880 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.057842 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" podUID="dd45f0d3-6786-4103-8e02-1f9ea1474914" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 01 19:26:50.058339 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.057909 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" Jul 01 19:26:50.058389 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.058360 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"3ffa9e1902a6d2e356690af204395fc051b61bce66060be450c1cb010deb086e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 01 19:26:50.058434 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.058408 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" podUID="dd45f0d3-6786-4103-8e02-1f9ea1474914" containerName="service-proxy" containerID="cri-o://3ffa9e1902a6d2e356690af204395fc051b61bce66060be450c1cb010deb086e" gracePeriod=30 Jul 01 19:26:50.611282 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.611249 2577 generic.go:356] "Generic (PLEG): container finished" podID="dd45f0d3-6786-4103-8e02-1f9ea1474914" containerID="3ffa9e1902a6d2e356690af204395fc051b61bce66060be450c1cb010deb086e" exitCode=2 Jul 01 19:26:50.611467 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.611317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" event={"ID":"dd45f0d3-6786-4103-8e02-1f9ea1474914","Type":"ContainerDied","Data":"3ffa9e1902a6d2e356690af204395fc051b61bce66060be450c1cb010deb086e"} Jul 01 19:26:50.611467 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:50.611359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5747b4b6ff-sx54h" event={"ID":"dd45f0d3-6786-4103-8e02-1f9ea1474914","Type":"ContainerStarted","Data":"0ce22c20377b73c4066494d6f7b09767bcc1d08b19a8b4bf2ed0c884bc314c24"} Jul 01 19:26:59.812597 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.812567 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-65h6x"] Jul 01 19:26:59.815327 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.815312 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:26:59.817602 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.817579 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cc6b7\"" Jul 01 19:26:59.817733 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.817580 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:26:59.818000 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.817984 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:26:59.836586 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.836560 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-65h6x"] Jul 01 19:26:59.965119 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:26:59.965081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k79fg\" (UniqueName: \"kubernetes.io/projected/75f1dd89-919c-4f22-a207-44f4ac31feef-kube-api-access-k79fg\") pod \"downloads-5499b6fb8f-65h6x\" (UID: \"75f1dd89-919c-4f22-a207-44f4ac31feef\") " pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:27:00.065897 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:00.065806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k79fg\" (UniqueName: \"kubernetes.io/projected/75f1dd89-919c-4f22-a207-44f4ac31feef-kube-api-access-k79fg\") pod \"downloads-5499b6fb8f-65h6x\" (UID: \"75f1dd89-919c-4f22-a207-44f4ac31feef\") " pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:27:00.075382 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:00.075346 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k79fg\" (UniqueName: \"kubernetes.io/projected/75f1dd89-919c-4f22-a207-44f4ac31feef-kube-api-access-k79fg\") pod \"downloads-5499b6fb8f-65h6x\" (UID: \"75f1dd89-919c-4f22-a207-44f4ac31feef\") " pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:27:00.124349 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:00.124313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:27:00.263767 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:00.263729 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-65h6x"] Jul 01 19:27:00.266786 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:27:00.266764 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f1dd89_919c_4f22_a207_44f4ac31feef.slice/crio-1f60f7bfe4db93657b652e6a8b35a4b2f701bf3e337bc4d93e50e48a1c7b9607 WatchSource:0}: Error finding container 1f60f7bfe4db93657b652e6a8b35a4b2f701bf3e337bc4d93e50e48a1c7b9607: Status 404 returned error can't find the container with id 1f60f7bfe4db93657b652e6a8b35a4b2f701bf3e337bc4d93e50e48a1c7b9607 Jul 01 19:27:00.645336 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:00.645292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-65h6x" event={"ID":"75f1dd89-919c-4f22-a207-44f4ac31feef","Type":"ContainerStarted","Data":"1f60f7bfe4db93657b652e6a8b35a4b2f701bf3e337bc4d93e50e48a1c7b9607"} Jul 01 19:27:16.706634 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:16.706595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-65h6x" event={"ID":"75f1dd89-919c-4f22-a207-44f4ac31feef","Type":"ContainerStarted","Data":"22bcce7c68705c73215e17a5c65969373f36ae20e8072a2ac2b29743337984e8"} Jul 01 19:27:16.707128 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:16.706850 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:27:16.714697 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:16.714674 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-65h6x" Jul 01 19:27:16.733100 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:16.733049 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-65h6x" podStartSLOduration=1.507143068 podStartE2EDuration="17.733031231s" totalImagesPullingTime="16.225888163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:16.730309787 +0000 UTC m=+343.734215864" watchObservedRunningTime="2026-07-01 19:27:16.733031231 +0000 UTC m=+343.736937242" Jul 01 19:27:47.350394 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:47.350315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:27:47.352463 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:47.352427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e8c0a6f-a0a7-4884-94f0-cad4e7555877-metrics-certs\") pod \"network-metrics-daemon-56gcg\" (UID: \"3e8c0a6f-a0a7-4884-94f0-cad4e7555877\") " pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:27:47.389027 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:47.389000 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tjdnw\"" Jul 01 19:27:47.397082 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:47.397042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-56gcg" Jul 01 19:27:47.590443 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:47.590300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-56gcg"] Jul 01 19:27:47.593870 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:27:47.593839 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8c0a6f_a0a7_4884_94f0_cad4e7555877.slice/crio-5d7102f53a967eae258ee800f5483de32e6ffef57177aa1dc43fd54993b36c37 WatchSource:0}: Error finding container 5d7102f53a967eae258ee800f5483de32e6ffef57177aa1dc43fd54993b36c37: Status 404 returned error can't find the container with id 5d7102f53a967eae258ee800f5483de32e6ffef57177aa1dc43fd54993b36c37 Jul 01 19:27:47.824314 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:47.824281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-56gcg" event={"ID":"3e8c0a6f-a0a7-4884-94f0-cad4e7555877","Type":"ContainerStarted","Data":"5d7102f53a967eae258ee800f5483de32e6ffef57177aa1dc43fd54993b36c37"} Jul 01 19:27:49.832694 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:49.832661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-56gcg" event={"ID":"3e8c0a6f-a0a7-4884-94f0-cad4e7555877","Type":"ContainerStarted","Data":"8dda15ee80a1172baedcc4ed71aa9bcae17df50540c6c2fa46852de61cfbc9b9"} Jul 01 19:27:49.833064 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:49.832714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-56gcg" event={"ID":"3e8c0a6f-a0a7-4884-94f0-cad4e7555877","Type":"ContainerStarted","Data":"272af24d3337e532393d302fd13e2e844959050eb93d3eac89e48bcb15102cb7"} Jul 01 19:27:49.850748 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:27:49.850704 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-56gcg" podStartSLOduration=375.419808002 podStartE2EDuration="6m16.850688967s" totalImagesPullingTime="1.430880965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:49.849818565 +0000 UTC m=+376.853724580" watchObservedRunningTime="2026-07-01 19:27:49.850688967 +0000 UTC m=+376.854594978" Jul 01 19:28:50.104136 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.104102 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq"] Jul 01 19:28:50.106381 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.106364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.109211 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.109191 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:28:50.109979 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.109964 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vhwkr\"" Jul 01 19:28:50.110032 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.109979 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:28:50.119239 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.119214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq"] Jul 01 19:28:50.196076 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.196040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.196291 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.196100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.196291 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.196180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b92gd\" (UniqueName: \"kubernetes.io/projected/97e85cb2-68af-44ff-956a-b61c79e40b97-kube-api-access-b92gd\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.296523 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.296462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.296702 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.296543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b92gd\" (UniqueName: \"kubernetes.io/projected/97e85cb2-68af-44ff-956a-b61c79e40b97-kube-api-access-b92gd\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.296702 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.296575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.296934 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.296913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.296934 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.296927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.307923 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.307903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b92gd\" (UniqueName: \"kubernetes.io/projected/97e85cb2-68af-44ff-956a-b61c79e40b97-kube-api-access-b92gd\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.415301 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.415209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:28:50.543017 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:50.542986 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq"] Jul 01 19:28:50.546568 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:28:50.546543 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e85cb2_68af_44ff_956a_b61c79e40b97.slice/crio-168779ab9fdffe1d0eb0c6a776a38e5580e215b74478d6388bbf530e349c8c8b WatchSource:0}: Error finding container 168779ab9fdffe1d0eb0c6a776a38e5580e215b74478d6388bbf530e349c8c8b: Status 404 returned error can't find the container with id 168779ab9fdffe1d0eb0c6a776a38e5580e215b74478d6388bbf530e349c8c8b Jul 01 19:28:51.048462 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:51.048428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" event={"ID":"97e85cb2-68af-44ff-956a-b61c79e40b97","Type":"ContainerStarted","Data":"168779ab9fdffe1d0eb0c6a776a38e5580e215b74478d6388bbf530e349c8c8b"} Jul 01 19:28:58.074003 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:58.073974 2577 generic.go:356] "Generic (PLEG): container finished" podID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerID="c617799f3a6cd4a825419311ca9e4d1a5a30d422bb969f750874c0e2de622faf" exitCode=0 Jul 01 19:28:58.074311 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:28:58.074051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" event={"ID":"97e85cb2-68af-44ff-956a-b61c79e40b97","Type":"ContainerDied","Data":"c617799f3a6cd4a825419311ca9e4d1a5a30d422bb969f750874c0e2de622faf"} Jul 01 19:29:01.088035 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:01.087998 2577 generic.go:356] "Generic (PLEG): container finished" podID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerID="e8d4e7591e42a5061c15e7d6d272718c2c64be26680bed3363ca983637edb056" exitCode=0 Jul 01 19:29:01.088397 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:01.088078 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" event={"ID":"97e85cb2-68af-44ff-956a-b61c79e40b97","Type":"ContainerDied","Data":"e8d4e7591e42a5061c15e7d6d272718c2c64be26680bed3363ca983637edb056"} Jul 01 19:29:09.119768 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:09.119726 2577 generic.go:356] "Generic (PLEG): container finished" podID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerID="6e23c8d6ad1dd9ee98f6e6e0b2c3dde575c65864230e3cdb44b591faf0880453" exitCode=0 Jul 01 19:29:09.120118 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:09.119803 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" event={"ID":"97e85cb2-68af-44ff-956a-b61c79e40b97","Type":"ContainerDied","Data":"6e23c8d6ad1dd9ee98f6e6e0b2c3dde575c65864230e3cdb44b591faf0880453"} Jul 01 19:29:10.253130 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.253106 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:29:10.364719 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.364677 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b92gd\" (UniqueName: \"kubernetes.io/projected/97e85cb2-68af-44ff-956a-b61c79e40b97-kube-api-access-b92gd\") pod \"97e85cb2-68af-44ff-956a-b61c79e40b97\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " Jul 01 19:29:10.364894 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.364745 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-bundle\") pod \"97e85cb2-68af-44ff-956a-b61c79e40b97\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " Jul 01 19:29:10.364894 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.364843 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-util\") pod \"97e85cb2-68af-44ff-956a-b61c79e40b97\" (UID: \"97e85cb2-68af-44ff-956a-b61c79e40b97\") " Jul 01 19:29:10.365383 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.365360 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-bundle" (OuterVolumeSpecName: "bundle") pod "97e85cb2-68af-44ff-956a-b61c79e40b97" (UID: "97e85cb2-68af-44ff-956a-b61c79e40b97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:29:10.366940 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.366918 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e85cb2-68af-44ff-956a-b61c79e40b97-kube-api-access-b92gd" (OuterVolumeSpecName: "kube-api-access-b92gd") pod "97e85cb2-68af-44ff-956a-b61c79e40b97" (UID: "97e85cb2-68af-44ff-956a-b61c79e40b97"). InnerVolumeSpecName "kube-api-access-b92gd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:29:10.369047 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.369027 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-util" (OuterVolumeSpecName: "util") pod "97e85cb2-68af-44ff-956a-b61c79e40b97" (UID: "97e85cb2-68af-44ff-956a-b61c79e40b97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:29:10.466273 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.466168 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b92gd\" (UniqueName: \"kubernetes.io/projected/97e85cb2-68af-44ff-956a-b61c79e40b97-kube-api-access-b92gd\") on node \"ip-10-0-140-188.ec2.internal\" DevicePath \"\"" Jul 01 19:29:10.466273 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.466217 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-bundle\") on node \"ip-10-0-140-188.ec2.internal\" DevicePath \"\"" Jul 01 19:29:10.466273 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:10.466227 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97e85cb2-68af-44ff-956a-b61c79e40b97-util\") on node \"ip-10-0-140-188.ec2.internal\" DevicePath \"\"" Jul 01 19:29:11.128615 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:11.128590 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" Jul 01 19:29:11.128615 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:11.128592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589h9dbq" event={"ID":"97e85cb2-68af-44ff-956a-b61c79e40b97","Type":"ContainerDied","Data":"168779ab9fdffe1d0eb0c6a776a38e5580e215b74478d6388bbf530e349c8c8b"} Jul 01 19:29:11.128816 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:11.128636 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="168779ab9fdffe1d0eb0c6a776a38e5580e215b74478d6388bbf530e349c8c8b" Jul 01 19:29:22.912147 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912114 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-lfhgm"] Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912351 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="util" Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912361 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="util" Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912377 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="pull" Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912383 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="pull" Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912389 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="extract" Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912395 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="extract" Jul 01 19:29:22.912666 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.912435 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e85cb2-68af-44ff-956a-b61c79e40b97" containerName="extract" Jul 01 19:29:22.915175 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.915157 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:22.918122 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.918102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 19:29:22.918230 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.918151 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 01 19:29:22.918616 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.918600 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 01 19:29:22.918706 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.918642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-wg2vx\"" Jul 01 19:29:22.918706 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.918694 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 19:29:22.918971 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.918954 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 01 19:29:22.930863 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:22.930840 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-lfhgm"] Jul 01 19:29:23.058792 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.058760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47sz\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-kube-api-access-g47sz\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.058961 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.058814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.058961 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.058887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-cabundle0\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.159492 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.159448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.159699 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.159547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-cabundle0\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.159699 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.159579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47sz\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-kube-api-access-g47sz\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.159699 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.159602 2577 secret.go:281] references non-existent secret key: ca.crt Jul 01 19:29:23.159699 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.159620 2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 01 19:29:23.159699 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.159632 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-lfhgm: references non-existent secret key: ca.crt Jul 01 19:29:23.159699 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.159700 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates podName:65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59 nodeName:}" failed. No retries permitted until 2026-07-01 19:29:23.659677359 +0000 UTC m=+470.663583350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates") pod "keda-operator-68bff59c-lfhgm" (UID: "65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59") : references non-existent secret key: ca.crt Jul 01 19:29:23.160237 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.160218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-cabundle0\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.168093 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.168035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47sz\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-kube-api-access-g47sz\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.320952 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.320915 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-bhb87"] Jul 01 19:29:23.323242 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.323224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.326079 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.326065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 01 19:29:23.335389 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.335367 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-bhb87"] Jul 01 19:29:23.461491 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.461378 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-certificates\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.461491 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.461434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9qgl\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-kube-api-access-x9qgl\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.461707 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.461555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0508e980-04f8-4d3f-9581-f8b310368576-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.562052 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.562023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-certificates\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.562052 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.562053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9qgl\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-kube-api-access-x9qgl\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.562309 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.562098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0508e980-04f8-4d3f-9581-f8b310368576-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.562309 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.562165 2577 secret.go:281] references non-existent secret key: tls.crt Jul 01 19:29:23.562309 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.562183 2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 01 19:29:23.562309 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.562200 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-bhb87: references non-existent secret key: tls.crt Jul 01 19:29:23.562309 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.562253 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-certificates podName:0508e980-04f8-4d3f-9581-f8b310368576 nodeName:}" failed. No retries permitted until 2026-07-01 19:29:24.062238745 +0000 UTC m=+471.066144733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-certificates") pod "keda-metrics-apiserver-559f75f947-bhb87" (UID: "0508e980-04f8-4d3f-9581-f8b310368576") : references non-existent secret key: tls.crt Jul 01 19:29:23.562578 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.562396 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0508e980-04f8-4d3f-9581-f8b310368576-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.573673 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.573647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9qgl\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-kube-api-access-x9qgl\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:23.662618 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.662564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:23.662796 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.662719 2577 secret.go:281] references non-existent secret key: ca.crt Jul 01 19:29:23.662796 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.662734 2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 01 19:29:23.662796 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.662743 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-lfhgm: references non-existent secret key: ca.crt Jul 01 19:29:23.662896 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:23.662832 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates podName:65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59 nodeName:}" failed. No retries permitted until 2026-07-01 19:29:24.662814951 +0000 UTC m=+471.666720946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates") pod "keda-operator-68bff59c-lfhgm" (UID: "65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59") : references non-existent secret key: ca.crt Jul 01 19:29:23.840210 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.840125 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2rhwv"] Jul 01 19:29:23.842273 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.842255 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:23.844847 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.844817 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 01 19:29:23.855781 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.855751 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2rhwv"] Jul 01 19:29:23.964863 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.964824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr9lw\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-kube-api-access-tr9lw\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:23.965241 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:23.964913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-certificates\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.065704 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.065664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-certificates\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:24.065881 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.065723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-certificates\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.065881 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.065757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr9lw\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-kube-api-access-tr9lw\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.065954 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:24.065897 2577 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 01 19:29:24.065954 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:24.065919 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-2rhwv: secret "keda-admission-webhooks-certs" not found Jul 01 19:29:24.066022 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:29:24.065971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-certificates podName:d8b1bf95-dc60-471d-80be-3632c15183d2 nodeName:}" failed. No retries permitted until 2026-07-01 19:29:24.565955544 +0000 UTC m=+471.569861533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-certificates") pod "keda-admission-5fbd5c4644-2rhwv" (UID: "d8b1bf95-dc60-471d-80be-3632c15183d2") : secret "keda-admission-webhooks-certs" not found Jul 01 19:29:24.068378 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.068355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0508e980-04f8-4d3f-9581-f8b310368576-certificates\") pod \"keda-metrics-apiserver-559f75f947-bhb87\" (UID: \"0508e980-04f8-4d3f-9581-f8b310368576\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:24.076382 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.076359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr9lw\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-kube-api-access-tr9lw\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.233297 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.233256 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:24.363202 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.363169 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-bhb87"] Jul 01 19:29:24.367321 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:29:24.367292 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0508e980_04f8_4d3f_9581_f8b310368576.slice/crio-c3722526244915997382688332186b678f575753dee41c7ec2b3b658daff70c1 WatchSource:0}: Error finding container c3722526244915997382688332186b678f575753dee41c7ec2b3b658daff70c1: Status 404 returned error can't find the container with id c3722526244915997382688332186b678f575753dee41c7ec2b3b658daff70c1 Jul 01 19:29:24.569726 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.569633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-certificates\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.571995 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.571975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d8b1bf95-dc60-471d-80be-3632c15183d2-certificates\") pod \"keda-admission-5fbd5c4644-2rhwv\" (UID: \"d8b1bf95-dc60-471d-80be-3632c15183d2\") " pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.670256 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.670215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:24.672611 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.672581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59-certificates\") pod \"keda-operator-68bff59c-lfhgm\" (UID: \"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59\") " pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:24.725144 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.725112 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:24.752392 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.752362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:24.859973 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.859940 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-lfhgm"] Jul 01 19:29:24.863574 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:29:24.863550 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65cb9fa9_69bf_47ac_99d6_a8a1ae5a0b59.slice/crio-2d76531745f816f25afc086a1e169780731a8fa8e8abe0d387ca6bd877e42db4 WatchSource:0}: Error finding container 2d76531745f816f25afc086a1e169780731a8fa8e8abe0d387ca6bd877e42db4: Status 404 returned error can't find the container with id 2d76531745f816f25afc086a1e169780731a8fa8e8abe0d387ca6bd877e42db4 Jul 01 19:29:24.901827 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:24.901797 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2rhwv"] Jul 01 19:29:24.905370 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:29:24.905343 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b1bf95_dc60_471d_80be_3632c15183d2.slice/crio-9753343bf6cccb49aa647a54871bd78f51fd95fef3ad1b34a55345cb1aa3da3d WatchSource:0}: Error finding container 9753343bf6cccb49aa647a54871bd78f51fd95fef3ad1b34a55345cb1aa3da3d: Status 404 returned error can't find the container with id 9753343bf6cccb49aa647a54871bd78f51fd95fef3ad1b34a55345cb1aa3da3d Jul 01 19:29:25.177375 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:25.177344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-lfhgm" event={"ID":"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59","Type":"ContainerStarted","Data":"2d76531745f816f25afc086a1e169780731a8fa8e8abe0d387ca6bd877e42db4"} Jul 01 19:29:25.178387 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:25.178360 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" event={"ID":"d8b1bf95-dc60-471d-80be-3632c15183d2","Type":"ContainerStarted","Data":"9753343bf6cccb49aa647a54871bd78f51fd95fef3ad1b34a55345cb1aa3da3d"} Jul 01 19:29:25.179388 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:25.179369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" event={"ID":"0508e980-04f8-4d3f-9581-f8b310368576","Type":"ContainerStarted","Data":"c3722526244915997382688332186b678f575753dee41c7ec2b3b658daff70c1"} Jul 01 19:29:27.187969 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:27.187935 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" event={"ID":"d8b1bf95-dc60-471d-80be-3632c15183d2","Type":"ContainerStarted","Data":"495820f80aa2f15ae04e19666ad6a8f6a0cc6212616b5e010f75a5492d830792"} Jul 01 19:29:27.188347 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:27.188003 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:27.208199 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:27.208154 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" podStartSLOduration=2.570885816 podStartE2EDuration="4.208138579s" totalImagesPullingTime="1.637252763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:27.206469351 +0000 UTC m=+474.210375364" watchObservedRunningTime="2026-07-01 19:29:27.208138579 +0000 UTC m=+474.212044567" Jul 01 19:29:30.200837 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:30.200796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" event={"ID":"0508e980-04f8-4d3f-9581-f8b310368576","Type":"ContainerStarted","Data":"1177df9fc19ba44ebd2ac9197bfbfdb40d712117bce412021a5cce121d0aba6e"} Jul 01 19:29:30.201239 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:30.200960 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:30.220303 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:30.220254 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" podStartSLOduration=2.358406576 podStartE2EDuration="7.220238964s" totalImagesPullingTime="4.861832388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:30.21909655 +0000 UTC m=+477.223002563" watchObservedRunningTime="2026-07-01 19:29:30.220238964 +0000 UTC m=+477.224144974" Jul 01 19:29:37.227552 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:37.227488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-lfhgm" event={"ID":"65cb9fa9-69bf-47ac-99d6-a8a1ae5a0b59","Type":"ContainerStarted","Data":"9918c666750f398b62099dfae4a9baa3d5acaa14f31c018c8d6218ffac10df79"} Jul 01 19:29:37.227938 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:37.227580 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:29:37.245687 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:37.245639 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-lfhgm" podStartSLOduration=3.550869039 podStartE2EDuration="15.245625442s" totalImagesPullingTime="11.694756403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:37.2443744 +0000 UTC m=+484.248280412" watchObservedRunningTime="2026-07-01 19:29:37.245625442 +0000 UTC m=+484.249531454" Jul 01 19:29:41.208511 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:41.208478 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-bhb87" Jul 01 19:29:48.193950 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:48.193921 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-2rhwv" Jul 01 19:29:58.233841 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:29:58.233810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-lfhgm" Jul 01 19:30:31.429588 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.429507 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-2w4d8"] Jul 01 19:30:31.432111 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.432094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.436122 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.436100 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 19:30:31.436327 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.436302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-z54t4\"" Jul 01 19:30:31.436698 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.436681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 19:30:31.437055 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.437038 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 19:30:31.446663 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.446641 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-2w4d8"] Jul 01 19:30:31.560895 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.560857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4a51bd5a-5252-4063-a10b-184df7302071-data\") pod \"seaweedfs-64568bcd49-2w4d8\" (UID: \"4a51bd5a-5252-4063-a10b-184df7302071\") " pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.561072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.560905 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2wjg\" (UniqueName: \"kubernetes.io/projected/4a51bd5a-5252-4063-a10b-184df7302071-kube-api-access-r2wjg\") pod \"seaweedfs-64568bcd49-2w4d8\" (UID: \"4a51bd5a-5252-4063-a10b-184df7302071\") " pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.661394 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.661358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4a51bd5a-5252-4063-a10b-184df7302071-data\") pod \"seaweedfs-64568bcd49-2w4d8\" (UID: \"4a51bd5a-5252-4063-a10b-184df7302071\") " pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.661576 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.661403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2wjg\" (UniqueName: \"kubernetes.io/projected/4a51bd5a-5252-4063-a10b-184df7302071-kube-api-access-r2wjg\") pod \"seaweedfs-64568bcd49-2w4d8\" (UID: \"4a51bd5a-5252-4063-a10b-184df7302071\") " pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.661789 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.661771 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4a51bd5a-5252-4063-a10b-184df7302071-data\") pod \"seaweedfs-64568bcd49-2w4d8\" (UID: \"4a51bd5a-5252-4063-a10b-184df7302071\") " pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.685877 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.685813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2wjg\" (UniqueName: \"kubernetes.io/projected/4a51bd5a-5252-4063-a10b-184df7302071-kube-api-access-r2wjg\") pod \"seaweedfs-64568bcd49-2w4d8\" (UID: \"4a51bd5a-5252-4063-a10b-184df7302071\") " pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.743255 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.743217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:31.898058 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:31.898032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-2w4d8"] Jul 01 19:30:31.900640 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:30:31.900614 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a51bd5a_5252_4063_a10b_184df7302071.slice/crio-9ad94bfb36d9f09c5ff137fb476ba45e18a8d87de165ac39528aad2aee628a90 WatchSource:0}: Error finding container 9ad94bfb36d9f09c5ff137fb476ba45e18a8d87de165ac39528aad2aee628a90: Status 404 returned error can't find the container with id 9ad94bfb36d9f09c5ff137fb476ba45e18a8d87de165ac39528aad2aee628a90 Jul 01 19:30:32.424600 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:32.424560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-2w4d8" event={"ID":"4a51bd5a-5252-4063-a10b-184df7302071","Type":"ContainerStarted","Data":"9ad94bfb36d9f09c5ff137fb476ba45e18a8d87de165ac39528aad2aee628a90"} Jul 01 19:30:35.501636 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:35.501607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 19:30:36.444099 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:36.444069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-2w4d8" event={"ID":"4a51bd5a-5252-4063-a10b-184df7302071","Type":"ContainerStarted","Data":"396be1215f349f8a305260448620ad66ec910338facece70234d5d60d2a3850e"} Jul 01 19:30:36.444272 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:36.444160 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:30:36.460794 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:36.460745 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-2w4d8" podStartSLOduration=1.867305131 podStartE2EDuration="5.460731625s" totalImagesPullingTime="3.593426494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:30:36.46021447 +0000 UTC m=+543.464120482" watchObservedRunningTime="2026-07-01 19:30:36.460731625 +0000 UTC m=+543.464637635" Jul 01 19:30:42.450565 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:30:42.450539 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-2w4d8" Jul 01 19:31:33.436445 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:33.436417 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:31:33.436957 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:33.436544 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:31:42.519654 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.519619 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-ljc2p"] Jul 01 19:31:42.522980 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.522963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:42.525748 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.525725 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 01 19:31:42.525859 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.525803 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-qbfhb\"" Jul 01 19:31:42.535467 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.535446 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ljc2p"] Jul 01 19:31:42.574115 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.574082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l47r4\" (UniqueName: \"kubernetes.io/projected/24cae331-fe36-49ea-a0ca-9273b5ac7300-kube-api-access-l47r4\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:42.574284 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.574124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24cae331-fe36-49ea-a0ca-9273b5ac7300-tls-certs\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:42.674977 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.674938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l47r4\" (UniqueName: \"kubernetes.io/projected/24cae331-fe36-49ea-a0ca-9273b5ac7300-kube-api-access-l47r4\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:42.675148 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.674985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24cae331-fe36-49ea-a0ca-9273b5ac7300-tls-certs\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:42.675148 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:31:42.675096 2577 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 19:31:42.675219 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:31:42.675174 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24cae331-fe36-49ea-a0ca-9273b5ac7300-tls-certs podName:24cae331-fe36-49ea-a0ca-9273b5ac7300 nodeName:}" failed. No retries permitted until 2026-07-01 19:31:43.175150397 +0000 UTC m=+610.179056400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/24cae331-fe36-49ea-a0ca-9273b5ac7300-tls-certs") pod "model-serving-api-fd65d7d6-ljc2p" (UID: "24cae331-fe36-49ea-a0ca-9273b5ac7300") : secret "model-serving-api-tls" not found Jul 01 19:31:42.683946 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:42.683914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l47r4\" (UniqueName: \"kubernetes.io/projected/24cae331-fe36-49ea-a0ca-9273b5ac7300-kube-api-access-l47r4\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:43.177581 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:43.177544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24cae331-fe36-49ea-a0ca-9273b5ac7300-tls-certs\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:43.179909 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:43.179890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24cae331-fe36-49ea-a0ca-9273b5ac7300-tls-certs\") pod \"model-serving-api-fd65d7d6-ljc2p\" (UID: \"24cae331-fe36-49ea-a0ca-9273b5ac7300\") " pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:43.433319 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:43.433208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:43.562860 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:43.562808 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ljc2p"] Jul 01 19:31:43.565212 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:31:43.565186 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24cae331_fe36_49ea_a0ca_9273b5ac7300.slice/crio-0b5185bfce26c3942aa4d5641e2351b77f9f1f2572229e49297c8eafe07357ef WatchSource:0}: Error finding container 0b5185bfce26c3942aa4d5641e2351b77f9f1f2572229e49297c8eafe07357ef: Status 404 returned error can't find the container with id 0b5185bfce26c3942aa4d5641e2351b77f9f1f2572229e49297c8eafe07357ef Jul 01 19:31:43.567391 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:43.567375 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:31:43.685878 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:43.685793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ljc2p" event={"ID":"24cae331-fe36-49ea-a0ca-9273b5ac7300","Type":"ContainerStarted","Data":"0b5185bfce26c3942aa4d5641e2351b77f9f1f2572229e49297c8eafe07357ef"} Jul 01 19:31:46.700172 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:46.700135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ljc2p" event={"ID":"24cae331-fe36-49ea-a0ca-9273b5ac7300","Type":"ContainerStarted","Data":"6635c56860ab3a9f3fba3ce36f35317d006ca1953bd671281e05cac3147566c6"} Jul 01 19:31:46.700588 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:46.700238 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:31:46.731057 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:46.731002 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-ljc2p" podStartSLOduration=1.743195289 podStartE2EDuration="4.730987876s" totalImagesPullingTime="2.987792587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:46.729429688 +0000 UTC m=+613.733335711" watchObservedRunningTime="2026-07-01 19:31:46.730987876 +0000 UTC m=+613.734893887" Jul 01 19:31:57.707845 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:31:57.707763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-ljc2p" Jul 01 19:33:53.338545 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.338450 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-ssvfz"] Jul 01 19:33:53.341716 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.341699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.343967 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.343948 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 01 19:33:53.344081 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.344006 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 01 19:33:53.349938 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.349913 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-ssvfz"] Jul 01 19:33:53.450825 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.450791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/794e3d25-4cac-451b-ab81-3776d1a69389-data\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.450997 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.450841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/794e3d25-4cac-451b-ab81-3776d1a69389-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.450997 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.450895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmrkv\" (UniqueName: \"kubernetes.io/projected/794e3d25-4cac-451b-ab81-3776d1a69389-kube-api-access-xmrkv\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.551556 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.551520 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmrkv\" (UniqueName: \"kubernetes.io/projected/794e3d25-4cac-451b-ab81-3776d1a69389-kube-api-access-xmrkv\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.551742 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.551566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/794e3d25-4cac-451b-ab81-3776d1a69389-data\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.551742 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.551607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/794e3d25-4cac-451b-ab81-3776d1a69389-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.552027 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.552002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/794e3d25-4cac-451b-ab81-3776d1a69389-data\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.554069 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.554041 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/794e3d25-4cac-451b-ab81-3776d1a69389-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.566051 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.566022 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmrkv\" (UniqueName: \"kubernetes.io/projected/794e3d25-4cac-451b-ab81-3776d1a69389-kube-api-access-xmrkv\") pod \"seaweedfs-tls-custom-8b44d767d-ssvfz\" (UID: \"794e3d25-4cac-451b-ab81-3776d1a69389\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.650450 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.650416 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" Jul 01 19:33:53.777808 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:53.777765 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-ssvfz"] Jul 01 19:33:53.780313 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:33:53.780288 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794e3d25_4cac_451b_ab81_3776d1a69389.slice/crio-14f64f10e270b7beca1e9c63b6b8f828368d3735c1985258109350393a9b946f WatchSource:0}: Error finding container 14f64f10e270b7beca1e9c63b6b8f828368d3735c1985258109350393a9b946f: Status 404 returned error can't find the container with id 14f64f10e270b7beca1e9c63b6b8f828368d3735c1985258109350393a9b946f Jul 01 19:33:54.172211 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:54.172179 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" event={"ID":"794e3d25-4cac-451b-ab81-3776d1a69389","Type":"ContainerStarted","Data":"3d1f772c3172f98c645c4dd2e851f9bbbb4102176227581651e1ee3d80411116"} Jul 01 19:33:54.172393 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:33:54.172224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" event={"ID":"794e3d25-4cac-451b-ab81-3776d1a69389","Type":"ContainerStarted","Data":"14f64f10e270b7beca1e9c63b6b8f828368d3735c1985258109350393a9b946f"} Jul 01 19:34:06.794297 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.794234 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-ssvfz" podStartSLOduration=13.543847573 podStartE2EDuration="13.794211301s" totalImagesPullingTime="250.363728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:33:54.187709763 +0000 UTC m=+741.191615775" watchObservedRunningTime="2026-07-01 19:34:06.794211301 +0000 UTC m=+753.798117313" Jul 01 19:34:06.795682 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.795660 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-scxtj"] Jul 01 19:34:06.799903 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.799887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.802414 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.802392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 01 19:34:06.802536 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.802400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 01 19:34:06.805942 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.805917 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-scxtj"] Jul 01 19:34:06.853752 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.853715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2468026d-ff83-46fc-ba47-3815d0e26daa-data\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.853923 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.853766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7czns\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-kube-api-access-7czns\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.853923 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.853846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.954274 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.954237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.954462 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.954283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2468026d-ff83-46fc-ba47-3815d0e26daa-data\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.954462 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.954325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7czns\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-kube-api-access-7czns\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.954462 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:34:06.954374 2577 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 01 19:34:06.954462 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:34:06.954391 2577 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-scxtj: secret "seaweedfs-tls-serving" not found Jul 01 19:34:06.954462 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:34:06.954452 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-seaweedfs-tls-serving podName:2468026d-ff83-46fc-ba47-3815d0e26daa nodeName:}" failed. No retries permitted until 2026-07-01 19:34:07.454436173 +0000 UTC m=+754.458342163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-scxtj" (UID: "2468026d-ff83-46fc-ba47-3815d0e26daa") : secret "seaweedfs-tls-serving" not found Jul 01 19:34:06.954803 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.954784 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2468026d-ff83-46fc-ba47-3815d0e26daa-data\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:06.962886 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:06.962860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7czns\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-kube-api-access-7czns\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:07.459874 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:07.459841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:07.462216 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:07.462195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/2468026d-ff83-46fc-ba47-3815d0e26daa-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-scxtj\" (UID: \"2468026d-ff83-46fc-ba47-3815d0e26daa\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:07.711354 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:07.711275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" Jul 01 19:34:07.836737 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:07.836640 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-scxtj"] Jul 01 19:34:07.839303 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:34:07.839273 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2468026d_ff83_46fc_ba47_3815d0e26daa.slice/crio-630e4876766c4c50f08d918eb34750fac7cb66fdf9b134c87a0fd3cb3f37c15e WatchSource:0}: Error finding container 630e4876766c4c50f08d918eb34750fac7cb66fdf9b134c87a0fd3cb3f37c15e: Status 404 returned error can't find the container with id 630e4876766c4c50f08d918eb34750fac7cb66fdf9b134c87a0fd3cb3f37c15e Jul 01 19:34:08.233188 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:08.233154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" event={"ID":"2468026d-ff83-46fc-ba47-3815d0e26daa","Type":"ContainerStarted","Data":"6a0da2c4f4f77c9c25fede8726e063cfca32550e4a4961a5d8e954f553b17e41"} Jul 01 19:34:08.233375 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:08.233205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" event={"ID":"2468026d-ff83-46fc-ba47-3815d0e26daa","Type":"ContainerStarted","Data":"630e4876766c4c50f08d918eb34750fac7cb66fdf9b134c87a0fd3cb3f37c15e"} Jul 01 19:34:08.251085 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:34:08.251029 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-scxtj" podStartSLOduration=1.967081915 podStartE2EDuration="2.251012077s" totalImagesPullingTime="283.930162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:34:08.250110782 +0000 UTC m=+755.254016796" watchObservedRunningTime="2026-07-01 19:34:08.251012077 +0000 UTC m=+755.254918088" Jul 01 19:36:33.459384 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:36:33.459358 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:36:33.460113 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:36:33.460092 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:38:01.600236 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.600137 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5"] Jul 01 19:38:01.603606 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.603582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.605924 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.605899 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\"" Jul 01 19:38:01.606056 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.605904 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\"" Jul 01 19:38:01.606056 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.605908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2q28w\"" Jul 01 19:38:01.606691 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.606674 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 19:38:01.606740 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.606722 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 01 19:38:01.614680 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.614652 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5"] Jul 01 19:38:01.700951 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.700910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.700951 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.700950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.701176 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.700978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcp2\" (UniqueName: \"kubernetes.io/projected/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-api-access-5pcp2\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.801470 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.801429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.801470 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.801471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.801780 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.801536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcp2\" (UniqueName: \"kubernetes.io/projected/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-api-access-5pcp2\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.802160 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.802140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.804029 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.804010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.814323 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.814295 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcp2\" (UniqueName: \"kubernetes.io/projected/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-api-access-5pcp2\") pod \"message-dumper-predictor-6575bcfdfd-vdwv5\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:01.913888 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:01.913847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:02.048086 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:02.048060 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5"] Jul 01 19:38:02.050583 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:38:02.050553 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946e62ba_e1f5_4173_a195_c3bbc5dbbcb8.slice/crio-bf885cd584059b539a856b9156dd07a057470dbd1d50d0ed14354a06d467da10 WatchSource:0}: Error finding container bf885cd584059b539a856b9156dd07a057470dbd1d50d0ed14354a06d467da10: Status 404 returned error can't find the container with id bf885cd584059b539a856b9156dd07a057470dbd1d50d0ed14354a06d467da10 Jul 01 19:38:02.052540 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:02.052520 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:38:02.119175 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:02.119142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" event={"ID":"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8","Type":"ContainerStarted","Data":"bf885cd584059b539a856b9156dd07a057470dbd1d50d0ed14354a06d467da10"} Jul 01 19:38:04.131652 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:04.131617 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" event={"ID":"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8","Type":"ContainerStarted","Data":"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3"} Jul 01 19:38:07.145979 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:07.145940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" event={"ID":"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8","Type":"ContainerStarted","Data":"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5"} Jul 01 19:38:07.146359 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:07.146171 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:07.146359 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:07.146321 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:07.147931 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:07.147912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:38:07.162650 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:07.162591 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" podStartSLOduration=2.079451996 podStartE2EDuration="6.162572989s" totalImagesPullingTime="4.083120993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:38:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:38:07.161881004 +0000 UTC m=+994.165787016" watchObservedRunningTime="2026-07-01 19:38:07.162572989 +0000 UTC m=+994.166479000" Jul 01 19:38:14.158523 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:38:14.158480 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:39:56.672966 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:56.672931 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-vdwv5_946e62ba-e1f5-4173-a195-c3bbc5dbbcb8/kserve-container/0.log" Jul 01 19:39:57.025831 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.025746 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5"] Jul 01 19:39:57.026019 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.025987 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kserve-container" containerID="cri-o://9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3" gracePeriod=30 Jul 01 19:39:57.026165 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.026055 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kube-rbac-proxy" containerID="cri-o://1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5" gracePeriod=30 Jul 01 19:39:57.146433 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.146388 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused" Jul 01 19:39:57.282836 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.282775 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:39:57.304155 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.304122 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-proxy-tls\") pod \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " Jul 01 19:39:57.304320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.304162 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pcp2\" (UniqueName: \"kubernetes.io/projected/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-api-access-5pcp2\") pod \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " Jul 01 19:39:57.304320 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.304204 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-rbac-proxy-sar-config\") pod \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\" (UID: \"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8\") " Jul 01 19:39:57.304590 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.304566 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" (UID: "946e62ba-e1f5-4173-a195-c3bbc5dbbcb8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:39:57.306373 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.306345 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" (UID: "946e62ba-e1f5-4173-a195-c3bbc5dbbcb8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:39:57.306507 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.306386 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-api-access-5pcp2" (OuterVolumeSpecName: "kube-api-access-5pcp2") pod "946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" (UID: "946e62ba-e1f5-4173-a195-c3bbc5dbbcb8"). InnerVolumeSpecName "kube-api-access-5pcp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:39:57.404948 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.404911 2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-proxy-tls\") on node \"ip-10-0-140-188.ec2.internal\" DevicePath \"\"" Jul 01 19:39:57.404948 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.404940 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pcp2\" (UniqueName: \"kubernetes.io/projected/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-api-access-5pcp2\") on node \"ip-10-0-140-188.ec2.internal\" DevicePath \"\"" Jul 01 19:39:57.404948 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.404951 2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-188.ec2.internal\" DevicePath \"\"" Jul 01 19:39:57.569241 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569152 2577 generic.go:356] "Generic (PLEG): container finished" podID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerID="1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5" exitCode=2 Jul 01 19:39:57.569241 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569177 2577 generic.go:356] "Generic (PLEG): container finished" podID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerID="9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3" exitCode=2 Jul 01 19:39:57.569241 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" event={"ID":"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8","Type":"ContainerDied","Data":"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5"} Jul 01 19:39:57.569241 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569223 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" Jul 01 19:39:57.569528 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" event={"ID":"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8","Type":"ContainerDied","Data":"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3"} Jul 01 19:39:57.569528 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5" event={"ID":"946e62ba-e1f5-4173-a195-c3bbc5dbbcb8","Type":"ContainerDied","Data":"bf885cd584059b539a856b9156dd07a057470dbd1d50d0ed14354a06d467da10"} Jul 01 19:39:57.569528 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.569339 2577 scope.go:117] "RemoveContainer" containerID="1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5" Jul 01 19:39:57.577594 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.577572 2577 scope.go:117] "RemoveContainer" containerID="9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3" Jul 01 19:39:57.585346 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.585328 2577 scope.go:117] "RemoveContainer" containerID="1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5" Jul 01 19:39:57.585512 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.585476 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5"] Jul 01 19:39:57.585659 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:39:57.585637 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5\": container with ID starting with 1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5 not found: ID does not exist" containerID="1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5" Jul 01 19:39:57.585713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.585669 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5"} err="failed to get container status \"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5\": rpc error: code = NotFound desc = could not find container \"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5\": container with ID starting with 1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5 not found: ID does not exist" Jul 01 19:39:57.585713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.585690 2577 scope.go:117] "RemoveContainer" containerID="9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3" Jul 01 19:39:57.585936 ip-10-0-140-188 kubenswrapper[2577]: E0701 19:39:57.585919 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3\": container with ID starting with 9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3 not found: ID does not exist" containerID="9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3" Jul 01 19:39:57.585998 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.585944 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3"} err="failed to get container status \"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3\": rpc error: code = NotFound desc = could not find container \"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3\": container with ID starting with 9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3 not found: ID does not exist" Jul 01 19:39:57.585998 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.585966 2577 scope.go:117] "RemoveContainer" containerID="1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5" Jul 01 19:39:57.586198 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.586181 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5"} err="failed to get container status \"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5\": rpc error: code = NotFound desc = could not find container \"1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5\": container with ID starting with 1c0be8d6d9056685fe4379bf0bb00aed2c1c82785dd7d8a67fdca56592471ae5 not found: ID does not exist" Jul 01 19:39:57.586246 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.586200 2577 scope.go:117] "RemoveContainer" containerID="9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3" Jul 01 19:39:57.586402 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.586383 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3"} err="failed to get container status \"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3\": rpc error: code = NotFound desc = could not find container \"9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3\": container with ID starting with 9174913c04d71beeaf98cea7b9ea774b18bd5527065b70fc8e450b92d85bcbe3 not found: ID does not exist" Jul 01 19:39:57.589076 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:57.589054 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-vdwv5"] Jul 01 19:39:59.488480 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:39:59.488448 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" path="/var/lib/kubelet/pods/946e62ba-e1f5-4173-a195-c3bbc5dbbcb8/volumes" Jul 01 19:41:33.488981 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:41:33.488949 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:41:33.489866 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:41:33.489847 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:46:33.512162 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:46:33.512132 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:46:33.514940 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:46:33.514919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:50:27.027712 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:27.027679 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ll98k_7e2cb84b-b822-4d3b-9358-41076175c222/global-pull-secret-syncer/0.log" Jul 01 19:50:27.228490 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:27.228459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l9tmc_f4506ecc-840e-499e-a1f8-8262c71abd35/konnectivity-agent/0.log" Jul 01 19:50:27.413022 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:27.412988 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-188.ec2.internal_5bd03072a955915507969a2e0aed7f92/haproxy/0.log" Jul 01 19:50:31.528475 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:31.528441 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-b584p_7535e331-d7c7-4e5e-ab1d-5b94c2f667a2/kube-state-metrics/0.log" Jul 01 19:50:31.554934 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:31.554899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-b584p_7535e331-d7c7-4e5e-ab1d-5b94c2f667a2/kube-rbac-proxy-main/0.log" Jul 01 19:50:31.583908 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:31.583882 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-b584p_7535e331-d7c7-4e5e-ab1d-5b94c2f667a2/kube-rbac-proxy-self/0.log" Jul 01 19:50:31.698958 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:31.698926 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kg57_4446c0d7-7fbb-46be-aaa4-5d5ac8a96102/node-exporter/0.log" Jul 01 19:50:31.725206 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:31.725176 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kg57_4446c0d7-7fbb-46be-aaa4-5d5ac8a96102/kube-rbac-proxy/0.log" Jul 01 19:50:31.766569 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:31.766534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8kg57_4446c0d7-7fbb-46be-aaa4-5d5ac8a96102/init-textfile/0.log" Jul 01 19:50:32.049936 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:32.049909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-p65b7_b1bfaba8-57b0-4b29-ae11-7aed9934c20f/kube-rbac-proxy-main/0.log" Jul 01 19:50:32.078558 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:32.078524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-p65b7_b1bfaba8-57b0-4b29-ae11-7aed9934c20f/kube-rbac-proxy-self/0.log" Jul 01 19:50:32.104618 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:32.104588 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-p65b7_b1bfaba8-57b0-4b29-ae11-7aed9934c20f/openshift-state-metrics/0.log" Jul 01 19:50:34.899005 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:34.898975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-65h6x_75f1dd89-919c-4f22-a207-44f4ac31feef/download-server/0.log" Jul 01 19:50:35.345011 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.344939 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72"] Jul 01 19:50:35.345277 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.345264 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kube-rbac-proxy" Jul 01 19:50:35.345318 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.345278 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kube-rbac-proxy" Jul 01 19:50:35.345318 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.345292 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kserve-container" Jul 01 19:50:35.345318 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.345298 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kserve-container" Jul 01 19:50:35.345409 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.345356 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kube-rbac-proxy" Jul 01 19:50:35.345409 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.345364 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="946e62ba-e1f5-4173-a195-c3bbc5dbbcb8" containerName="kserve-container" Jul 01 19:50:35.348138 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.348124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.350351 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.350329 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qhllw\"/\"kube-root-ca.crt\"" Jul 01 19:50:35.351072 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.351052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qhllw\"/\"default-dockercfg-vv6n8\"" Jul 01 19:50:35.351201 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.351053 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qhllw\"/\"openshift-service-ca.crt\"" Jul 01 19:50:35.359363 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.359337 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72"] Jul 01 19:50:35.449957 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.449923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-sys\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.449957 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.449953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-proc\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.450199 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.449973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxgq9\" (UniqueName: \"kubernetes.io/projected/5c53182d-29a6-4fbb-a1e2-caec384180eb-kube-api-access-gxgq9\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.450199 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.450113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-podres\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.450199 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.450142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-lib-modules\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551531 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-sys\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551531 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-proc\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgq9\" (UniqueName: \"kubernetes.io/projected/5c53182d-29a6-4fbb-a1e2-caec384180eb-kube-api-access-gxgq9\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-sys\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551608 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-proc\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-podres\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551713 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-lib-modules\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551862 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-lib-modules\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.551862 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.551766 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c53182d-29a6-4fbb-a1e2-caec384180eb-podres\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.559430 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.559398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgq9\" (UniqueName: \"kubernetes.io/projected/5c53182d-29a6-4fbb-a1e2-caec384180eb-kube-api-access-gxgq9\") pod \"perf-node-gather-daemonset-mts72\" (UID: \"5c53182d-29a6-4fbb-a1e2-caec384180eb\") " pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.658689 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.658649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:35.786796 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.786773 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72"] Jul 01 19:50:35.789327 ip-10-0-140-188 kubenswrapper[2577]: W0701 19:50:35.789302 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c53182d_29a6_4fbb_a1e2_caec384180eb.slice/crio-a6c2efe729523fc25f0ee83444d88194ff359ecb60a9d6d9aea569a6b6da7654 WatchSource:0}: Error finding container a6c2efe729523fc25f0ee83444d88194ff359ecb60a9d6d9aea569a6b6da7654: Status 404 returned error can't find the container with id a6c2efe729523fc25f0ee83444d88194ff359ecb60a9d6d9aea569a6b6da7654 Jul 01 19:50:35.998992 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.998895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" event={"ID":"5c53182d-29a6-4fbb-a1e2-caec384180eb","Type":"ContainerStarted","Data":"2387a224980571a9cab845e4e8bbc6d672970648b9e2879b33bb3b85cbfaf6b1"} Jul 01 19:50:35.998992 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.998947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" event={"ID":"5c53182d-29a6-4fbb-a1e2-caec384180eb","Type":"ContainerStarted","Data":"a6c2efe729523fc25f0ee83444d88194ff359ecb60a9d6d9aea569a6b6da7654"} Jul 01 19:50:35.998992 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:35.998986 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:36.014764 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:36.014716 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" podStartSLOduration=1.014699616 podStartE2EDuration="1.014699616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:50:36.014413715 +0000 UTC m=+1743.018319727" watchObservedRunningTime="2026-07-01 19:50:36.014699616 +0000 UTC m=+1743.018605627" Jul 01 19:50:36.281453 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:36.281371 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zvff_165eb356-87b4-4773-8a08-cae5f93355b6/dns/0.log" Jul 01 19:50:36.300553 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:36.300523 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8zvff_165eb356-87b4-4773-8a08-cae5f93355b6/kube-rbac-proxy/0.log" Jul 01 19:50:36.421438 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:36.421406 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7v7b7_3e4f15b3-7d74-4722-867b-7e03e738c6ce/dns-node-resolver/0.log" Jul 01 19:50:36.947245 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:36.947220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f6m72_c7e63629-7610-47af-9d26-ab628d916015/node-ca/0.log" Jul 01 19:50:38.108271 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:38.108246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j55h_ae1faf5b-8b45-4b73-865d-65773613e758/serve-healthcheck-canary/0.log" Jul 01 19:50:38.532614 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:38.532522 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9x8mw_ba8a7e79-6415-4b32-8a8a-6f04f1852341/kube-rbac-proxy/0.log" Jul 01 19:50:38.554304 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:38.554240 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9x8mw_ba8a7e79-6415-4b32-8a8a-6f04f1852341/exporter/0.log" Jul 01 19:50:38.573380 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:38.573357 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9x8mw_ba8a7e79-6415-4b32-8a8a-6f04f1852341/extractor/0.log" Jul 01 19:50:40.799489 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:40.799458 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-ljc2p_24cae331-fe36-49ea-a0ca-9273b5ac7300/server/0.log" Jul 01 19:50:41.062405 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:41.062328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-2w4d8_4a51bd5a-5252-4063-a10b-184df7302071/seaweedfs/0.log" Jul 01 19:50:41.084934 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:41.084907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-ssvfz_794e3d25-4cac-451b-ab81-3776d1a69389/seaweedfs-tls-custom/0.log" Jul 01 19:50:41.108018 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:41.107986 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-scxtj_2468026d-ff83-46fc-ba47-3815d0e26daa/seaweedfs-tls-serving/0.log" Jul 01 19:50:42.011888 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:42.011862 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qhllw/perf-node-gather-daemonset-mts72" Jul 01 19:50:46.597038 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.597007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/kube-multus-additional-cni-plugins/0.log" Jul 01 19:50:46.619748 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.619723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/egress-router-binary-copy/0.log" Jul 01 19:50:46.640565 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.640540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/cni-plugins/0.log" Jul 01 19:50:46.660252 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.660224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/bond-cni-plugin/0.log" Jul 01 19:50:46.681002 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.680974 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/routeoverride-cni/0.log" Jul 01 19:50:46.701412 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.701390 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/whereabouts-cni-bincopy/0.log" Jul 01 19:50:46.723668 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.723640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5jgl_fdf0e61f-92a2-4a9e-be15-32c16367d8f3/whereabouts-cni/0.log" Jul 01 19:50:46.919857 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.919829 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ks8tz_a6669e6a-96f3-4c76-adb0-130a1a5c1d10/kube-multus/0.log" Jul 01 19:50:46.994688 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:46.994656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-56gcg_3e8c0a6f-a0a7-4884-94f0-cad4e7555877/network-metrics-daemon/0.log" Jul 01 19:50:47.027198 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:47.027173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-56gcg_3e8c0a6f-a0a7-4884-94f0-cad4e7555877/kube-rbac-proxy/0.log" Jul 01 19:50:48.226252 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.226216 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-controller/0.log" Jul 01 19:50:48.243108 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.243085 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/0.log" Jul 01 19:50:48.243258 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.243113 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovn-acl-logging/1.log" Jul 01 19:50:48.268654 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.268621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/kube-rbac-proxy-node/0.log" Jul 01 19:50:48.294436 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.294405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 19:50:48.310381 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.310351 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/northd/0.log" Jul 01 19:50:48.330654 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.330626 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/nbdb/0.log" Jul 01 19:50:48.350935 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.350909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/sbdb/0.log" Jul 01 19:50:48.403774 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:48.403743 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8jjd_4ce39f68-291d-4fa7-aa72-acc4334715c4/ovnkube-controller/0.log" Jul 01 19:50:49.594549 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:49.594481 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h9bmp_0efd8352-f5b2-4110-aa85-7b2f7d8b908c/network-check-target-container/0.log" Jul 01 19:50:50.467612 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:50.467585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cphkp_b6ec83d0-4da2-4873-a27e-8bfedbf4d174/iptables-alerter/0.log" Jul 01 19:50:51.170021 ip-10-0-140-188 kubenswrapper[2577]: I0701 19:50:51.169995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qz4lv_7fa1cca5-71a8-41f0-af8c-84ff7014d131/tuned/0.log"