Jul 02 15:47:05.808046 ip-10-0-141-121 systemd[1]: Starting Kubernetes Kubelet... Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.320344 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328586 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328608 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328611 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328617 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328619 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328622 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328626 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:47:06.375591 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328628 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328632 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328634 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328637 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328640 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328645 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328670 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328674 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328677 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328679 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328682 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328687 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328692 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328695 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328698 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328701 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328704 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328708 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328711 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:47:06.376955 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328714 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328717 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328719 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328722 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328725 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328728 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328730 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328733 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328737 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328740 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328743 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328746 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328749 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328752 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328755 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328758 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328760 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328763 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328766 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328769 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:47:06.377557 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328772 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328774 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328777 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328780 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328782 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328786 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328789 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328791 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328794 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328798 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328820 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328824 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328826 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328829 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328834 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328838 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328841 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328844 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328847 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:47:06.378384 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328851 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328853 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328856 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328859 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328862 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328865 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328874 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328877 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328881 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328884 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328886 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328889 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328892 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328895 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328898 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328901 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328903 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328906 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328909 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328912 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:47:06.378969 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328914 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328917 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328920 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328922 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328925 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328928 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328931 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328933 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328936 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328939 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328941 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328945 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328948 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.328950 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329752 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329761 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329766 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329769 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329775 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329779 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:47:06.379556 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329782 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329784 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329787 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329789 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329793 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329796 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329799 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329801 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329804 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329808 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329813 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329815 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329818 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329821 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329823 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329828 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329831 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329834 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329837 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:47:06.380129 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329839 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329842 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329844 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329847 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329850 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329854 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329857 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329860 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329863 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329866 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329868 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329872 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329875 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329878 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329881 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329884 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329886 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329889 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329891 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:47:06.380725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329894 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329896 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329899 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329901 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329904 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329906 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329909 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329911 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329913 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329917 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329921 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329926 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329929 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329933 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329935 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329938 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329941 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329944 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329947 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329950 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:47:06.381376 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329952 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329955 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329958 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329962 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329966 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329968 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329971 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329974 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329977 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329979 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329982 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329984 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329987 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329990 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329993 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329995 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.329998 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330000 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330003 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330005 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:47:06.382072 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330008 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330012 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330014 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330017 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330020 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330023 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330025 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330028 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330030 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330033 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330036 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330038 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330041 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330043 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330046 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330464 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330471 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330474 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330477 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330480 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:47:06.382620 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330484 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330487 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330490 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330493 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330495 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330498 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330501 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330503 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330506 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330508 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330511 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330513 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330516 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330521 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330523 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330526 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330528 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330531 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330533 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330536 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:47:06.383301 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330539 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330541 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330543 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330546 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330549 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330551 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330554 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330556 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330560 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330563 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330566 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330568 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330573 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330576 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330579 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330582 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330584 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330588 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330591 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:47:06.383923 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330593 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330596 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330598 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330601 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330603 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330606 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330610 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330613 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330616 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330618 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330622 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330626 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330628 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330631 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330634 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330637 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330640 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330642 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330645 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330648 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:47:06.384624 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330670 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330675 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330678 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330680 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330683 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330685 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330689 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330691 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330694 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330697 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330700 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330702 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330705 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330707 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330710 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330712 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330715 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330717 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330721 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330724 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:47:06.385202 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330727 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330729 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330732 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330734 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330737 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330740 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330742 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330745 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330747 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330750 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330752 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330755 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330757 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330762 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.330766 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330850 2571 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330859 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330866 2571 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330871 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330876 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 15:47:06.385807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330881 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330886 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330893 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330898 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330903 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330908 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330913 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330918 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330920 2571 flags.go:64] FLAG: --cgroup-root="" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330923 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330929 2571 flags.go:64] FLAG: --client-ca-file="" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330932 2571 flags.go:64] FLAG: --cloud-provider="external" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330935 2571 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330941 2571 flags.go:64] FLAG: --cluster-domain="" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330944 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330948 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330951 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330954 2571 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330958 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330961 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330964 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330967 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330970 2571 flags.go:64] FLAG: --contention-profiling="false" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330974 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 15:47:06.386372 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330977 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330981 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330984 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330989 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330992 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330995 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.330998 2571 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331001 2571 flags.go:64] FLAG: --enable-server="true" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331005 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331010 2571 flags.go:64] FLAG: --event-burst="100" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331013 2571 flags.go:64] FLAG: --event-qps="50" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331016 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331019 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331022 2571 flags.go:64] FLAG: --eviction-hard="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331026 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331029 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331032 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331035 2571 flags.go:64] FLAG: --eviction-soft="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331040 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331043 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331047 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331049 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331052 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331055 2571 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331058 2571 flags.go:64] FLAG: --feature-gates="" Jul 02 15:47:06.387095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331062 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331065 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331069 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331072 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331075 2571 flags.go:64] FLAG: --healthz-port="10248" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331078 2571 flags.go:64] FLAG: --help="false" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331081 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331084 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331090 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331093 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331096 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331100 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331102 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331105 2571 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331108 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331111 2571 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331115 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331118 2571 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331121 2571 flags.go:64] FLAG: --kube-reserved="" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331123 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331126 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331129 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331132 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331135 2571 flags.go:64] FLAG: --lock-file="" Jul 02 15:47:06.387901 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331138 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331143 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331146 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331152 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331155 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331157 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331160 2571 flags.go:64] FLAG: --logging-format="text" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331163 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331166 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331169 2571 flags.go:64] FLAG: --manifest-url="" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331172 2571 flags.go:64] FLAG: --manifest-url-header="" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331177 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331180 2571 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331184 2571 flags.go:64] FLAG: --max-pods="110" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331187 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331190 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331195 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331198 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331201 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331204 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331207 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331215 2571 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331218 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331221 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 15:47:06.388639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331224 2571 flags.go:64] FLAG: --pod-cidr="" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331227 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331233 2571 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331236 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331239 2571 flags.go:64] FLAG: --pods-per-core="0" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331242 2571 flags.go:64] FLAG: --port="10250" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331245 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331248 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d5222f7731475ce" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331252 2571 flags.go:64] FLAG: --qos-reserved="" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331256 2571 flags.go:64] FLAG: --read-only-port="10255" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331260 2571 flags.go:64] FLAG: --register-node="true" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331263 2571 flags.go:64] FLAG: --register-with-taints="" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331266 2571 flags.go:64] FLAG: --registry-burst="10" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331269 2571 flags.go:64] FLAG: --registry-qps="5" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331272 2571 flags.go:64] FLAG: --reserved-cpus="" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331275 2571 flags.go:64] FLAG: --reserved-memory="" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331279 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331282 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331285 2571 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331289 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331292 2571 flags.go:64] FLAG: --runonce="false" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331294 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331297 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331301 2571 flags.go:64] FLAG: --seccomp-default="false" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331305 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 15:47:06.389725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331308 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331312 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331315 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331318 2571 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331321 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331324 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331327 2571 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331330 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331333 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331336 2571 flags.go:64] FLAG: --system-cgroups="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331339 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331346 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331349 2571 flags.go:64] FLAG: --tls-cert-file="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331351 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331355 2571 flags.go:64] FLAG: --tls-min-version="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331359 2571 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331361 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331366 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331368 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331371 2571 flags.go:64] FLAG: --v="2" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331375 2571 flags.go:64] FLAG: --version="false" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331380 2571 flags.go:64] FLAG: --vmodule="" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331384 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331387 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 15:47:06.539212 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331509 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:47:06.426919 ip-10-0-141-121 systemd[1]: Started Kubernetes Kubelet. Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331514 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331518 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331521 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331524 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331527 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331530 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331535 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331538 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331542 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331545 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331548 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331552 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331556 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331559 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331562 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331565 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331567 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331571 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331573 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:47:06.564467 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331576 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331579 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331582 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331584 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331587 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331591 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331593 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331596 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331598 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331601 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331604 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331607 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331609 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331612 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331615 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331617 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331620 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331623 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331625 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331630 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:47:06.565495 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331632 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331635 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331638 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331640 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331643 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331645 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331648 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331665 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331670 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331674 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331676 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331684 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331687 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331689 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331692 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331695 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331697 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331701 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331704 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331707 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:47:06.566256 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331709 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331713 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331716 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331719 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331721 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331724 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331727 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331730 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331732 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331735 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331738 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331741 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331744 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331753 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331756 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331760 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331764 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331767 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331770 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:47:06.567013 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331773 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331775 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331778 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331780 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331783 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331793 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331796 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331799 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331801 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331804 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331809 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331812 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331814 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331817 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331820 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331822 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331824 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331827 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331830 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:47:06.567616 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.331832 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.331838 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.340181 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.340349 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.340373 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.340382 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340457 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340463 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340466 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340469 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340472 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340475 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340479 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340481 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340484 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:47:06.568379 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340487 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340491 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340493 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340503 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340506 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340509 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340512 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340514 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340517 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340520 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340522 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340525 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340527 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340530 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340533 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340536 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340541 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340544 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340547 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:47:06.568935 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340550 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340553 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340556 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340559 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340561 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340563 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340566 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340569 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340572 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340574 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340577 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340579 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340584 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340587 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340590 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340593 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340595 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340604 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340607 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:47:06.569559 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340610 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340613 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340615 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340617 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340620 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340623 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340626 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340628 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340631 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340635 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340637 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340640 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340643 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340646 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340649 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340670 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340675 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340678 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340680 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340683 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:47:06.570192 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340686 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340689 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340691 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340694 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340696 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340699 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340701 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340704 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340707 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340710 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340712 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340721 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340724 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340726 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340729 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340731 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340734 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340736 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340739 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340741 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:47:06.570887 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340744 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340749 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340753 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340756 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340758 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340761 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340764 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340767 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340770 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340772 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340775 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340777 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.340783 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340955 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340960 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:47:06.571516 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340963 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340967 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340970 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340973 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340977 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340981 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340984 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340988 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.340990 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341003 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341008 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341011 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341014 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341017 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341019 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341022 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341025 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341028 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341030 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:47:06.572108 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341033 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341035 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341038 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341040 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341043 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341045 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341048 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341050 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341053 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341056 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341058 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341061 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341063 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341066 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341068 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341071 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341073 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341076 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341078 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:47:06.572687 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341081 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341085 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341088 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341092 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341102 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341105 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341108 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341110 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341113 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341116 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341118 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341121 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341123 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341126 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341128 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341131 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341133 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341136 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341139 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:47:06.573258 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341141 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341144 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341146 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341149 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341151 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341154 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341156 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341159 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341167 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341170 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341172 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341174 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341177 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341180 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341184 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341186 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341191 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341197 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341205 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341208 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:47:06.574006 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341211 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341213 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341216 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341218 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341221 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341223 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341226 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341228 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341231 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341234 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341236 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341239 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341241 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341244 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341246 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341249 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341251 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341254 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341256 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:47:06.574625 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:06.341259 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.341264 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.341420 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.344048 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.345843 2571 server.go:1019] "Starting client certificate rotation" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.345964 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.345998 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.352641 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.354184 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.363796 2571 log.go:25] "Validated CRI v1 runtime API" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.380854 2571 log.go:25] "Validated CRI v1 image API" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.380913 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:47:06.575243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.382756 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 15:47:06.575881 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.386926 2571 fs.go:135] Filesystem UUIDs: map[3638d298-c949-4589-ad72-bf7aaca9beff:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8ceff6bd-0f92-4af1-9e5e-aa11c0bea4ce:/dev/nvme0n1p3] Jul 02 15:47:06.575881 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.386952 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.395472 2571 manager.go:216] Machine: {Timestamp:2026-07-02 15:47:06.39393686 +0000 UTC m=+0.404359709 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099779 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2692ffadc6b1c9bc3d4fb4033446de SystemUUID:ec2692ff-adc6-b1c9-bc3d-4fb4033446de BootID:fcadc6a0-4b69-4af5-99c9-3901e292c3d2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:eb:49:70:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:eb:49:70:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:7f:ef:fc:b2:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.395601 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.395777 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.399561 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.399610 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.401251 2571 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.401268 2571 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.401277 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.402064 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.403329 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412163 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412343 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412384 2571 kubelet.go:486] "Attempting to sync node with API server" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412403 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412424 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412440 2571 kubelet.go:398] "Adding apiserver pod source" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.412454 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 15:47:06.576269 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.413164 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.413195 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.416997 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419042 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419073 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419956 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419971 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419979 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419984 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419994 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.419999 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420009 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420014 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420022 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420027 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420036 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420042 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420919 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.420936 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.425417 2571 server.go:1268] "Started kubelet" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.425535 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.425692 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.425719 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.427318 2571 server.go:310] "Adding debug handlers to kubelet server" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.429598 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.430115 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.430328 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.430328 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.433188 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.432278 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-121.ec2.internal.18be83a02b09edb3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-121.ec2.internal,UID:ip-10-0-141-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-121.ec2.internal,},FirstTimestamp:2026-07-02 15:47:06.425372083 +0000 UTC m=+0.435794934,LastTimestamp:2026-07-02 15:47:06.425372083 +0000 UTC m=+0.435794934,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-121.ec2.internal,}" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.441699 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lg2s" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.441932 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.441945 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.442140 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.442729 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.442753 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.442798 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443036 2571 reconstruct.go:97] "Volume reconstruction finished" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443048 2571 reconciler.go:29] "Reconciler: start to sync state" Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443093 2571 factory.go:55] Registering systemd factory Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443124 2571 factory.go:223] Registration of the systemd container factory successfully Jul 02 15:47:06.757015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443432 2571 factory.go:153] Registering CRI-O factory Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443447 2571 factory.go:223] Registration of the crio container factory successfully Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443598 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443626 2571 factory.go:103] Registering Raw factory Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.443644 2571 manager.go:1196] Started watching for new ooms in manager Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.444183 2571 manager.go:349] Starting recovery of all containers Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.444432 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.444525 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.451194 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lg2s" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.460850 2571 manager.go:354] Recovery completed Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.466131 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.468010 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.468036 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.468046 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.468909 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.468918 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.468935 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.469759 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.470752 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.470782 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.470793 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.471158 2571 policy_none.go:49] "None policy: Start" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.471171 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.471182 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.473279 2571 policy_none.go:47] "Start" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.514629 2571 manager.go:337] "Starting Device Plugin manager" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.514685 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.514703 2571 server.go:87] "Starting device plugin registration server" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.515081 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.515098 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.515198 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.515489 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.515505 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.516263 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.516326 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.536325 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.537563 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.537600 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.537622 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.537669 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.547748 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.615895 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.617134 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.617176 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.617193 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.617240 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.758409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.626840 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.626879 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-121.ec2.internal\": node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.637815 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal"] Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.637934 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.642502 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.642537 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.642552 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.644058 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.644083 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.645064 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.645212 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.645270 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.645988 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.645999 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.646017 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.646020 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.646028 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.646030 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.648432 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.648470 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.649215 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.649260 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.649276 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.653024 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.676859 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-121.ec2.internal\" not found" node="ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.682241 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-121.ec2.internal\" not found" node="ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.744750 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.744784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.760603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.744807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff8112a09a92e79e1fba8f9541e6f8d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-121.ec2.internal\" (UID: \"ff8112a09a92e79e1fba8f9541e6f8d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.761485 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.744840 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.761485 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:06.744856 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdda60bf425dadd7b86ec2242e37edb6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal\" (UID: \"bdda60bf425dadd7b86ec2242e37edb6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:06.761485 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:06.754865 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.288980 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.233337 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff8112a09a92e79e1fba8f9541e6f8d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-121.ec2.internal\" (UID: \"ff8112a09a92e79e1fba8f9541e6f8d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 15:47:08.288980 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.233428 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff8112a09a92e79e1fba8f9541e6f8d7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-121.ec2.internal\" (UID: \"ff8112a09a92e79e1fba8f9541e6f8d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 15:47:08.288980 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:08.242305 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.453266 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:08.343026 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.453266 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.367184 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:08.453266 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.373465 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 15:47:08.453266 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:08.443482 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.624779 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:08.543979 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.813759 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:08.644554 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.813759 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.730996 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 15:47:08.813759 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.731236 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:47:08.813759 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:08.745462 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-121.ec2.internal\" not found" Jul 02 15:47:08.817039 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.816811 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.827880 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.827989 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.846699 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.847361 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 15:42:07 +0000 UTC" deadline="2027-12-12 00:22:07.040782459 +0000 UTC" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.847400 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12656h34m58.193386756s" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.848528 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.850591 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.860497 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.878061 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thb8r" Jul 02 15:47:08.971870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:08.886903 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thb8r" Jul 02 15:47:09.131347 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:09.081064 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8112a09a92e79e1fba8f9541e6f8d7.slice/crio-62abd50c736b7831840edbbfb882c1eafc2ffc78e1d5c7e6ccbc8f691a9b88c4 WatchSource:0}: Error finding container 62abd50c736b7831840edbbfb882c1eafc2ffc78e1d5c7e6ccbc8f691a9b88c4: Status 404 returned error can't find the container with id 62abd50c736b7831840edbbfb882c1eafc2ffc78e1d5c7e6ccbc8f691a9b88c4 Jul 02 15:47:09.131347 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:09.089650 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdda60bf425dadd7b86ec2242e37edb6.slice/crio-727e09c40128d4faea107da693dd501819fd2bd12286ec9f070b73d551c6208a WatchSource:0}: Error finding container 727e09c40128d4faea107da693dd501819fd2bd12286ec9f070b73d551c6208a: Status 404 returned error can't find the container with id 727e09c40128d4faea107da693dd501819fd2bd12286ec9f070b73d551c6208a Jul 02 15:47:09.131347 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.090316 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:47:09.301905 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.136894 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:47:09.301905 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.197625 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:47:09.830440 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.798867 2571 apiserver.go:52] "Watching apiserver" Jul 02 15:47:09.830440 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.807484 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 15:47:09.830440 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.807975 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-v9s2j","kube-system/global-pull-secret-syncer-7wjzr","openshift-cluster-node-tuning-operator/tuned-gtc5m","openshift-image-registry/node-ca-m7w29","openshift-multus/network-metrics-daemon-2wh5p","openshift-network-operator/iptables-alerter-6w7f7","openshift-ovn-kubernetes/ovnkube-node-7kmq5","kube-system/konnectivity-agent-cxjcb","kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq","openshift-dns/node-resolver-mf7b7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-vtnq7","openshift-multus/multus-xvsdx"] Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.846349 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.846470 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.846564 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.848808 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.848903 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.851646 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.854068 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.877112 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.877197 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.878032 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.878546 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.878630 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.878783 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.878557 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5nrbn\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.879321 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.879616 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9mdbv\"" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.890418 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:42:08 +0000 UTC" deadline="2028-02-08 21:39:49.379361334 +0000 UTC" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.890464 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14069h52m39.488901996s" Jul 02 15:47:09.907044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.894063 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946558 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946602 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-systemd\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946631 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-kubernetes\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946658 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-host\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946697 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7bzc\" (UniqueName: \"kubernetes.io/projected/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-kube-api-access-d7bzc\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr5t8\" (UniqueName: \"kubernetes.io/projected/51cccf36-504c-42d9-85ef-8ce5a4d7b270-kube-api-access-cr5t8\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946747 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-ovn\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946766 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-log-socket\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946788 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-cni-bin\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946811 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946831 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-env-overrides\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946847 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-modprobe-d\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946881 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysconfig\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946937 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffg8k\" (UniqueName: \"kubernetes.io/projected/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-kube-api-access-ffg8k\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946959 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-run-netns\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.967762 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.946982 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947009 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947057 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-lib-modules\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947105 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe76034-ddd9-4202-aff1-b9cb5b7685f1-host\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947165 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947202 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-systemd-units\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947311 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-slash\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947336 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovnkube-script-lib\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947366 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-systemd\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947389 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-tmp\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947413 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-kubelet-config\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947468 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-iptables-alerter-script\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947538 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovnkube-config\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947576 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-run\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947610 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ct2l\" (UniqueName: \"kubernetes.io/projected/abe76034-ddd9-4202-aff1-b9cb5b7685f1-kube-api-access-8ct2l\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:09.968986 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947645 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-host-slash\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947672 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-node-log\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947696 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-var-lib-kubelet\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947720 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-var-lib-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947751 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-etc-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947771 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-cni-netd\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947814 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovn-node-metrics-cert\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947843 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysctl-d\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947866 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysctl-conf\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947887 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-sys\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-kubelet\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947929 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjvl\" (UniqueName: \"kubernetes.io/projected/0d4571b5-a9a3-4a52-89be-fb924dbf680d-kube-api-access-qrjvl\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947954 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-tuned\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.947976 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe76034-ddd9-4202-aff1-b9cb5b7685f1-serviceca\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:09.969817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.948001 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-dbus\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:09.976234 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.976196 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:47:09.976234 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.976224 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 15:47:09.976389 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.976285 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wgdrb\"" Jul 02 15:47:09.976389 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.976224 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 15:47:09.976597 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.976534 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:09.977211 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.976985 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:09.977211 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.977020 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:09.977211 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.977038 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:09.977211 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:09.977108 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:10.477085896 +0000 UTC m=+3.101720051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:09.978952 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.978673 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:09.979559 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.979535 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 15:47:09.979669 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.979561 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jh9v9\"" Jul 02 15:47:09.979852 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.979827 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 15:47:09.985787 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.985312 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 15:47:09.985787 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.985363 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 15:47:09.985787 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.985659 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 15:47:09.987254 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.986953 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:09.987254 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.987247 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 15:47:09.988700 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.987292 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 15:47:09.988700 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.987577 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-csq7m\"" Jul 02 15:47:09.988700 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.987744 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 15:47:09.990345 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.990238 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:09.992253 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.992062 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 15:47:09.992253 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.992191 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 15:47:09.994599 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.993374 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 15:47:09.994599 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.993700 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 15:47:09.994599 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.993907 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 15:47:09.994599 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.993928 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mnl8r\"" Jul 02 15:47:09.994599 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.994057 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:09.994599 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.994137 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hgwpm\"" Jul 02 15:47:09.997319 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:09.996976 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.001291 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.001162 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerStarted","Data":"727e09c40128d4faea107da693dd501819fd2bd12286ec9f070b73d551c6208a"} Jul 02 15:47:10.001291 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.001252 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" event={"ID":"ff8112a09a92e79e1fba8f9541e6f8d7","Type":"ContainerStarted","Data":"62abd50c736b7831840edbbfb882c1eafc2ffc78e1d5c7e6ccbc8f691a9b88c4"} Jul 02 15:47:10.003923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.002966 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tlqpq\"" Jul 02 15:47:10.003923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.003371 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 15:47:10.003923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.003567 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 15:47:10.003923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.003662 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 15:47:10.003923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.003816 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 15:47:10.003923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.003886 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 15:47:10.004358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.004334 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gzkp4\"" Jul 02 15:47:10.004664 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.004632 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 15:47:10.018722 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.018688 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:47:10.030140 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.030109 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 15:47:10.049140 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049098 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.049327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049157 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-cni-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.049327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049195 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-systemd-units\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.049327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049221 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-slash\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.049327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovnkube-script-lib\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.049327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049276 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-registration-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.049327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049301 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-netns\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049330 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-iptables-alerter-script\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049359 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-run\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049373 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-systemd-units\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049458 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049502 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049531 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-cnibin\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049550 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-run\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049555 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-socket-dir-parent\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049457 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-slash\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049589 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-k8s-cni-cncf-io\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049620 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-host-slash\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049645 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-var-lib-kubelet\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049671 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovn-node-metrics-cert\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.049739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049712 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysctl-d\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049750 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-var-lib-kubelet\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049761 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-sys\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049785 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-socket-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049945 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysctl-d\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.049984 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-host-slash\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050023 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-sys\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050052 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077692ea-c0ac-462e-b55d-bb7717b8b74e-tmp-dir\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050079 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-cni-binary-copy\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050084 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-iptables-alerter-script\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050148 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050173 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv29c\" (UniqueName: \"kubernetes.io/projected/1617fa55-96af-468c-90ee-53e97764869d-kube-api-access-rv29c\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050205 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-kubelet\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050230 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjvl\" (UniqueName: \"kubernetes.io/projected/0d4571b5-a9a3-4a52-89be-fb924dbf680d-kube-api-access-qrjvl\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050255 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-sys-fs\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050285 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovnkube-script-lib\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-dbus\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:10.050402 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050363 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-kubernetes\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.050533 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050536 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-kubernetes\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050541 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-kubelet\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.050600 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:10.550581121 +0000 UTC m=+3.175215262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050593 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050668 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-kubelet\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1617fa55-96af-468c-90ee-53e97764869d-multus-daemon-config\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-ovn\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050845 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-dbus\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050867 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-cni-bin\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050909 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-ovn\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.050983 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-cni-bin\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051013 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-env-overrides\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051045 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-modprobe-d\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a0d76ac-9d58-4558-8419-e8c608fb3b61-agent-certs\") pod \"konnectivity-agent-cxjcb\" (UID: \"7a0d76ac-9d58-4558-8419-e8c608fb3b61\") " pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.051207 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051092 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-system-cni-dir\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051114 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-os-release\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051135 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051159 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffg8k\" (UniqueName: \"kubernetes.io/projected/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-kube-api-access-ffg8k\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051179 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051201 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051221 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe76034-ddd9-4202-aff1-b9cb5b7685f1-host\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051241 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhxp8\" (UniqueName: \"kubernetes.io/projected/ef37b213-8d7b-45b5-84ba-2f62cea9be93-kube-api-access-qhxp8\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051233 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051266 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/077692ea-c0ac-462e-b55d-bb7717b8b74e-hosts-file\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051286 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-os-release\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051306 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-cni-bin\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051342 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051363 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-systemd\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051382 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-tmp\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051403 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a0d76ac-9d58-4558-8419-e8c608fb3b61-konnectivity-ca\") pod \"konnectivity-agent-cxjcb\" (UID: \"7a0d76ac-9d58-4558-8419-e8c608fb3b61\") " pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051424 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-cni-multus\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.052000 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051465 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-kubelet-config\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051464 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-env-overrides\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051487 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovnkube-config\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051178 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-modprobe-d\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051509 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ct2l\" (UniqueName: \"kubernetes.io/projected/abe76034-ddd9-4202-aff1-b9cb5b7685f1-kube-api-access-8ct2l\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051545 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-system-cni-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051552 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051568 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-etc-kubernetes\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051587 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abe76034-ddd9-4202-aff1-b9cb5b7685f1-host\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051589 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-node-log\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051611 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-cnibin\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051630 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-conf-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051634 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-systemd\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051653 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-var-lib-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051675 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-etc-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051698 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-cni-netd\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051719 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysctl-conf\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.052873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051739 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-tuned\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051759 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-hostroot\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051780 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe76034-ddd9-4202-aff1-b9cb5b7685f1-serviceca\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051800 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-device-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051818 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-kubelet-config\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051821 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsg5x\" (UniqueName: \"kubernetes.io/projected/5d91359e-696a-44b1-aa72-242bbc989802-kube-api-access-wsg5x\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-multus-certs\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.051909 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.051942 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysctl-conf\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052017 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-cni-netd\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.052051 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:10.552034112 +0000 UTC m=+3.176668264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052071 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-systemd\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052080 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-var-lib-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052122 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-etc-openvswitch\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052126 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-host\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052169 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-host\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052215 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7bzc\" (UniqueName: \"kubernetes.io/projected/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-kube-api-access-d7bzc\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.053694 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052263 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr5t8\" (UniqueName: \"kubernetes.io/projected/51cccf36-504c-42d9-85ef-8ce5a4d7b270-kube-api-access-cr5t8\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052286 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-node-log\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052433 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovnkube-config\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052478 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-run-systemd\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052583 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-log-socket\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052641 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-log-socket\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052685 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysconfig\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052693 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052733 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-sysconfig\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052733 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks82t\" (UniqueName: \"kubernetes.io/projected/077692ea-c0ac-462e-b55d-bb7717b8b74e-kube-api-access-ks82t\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052772 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1617fa55-96af-468c-90ee-53e97764869d-cni-binary-copy\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052800 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-run-netns\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052833 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-lib-modules\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052860 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d4571b5-a9a3-4a52-89be-fb924dbf680d-host-run-netns\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.052959 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-lib-modules\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.054491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.054039 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/abe76034-ddd9-4202-aff1-b9cb5b7685f1-serviceca\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.055317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.055296 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d4571b5-a9a3-4a52-89be-fb924dbf680d-ovn-node-metrics-cert\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.055579 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.055559 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-tmp\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.056231 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.056188 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-etc-tuned\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.064052 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.063936 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ct2l\" (UniqueName: \"kubernetes.io/projected/abe76034-ddd9-4202-aff1-b9cb5b7685f1-kube-api-access-8ct2l\") pod \"node-ca-m7w29\" (UID: \"abe76034-ddd9-4202-aff1-b9cb5b7685f1\") " pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.064052 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.063936 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffg8k\" (UniqueName: \"kubernetes.io/projected/d02289b2-fe5c-450f-85a6-af56ab0b7fd4-kube-api-access-ffg8k\") pod \"iptables-alerter-6w7f7\" (UID: \"d02289b2-fe5c-450f-85a6-af56ab0b7fd4\") " pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.064327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.064300 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7bzc\" (UniqueName: \"kubernetes.io/projected/a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7-kube-api-access-d7bzc\") pod \"tuned-gtc5m\" (UID: \"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7\") " pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.065658 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.065611 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr5t8\" (UniqueName: \"kubernetes.io/projected/51cccf36-504c-42d9-85ef-8ce5a4d7b270-kube-api-access-cr5t8\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:10.066840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.066807 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjvl\" (UniqueName: \"kubernetes.io/projected/0d4571b5-a9a3-4a52-89be-fb924dbf680d-kube-api-access-qrjvl\") pod \"ovnkube-node-7kmq5\" (UID: \"0d4571b5-a9a3-4a52-89be-fb924dbf680d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-socket-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153594 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077692ea-c0ac-462e-b55d-bb7717b8b74e-tmp-dir\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153623 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-cni-binary-copy\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153652 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv29c\" (UniqueName: \"kubernetes.io/projected/1617fa55-96af-468c-90ee-53e97764869d-kube-api-access-rv29c\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153680 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-sys-fs\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153725 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153756 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-kubelet\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153768 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-socket-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1617fa55-96af-468c-90ee-53e97764869d-multus-daemon-config\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153836 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a0d76ac-9d58-4558-8419-e8c608fb3b61-agent-certs\") pod \"konnectivity-agent-cxjcb\" (UID: \"7a0d76ac-9d58-4558-8419-e8c608fb3b61\") " pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.153860 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153862 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-system-cni-dir\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.154558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.153909 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-system-cni-dir\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.154558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154330 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-kubelet\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.154558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154401 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-sys-fs\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.154558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154420 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1617fa55-96af-468c-90ee-53e97764869d-multus-daemon-config\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.154558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154460 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077692ea-c0ac-462e-b55d-bb7717b8b74e-tmp-dir\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.154558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-os-release\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154603 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154635 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-os-release\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154642 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhxp8\" (UniqueName: \"kubernetes.io/projected/ef37b213-8d7b-45b5-84ba-2f62cea9be93-kube-api-access-qhxp8\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154669 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/077692ea-c0ac-462e-b55d-bb7717b8b74e-hosts-file\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154697 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-os-release\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154699 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154721 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-cni-bin\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154769 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/077692ea-c0ac-462e-b55d-bb7717b8b74e-hosts-file\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.154840 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154777 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a0d76ac-9d58-4558-8419-e8c608fb3b61-konnectivity-ca\") pod \"konnectivity-agent-cxjcb\" (UID: \"7a0d76ac-9d58-4558-8419-e8c608fb3b61\") " pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.154938 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-cni-binary-copy\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155037 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-os-release\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-cni-multus\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155074 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-cni-bin\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-system-cni-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155109 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-var-lib-cni-multus\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155121 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-etc-kubernetes\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155128 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d91359e-696a-44b1-aa72-242bbc989802-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155147 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-cnibin\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155156 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-system-cni-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155171 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-conf-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155186 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-etc-kubernetes\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155200 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-cnibin\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155204 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-hostroot\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155227 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-conf-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155254 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-device-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.155288 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155281 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsg5x\" (UniqueName: \"kubernetes.io/projected/5d91359e-696a-44b1-aa72-242bbc989802-kube-api-access-wsg5x\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155304 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-hostroot\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155313 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a0d76ac-9d58-4558-8419-e8c608fb3b61-konnectivity-ca\") pod \"konnectivity-agent-cxjcb\" (UID: \"7a0d76ac-9d58-4558-8419-e8c608fb3b61\") " pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155307 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-multus-certs\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155345 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-multus-certs\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-device-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155381 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks82t\" (UniqueName: \"kubernetes.io/projected/077692ea-c0ac-462e-b55d-bb7717b8b74e-kube-api-access-ks82t\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1617fa55-96af-468c-90ee-53e97764869d-cni-binary-copy\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155463 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-cni-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155531 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-registration-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155558 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-netns\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155588 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155651 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-cni-dir\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155691 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-registration-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155713 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155715 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-cnibin\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155750 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-socket-dir-parent\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155752 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-netns\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155765 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef37b213-8d7b-45b5-84ba-2f62cea9be93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155782 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-k8s-cni-cncf-io\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155808 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-cnibin\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155821 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-multus-socket-dir-parent\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155858 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1617fa55-96af-468c-90ee-53e97764869d-host-run-k8s-cni-cncf-io\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155934 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1617fa55-96af-468c-90ee-53e97764869d-cni-binary-copy\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.156709 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.155926 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d91359e-696a-44b1-aa72-242bbc989802-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.157178 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.157149 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a0d76ac-9d58-4558-8419-e8c608fb3b61-agent-certs\") pod \"konnectivity-agent-cxjcb\" (UID: \"7a0d76ac-9d58-4558-8419-e8c608fb3b61\") " pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.164111 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.164011 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhxp8\" (UniqueName: \"kubernetes.io/projected/ef37b213-8d7b-45b5-84ba-2f62cea9be93-kube-api-access-qhxp8\") pod \"aws-ebs-csi-driver-node-mh7nq\" (UID: \"ef37b213-8d7b-45b5-84ba-2f62cea9be93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.164111 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.164012 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv29c\" (UniqueName: \"kubernetes.io/projected/1617fa55-96af-468c-90ee-53e97764869d-kube-api-access-rv29c\") pod \"multus-xvsdx\" (UID: \"1617fa55-96af-468c-90ee-53e97764869d\") " pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.165373 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.165242 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks82t\" (UniqueName: \"kubernetes.io/projected/077692ea-c0ac-462e-b55d-bb7717b8b74e-kube-api-access-ks82t\") pod \"node-resolver-mf7b7\" (UID: \"077692ea-c0ac-462e-b55d-bb7717b8b74e\") " pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.165373 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.165263 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsg5x\" (UniqueName: \"kubernetes.io/projected/5d91359e-696a-44b1-aa72-242bbc989802-kube-api-access-wsg5x\") pod \"multus-additional-cni-plugins-vtnq7\" (UID: \"5d91359e-696a-44b1-aa72-242bbc989802\") " pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.167227 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.167165 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" Jul 02 15:47:10.173867 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.173611 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7w29" Jul 02 15:47:10.278976 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.278880 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6w7f7" Jul 02 15:47:10.290664 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.290565 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:10.300118 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.300070 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:10.310576 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.310520 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" Jul 02 15:47:10.320857 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.320824 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mf7b7" Jul 02 15:47:10.328952 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.328916 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" Jul 02 15:47:10.338307 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.338277 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvsdx" Jul 02 15:47:10.448211 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.448176 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4571b5_a9a3_4a52_89be_fb924dbf680d.slice/crio-1e6292c06284b3c692dd0932fae2ad2f3869a5988fd270e169b8f9c4205f0ff1 WatchSource:0}: Error finding container 1e6292c06284b3c692dd0932fae2ad2f3869a5988fd270e169b8f9c4205f0ff1: Status 404 returned error can't find the container with id 1e6292c06284b3c692dd0932fae2ad2f3869a5988fd270e169b8f9c4205f0ff1 Jul 02 15:47:10.448979 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.448946 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d91359e_696a_44b1_aa72_242bbc989802.slice/crio-2b06f254a07c3cb6f6d81a3099353dc1a10fb7a5c8ee095fef0a927afcd5d5ab WatchSource:0}: Error finding container 2b06f254a07c3cb6f6d81a3099353dc1a10fb7a5c8ee095fef0a927afcd5d5ab: Status 404 returned error can't find the container with id 2b06f254a07c3cb6f6d81a3099353dc1a10fb7a5c8ee095fef0a927afcd5d5ab Jul 02 15:47:10.449711 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.449679 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0d76ac_9d58_4558_8419_e8c608fb3b61.slice/crio-601c0414419c03fb87701f6cec72d4adb2072921481d19445a8091e296062e29 WatchSource:0}: Error finding container 601c0414419c03fb87701f6cec72d4adb2072921481d19445a8091e296062e29: Status 404 returned error can't find the container with id 601c0414419c03fb87701f6cec72d4adb2072921481d19445a8091e296062e29 Jul 02 15:47:10.450835 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.450757 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe76034_ddd9_4202_aff1_b9cb5b7685f1.slice/crio-d8561287e7368e661bca5f6d20b1002700624d2a0e7842b64352a3389a7837f2 WatchSource:0}: Error finding container d8561287e7368e661bca5f6d20b1002700624d2a0e7842b64352a3389a7837f2: Status 404 returned error can't find the container with id d8561287e7368e661bca5f6d20b1002700624d2a0e7842b64352a3389a7837f2 Jul 02 15:47:10.451550 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.451527 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1617fa55_96af_468c_90ee_53e97764869d.slice/crio-28965d0cf5aeebf1b43d2ab706ea31892c6d97a8f784bbaaa29deb2881a1f268 WatchSource:0}: Error finding container 28965d0cf5aeebf1b43d2ab706ea31892c6d97a8f784bbaaa29deb2881a1f268: Status 404 returned error can't find the container with id 28965d0cf5aeebf1b43d2ab706ea31892c6d97a8f784bbaaa29deb2881a1f268 Jul 02 15:47:10.452773 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.452746 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02289b2_fe5c_450f_85a6_af56ab0b7fd4.slice/crio-caa669f17fcc4707bc02c49bcff970a9f0244f59d07c2288192ecc745a65cb94 WatchSource:0}: Error finding container caa669f17fcc4707bc02c49bcff970a9f0244f59d07c2288192ecc745a65cb94: Status 404 returned error can't find the container with id caa669f17fcc4707bc02c49bcff970a9f0244f59d07c2288192ecc745a65cb94 Jul 02 15:47:10.453621 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.453599 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077692ea_c0ac_462e_b55d_bb7717b8b74e.slice/crio-529ba3f8f55d226bf9ce865cf5c592e58b1ff797874562b608888baa2bf857ff WatchSource:0}: Error finding container 529ba3f8f55d226bf9ce865cf5c592e58b1ff797874562b608888baa2bf857ff: Status 404 returned error can't find the container with id 529ba3f8f55d226bf9ce865cf5c592e58b1ff797874562b608888baa2bf857ff Jul 02 15:47:10.455097 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:10.454813 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61bd2c1_52c5_4e2e_a3fe_ea075a1bb5f7.slice/crio-dde47c7febaedbca58e13a6e828bfb0ef71ffa7a5a9f0213f77533f83532793a WatchSource:0}: Error finding container dde47c7febaedbca58e13a6e828bfb0ef71ffa7a5a9f0213f77533f83532793a: Status 404 returned error can't find the container with id dde47c7febaedbca58e13a6e828bfb0ef71ffa7a5a9f0213f77533f83532793a Jul 02 15:47:10.559888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.559781 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:10.559888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.559855 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:10.559888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.559885 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.559893 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.559968 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.559974 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:11.559952752 +0000 UTC m=+4.184586908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.560006 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:11.559996397 +0000 UTC m=+4.184630534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.560050 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.560079 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.560094 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:10.560170 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:10.560156 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:11.560138116 +0000 UTC m=+4.184772253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:10.891462 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.891381 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:42:08 +0000 UTC" deadline="2027-12-16 06:23:12.145718837 +0000 UTC" Jul 02 15:47:10.891462 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.891437 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12758h36m1.254284399s" Jul 02 15:47:10.946682 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.946636 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerStarted","Data":"d8b2b2aa01faba89c157d4f386e8ae007c86e51917fc6ae6864b45b4aba5313e"} Jul 02 15:47:10.947881 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.947842 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" event={"ID":"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7","Type":"ContainerStarted","Data":"dde47c7febaedbca58e13a6e828bfb0ef71ffa7a5a9f0213f77533f83532793a"} Jul 02 15:47:10.948974 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.948952 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxjcb" event={"ID":"7a0d76ac-9d58-4558-8419-e8c608fb3b61","Type":"ContainerStarted","Data":"601c0414419c03fb87701f6cec72d4adb2072921481d19445a8091e296062e29"} Jul 02 15:47:10.950004 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.949979 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvsdx" event={"ID":"1617fa55-96af-468c-90ee-53e97764869d","Type":"ContainerStarted","Data":"28965d0cf5aeebf1b43d2ab706ea31892c6d97a8f784bbaaa29deb2881a1f268"} Jul 02 15:47:10.951090 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.951065 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerStarted","Data":"2b06f254a07c3cb6f6d81a3099353dc1a10fb7a5c8ee095fef0a927afcd5d5ab"} Jul 02 15:47:10.952219 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.952194 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mf7b7" event={"ID":"077692ea-c0ac-462e-b55d-bb7717b8b74e","Type":"ContainerStarted","Data":"529ba3f8f55d226bf9ce865cf5c592e58b1ff797874562b608888baa2bf857ff"} Jul 02 15:47:10.953289 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.953263 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6w7f7" event={"ID":"d02289b2-fe5c-450f-85a6-af56ab0b7fd4","Type":"ContainerStarted","Data":"caa669f17fcc4707bc02c49bcff970a9f0244f59d07c2288192ecc745a65cb94"} Jul 02 15:47:10.954369 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.954346 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7w29" event={"ID":"abe76034-ddd9-4202-aff1-b9cb5b7685f1","Type":"ContainerStarted","Data":"d8561287e7368e661bca5f6d20b1002700624d2a0e7842b64352a3389a7837f2"} Jul 02 15:47:10.955385 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.955360 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"1e6292c06284b3c692dd0932fae2ad2f3869a5988fd270e169b8f9c4205f0ff1"} Jul 02 15:47:10.956504 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:10.956486 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" event={"ID":"ef37b213-8d7b-45b5-84ba-2f62cea9be93","Type":"ContainerStarted","Data":"d1091336a19e3edfb511499f35697d4a41fcb00ca2dbf4e849b13efe2a4f2354"} Jul 02 15:47:11.568563 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.568510 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:11.568750 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.568587 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:11.568750 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.568618 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:11.568750 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568674 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:11.568750 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568742 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:11.568750 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568753 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:13.568729558 +0000 UTC m=+6.193363710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:11.569026 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568803 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:13.568786895 +0000 UTC m=+6.193421035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:11.569026 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568897 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:11.569026 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568918 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:11.569026 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568932 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:11.569026 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.568975 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:13.56896065 +0000 UTC m=+6.193594787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:11.928500 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.927317 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:11.928500 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.927909 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:11.928500 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.927911 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:11.928500 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.928086 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:11.928500 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.928172 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:11.931756 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:11.931665 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:11.970265 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.969156 2571 generic.go:356] "Generic (PLEG): container finished" podID="bdda60bf425dadd7b86ec2242e37edb6" containerID="d8b2b2aa01faba89c157d4f386e8ae007c86e51917fc6ae6864b45b4aba5313e" exitCode=0 Jul 02 15:47:11.970265 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.969289 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerDied","Data":"d8b2b2aa01faba89c157d4f386e8ae007c86e51917fc6ae6864b45b4aba5313e"} Jul 02 15:47:11.976100 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:11.975621 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" event={"ID":"ff8112a09a92e79e1fba8f9541e6f8d7","Type":"ContainerStarted","Data":"1051289027e03c238077b9e7e33ebe9b3538b6117501c813cb1949c8b2005d39"} Jul 02 15:47:12.014506 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:12.009602 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-121.ec2.internal" podStartSLOduration=4.009577597 podStartE2EDuration="4.009577597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:12.004337616 +0000 UTC m=+4.628971773" watchObservedRunningTime="2026-07-02 15:47:12.009577597 +0000 UTC m=+4.634211758" Jul 02 15:47:13.012689 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.012632 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" event={"ID":"bdda60bf425dadd7b86ec2242e37edb6","Type":"ContainerStarted","Data":"3f8ed06898489a9bc443668e9efcf460c400d30cd06729fb4491e775dfd3734f"} Jul 02 15:47:13.587941 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.587894 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:13.588138 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.587967 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:13.588138 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.587999 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:13.588241 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588147 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:13.588241 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588217 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:17.588197763 +0000 UTC m=+10.212831903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:13.588686 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588662 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:13.588776 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588727 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:17.588710045 +0000 UTC m=+10.213344185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:13.588836 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588809 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:13.588836 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588828 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:13.588895 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588841 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:13.588895 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.588876 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:17.588865267 +0000 UTC m=+10.213499407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:13.925140 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.924304 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:13.925140 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.924463 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:13.925140 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.924901 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:13.925140 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.925008 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:13.925774 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:13.925575 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:13.925774 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:13.925689 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:15.925643 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:15.924818 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:15.925643 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:15.924981 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:15.925643 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:15.925472 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:15.925643 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:15.925584 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:15.926631 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:15.926425 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:15.926631 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:15.926580 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:17.625510 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:17.625463 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:17.625992 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:17.625539 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:17.625992 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:17.625560 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:17.625992 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.625694 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:17.625992 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.625757 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:25.625738794 +0000 UTC m=+18.250372934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:17.626270 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.626181 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:17.626270 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.626236 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:25.626220948 +0000 UTC m=+18.250855101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:17.626343 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.626318 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:17.626343 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.626337 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:17.626437 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.626349 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:17.626437 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.626386 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:25.626375173 +0000 UTC m=+18.251009311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:17.926352 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:17.925832 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:17.926352 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.925947 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:17.926352 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:17.926217 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:17.926648 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.926354 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:17.926648 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:17.926392 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:17.926648 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:17.926496 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:19.924347 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:19.924307 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:19.924833 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:19.924307 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:19.924833 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:19.924435 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:19.924833 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:19.924542 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:19.924833 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:19.924323 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:19.924833 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:19.924652 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:21.923838 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:21.923747 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:21.924298 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:21.923757 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:21.924298 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:21.923886 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:21.924298 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:21.923758 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:21.924298 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:21.923982 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:21.924298 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:21.924059 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:23.923892 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:23.923844 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:23.924411 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:23.923844 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:23.924411 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:23.924012 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:23.924411 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:23.924071 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:23.924411 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:23.923861 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:23.924411 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:23.924175 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:25.689271 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:25.689223 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:25.689320 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:25.689374 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689404 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689474 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689489 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:41.689468276 +0000 UTC m=+34.314102431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689513 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689528 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689530 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:41.689516358 +0000 UTC m=+34.314150493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689539 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:25.689772 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.689584 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:41.689572977 +0000 UTC m=+34.314207114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:25.923965 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:25.923922 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:25.924130 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:25.923977 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:25.924130 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:25.923922 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:25.924130 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.924095 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:25.924262 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.924200 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:25.924305 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:25.924289 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:27.924743 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:27.924704 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:27.925293 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:27.924834 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:27.925293 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:27.924865 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:27.925293 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:27.924892 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:27.925293 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:27.924996 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:27.925293 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:27.925135 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:29.924208 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:29.924164 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:29.924674 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:29.924180 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:29.924674 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:29.924289 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:29.924674 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:29.924361 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:29.924674 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:29.924180 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:29.924674 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:29.924503 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:31.053633 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.053021 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" event={"ID":"a61bd2c1-52c5-4e2e-a3fe-ea075a1bb5f7","Type":"ContainerStarted","Data":"35247ff8dddb8112677e429c602062f70cb312cdf37bda9f3762b8f86347005a"} Jul 02 15:47:31.054780 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.054745 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxjcb" event={"ID":"7a0d76ac-9d58-4558-8419-e8c608fb3b61","Type":"ContainerStarted","Data":"e654c08f6437c2a926278676620ab3ebd5c40287acfb4f6180a15e6de5acd772"} Jul 02 15:47:31.056692 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.056627 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvsdx" event={"ID":"1617fa55-96af-468c-90ee-53e97764869d","Type":"ContainerStarted","Data":"7ac3381b9056f510b8549685e82fd870ed0ce77cf50e3798bad66b474f53bc95"} Jul 02 15:47:31.062238 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.062190 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d91359e-696a-44b1-aa72-242bbc989802" containerID="8d9fb85299f35d17ee8ab6d768d28895f9dc293d68cb72753be8e7c335a6a50d" exitCode=0 Jul 02 15:47:31.062543 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.062276 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerDied","Data":"8d9fb85299f35d17ee8ab6d768d28895f9dc293d68cb72753be8e7c335a6a50d"} Jul 02 15:47:31.064276 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.064238 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mf7b7" event={"ID":"077692ea-c0ac-462e-b55d-bb7717b8b74e","Type":"ContainerStarted","Data":"5a1f4dab68aa968a96a268bc09d6975eee7acafaf5d9ff7b85321db0c74e2f2f"} Jul 02 15:47:31.066091 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.066050 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7w29" event={"ID":"abe76034-ddd9-4202-aff1-b9cb5b7685f1","Type":"ContainerStarted","Data":"16d6ab87fca14a6004959f1f67d72fd40b1de725c47e37b189424f05653c16e1"} Jul 02 15:47:31.069568 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.069526 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"bcda2fab90a01e3fa5b8e076c0edb320910cd3b00851034bd9ab3dbc949113fd"} Jul 02 15:47:31.069733 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.069625 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"7ab4e0002f75d59872c208a9d37d197fc72ac92a66f276b79c9d9ea0fddaa0bd"} Jul 02 15:47:31.069733 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.069660 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"a894c09654b9e847f6dd644a887d9e9fbbcf9151a5124adf16729bfa79f956a1"} Jul 02 15:47:31.069733 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.069692 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"624b93c460e4257a00371733a9f75d4dd365f5a4729d2758144f75526016315e"} Jul 02 15:47:31.069733 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.069725 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"747b34fd7e03bcef69e829eb0739348cb659c8c99fdc390ce558fcb8765b4ae0"} Jul 02 15:47:31.069903 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.069757 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"44cecc0ec910dce72d7282845a67df3b457b54a62e5f31d0719e52fd646b5dcb"} Jul 02 15:47:31.071095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.071058 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" event={"ID":"ef37b213-8d7b-45b5-84ba-2f62cea9be93","Type":"ContainerStarted","Data":"2a9291e838b64c348ff03fb7dd7043e022559d68bc06ac106bb5d8cf8a31e24d"} Jul 02 15:47:31.074408 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.074351 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-121.ec2.internal" podStartSLOduration=23.074334049 podStartE2EDuration="23.074334049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:13.0280056 +0000 UTC m=+5.652639760" watchObservedRunningTime="2026-07-02 15:47:31.074334049 +0000 UTC m=+23.698968206" Jul 02 15:47:31.074674 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.074651 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gtc5m" podStartSLOduration=3.530229678 podStartE2EDuration="23.074645104s" totalImagesPullingTime="19.544415426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:31.074228232 +0000 UTC m=+23.698862412" watchObservedRunningTime="2026-07-02 15:47:31.074645104 +0000 UTC m=+23.699279262" Jul 02 15:47:31.099902 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.099833 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xvsdx" podStartSLOduration=3.354304399 podStartE2EDuration="23.099811114s" totalImagesPullingTime="19.745506715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:31.09955211 +0000 UTC m=+23.724186281" watchObservedRunningTime="2026-07-02 15:47:31.099811114 +0000 UTC m=+23.724445317" Jul 02 15:47:31.131526 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.131436 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7w29" podStartSLOduration=3.588102574 podStartE2EDuration="23.13141865s" totalImagesPullingTime="19.543316076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:31.131146704 +0000 UTC m=+23.755780879" watchObservedRunningTime="2026-07-02 15:47:31.13141865 +0000 UTC m=+23.756052808" Jul 02 15:47:31.149590 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.149522 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cxjcb" podStartSLOduration=8.439326446 podStartE2EDuration="23.149500174s" totalImagesPullingTime="14.710173728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:31.149228014 +0000 UTC m=+23.773862186" watchObservedRunningTime="2026-07-02 15:47:31.149500174 +0000 UTC m=+23.774134332" Jul 02 15:47:31.205408 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.205339 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mf7b7" podStartSLOduration=3.662575876 podStartE2EDuration="23.205316432s" totalImagesPullingTime="19.542740556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:31.172810014 +0000 UTC m=+23.797444169" watchObservedRunningTime="2026-07-02 15:47:31.205316432 +0000 UTC m=+23.829950689" Jul 02 15:47:31.715504 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.715469 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 15:47:31.913685 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.913475 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T15:47:31.715496205Z","UUID":"016d6de8-b2e0-481c-b912-026e3d0f77c0","Handler":null,"Name":"","Endpoint":""} Jul 02 15:47:31.916873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.916840 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 15:47:31.917034 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.916896 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 15:47:31.924097 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.924063 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:31.924097 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.924086 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:31.924097 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:31.924063 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:31.924418 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:31.924231 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:31.924656 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:31.924615 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:31.924797 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:31.924731 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:32.076429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:32.076339 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" event={"ID":"ef37b213-8d7b-45b5-84ba-2f62cea9be93","Type":"ContainerStarted","Data":"687060443a065af9fd2d6858df08cff543aedc55afd574e788228b9f471ed589"} Jul 02 15:47:32.078215 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:32.078171 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6w7f7" event={"ID":"d02289b2-fe5c-450f-85a6-af56ab0b7fd4","Type":"ContainerStarted","Data":"dfdb40d29de3f76674c722bf298ba6a24114b9fd7f6ec92526d7c7244bc23027"} Jul 02 15:47:32.093733 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:32.093671 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6w7f7" podStartSLOduration=4.550273638 podStartE2EDuration="24.093652273s" totalImagesPullingTime="19.543378635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:32.093585825 +0000 UTC m=+24.718219984" watchObservedRunningTime="2026-07-02 15:47:32.093652273 +0000 UTC m=+24.718286479" Jul 02 15:47:33.923866 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:33.923828 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:33.924272 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:33.923833 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:33.924272 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:33.923944 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:33.924272 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:33.924020 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:33.924272 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:33.923833 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:33.924272 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:33.924103 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:34.086832 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:34.086789 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"42ab45b24ae008ba4683263f7072879cf86043e53f3f751f16932f6553e44f6a"} Jul 02 15:47:34.089016 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:34.088982 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" event={"ID":"ef37b213-8d7b-45b5-84ba-2f62cea9be93","Type":"ContainerStarted","Data":"53e3d413c45325b1003fdc03d894a83e3c06c570c22989b15a4a578add35b7aa"} Jul 02 15:47:34.113164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:34.113108 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh7nq" podStartSLOduration=3.79588086 podStartE2EDuration="26.113090872s" totalImagesPullingTime="22.317210012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:34.112705053 +0000 UTC m=+26.737339212" watchObservedRunningTime="2026-07-02 15:47:34.113090872 +0000 UTC m=+26.737725030" Jul 02 15:47:35.119306 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:35.119079 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:35.119852 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:35.119698 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:35.924109 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:35.924070 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:35.924309 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:35.924070 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:35.924309 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:35.924226 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:35.924309 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:35.924077 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:35.924486 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:35.924319 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:35.924486 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:35.924356 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:36.098889 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.098606 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" event={"ID":"0d4571b5-a9a3-4a52-89be-fb924dbf680d","Type":"ContainerStarted","Data":"e0e6dcae4037c159a43338b61a37f9b3590987458c5c3483ebc4e4af2a313927"} Jul 02 15:47:36.099070 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.098958 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:36.099070 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.099012 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:36.099070 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.099058 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:36.100853 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.100813 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerStarted","Data":"8492b6a37e58005a03407afe98a11f350646b8994eb74c2cc7d914c593102bfb"} Jul 02 15:47:36.101175 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.101149 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:36.101704 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.101682 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cxjcb" Jul 02 15:47:36.114944 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.114916 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:36.115076 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.115023 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:47:36.156586 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:36.156530 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" podStartSLOduration=8.560963979 podStartE2EDuration="28.15651232s" totalImagesPullingTime="19.595548341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:36.129921397 +0000 UTC m=+28.754555576" watchObservedRunningTime="2026-07-02 15:47:36.15651232 +0000 UTC m=+28.781146478" Jul 02 15:47:37.104945 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.104904 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d91359e-696a-44b1-aa72-242bbc989802" containerID="8492b6a37e58005a03407afe98a11f350646b8994eb74c2cc7d914c593102bfb" exitCode=0 Jul 02 15:47:37.105253 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.105027 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerDied","Data":"8492b6a37e58005a03407afe98a11f350646b8994eb74c2cc7d914c593102bfb"} Jul 02 15:47:37.804499 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.804459 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wjzr"] Jul 02 15:47:37.804938 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.804650 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:37.804938 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:37.804786 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:37.808084 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.808054 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wh5p"] Jul 02 15:47:37.808229 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.808174 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:37.808290 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:37.808269 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:37.811779 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.811747 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v9s2j"] Jul 02 15:47:37.811906 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:37.811887 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:37.812014 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:37.811993 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:39.112517 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:39.112482 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d91359e-696a-44b1-aa72-242bbc989802" containerID="556a47994df46dc9ee873af8878d12e501a83a7051b22f06ee97656d50594825" exitCode=0 Jul 02 15:47:39.113029 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:39.112556 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerDied","Data":"556a47994df46dc9ee873af8878d12e501a83a7051b22f06ee97656d50594825"} Jul 02 15:47:39.928006 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:39.927974 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:39.928165 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:39.927990 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:39.928165 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:39.928103 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:39.928165 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:39.928137 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:39.928264 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:39.928184 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:39.928264 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:39.928243 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:41.120069 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.120031 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d91359e-696a-44b1-aa72-242bbc989802" containerID="2ff899709456836fd0c6839a7663011e17d66a0a30ec2402194aa8bd5a1183e6" exitCode=0 Jul 02 15:47:41.120511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.120095 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerDied","Data":"2ff899709456836fd0c6839a7663011e17d66a0a30ec2402194aa8bd5a1183e6"} Jul 02 15:47:41.714282 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.714249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:41.714481 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.714293 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:41.714481 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.714317 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:41.714481 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714416 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:41.714481 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714474 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:47:41.714629 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714491 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret podName:cfb1f722-afe7-4bb4-ae0a-8774a8a1c787 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:13.714474799 +0000 UTC m=+66.339108947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret") pod "global-pull-secret-syncer-7wjzr" (UID: "cfb1f722-afe7-4bb4-ae0a-8774a8a1c787") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:47:41.714629 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714501 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:47:41.714629 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714514 2571 projected.go:196] Error preparing data for projected volume kube-api-access-7dtf9 for pod openshift-network-diagnostics/network-check-target-v9s2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:41.714629 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714479 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:41.714629 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714560 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9 podName:60054f48-cca0-4055-8fc7-c67f24ab5451 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:13.714544472 +0000 UTC m=+66.339178627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dtf9" (UniqueName: "kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9") pod "network-check-target-v9s2j" (UID: "60054f48-cca0-4055-8fc7-c67f24ab5451") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:47:41.714629 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.714586 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:13.714570684 +0000 UTC m=+66.339204833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:47:41.927286 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.927255 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:41.927482 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.927384 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:41.927482 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.927391 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:41.927482 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:41.927416 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:41.927691 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.927514 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:41.927691 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:41.927627 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:43.924300 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:43.924201 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:43.924300 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:43.924227 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:43.924979 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:43.924356 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v9s2j" podUID="60054f48-cca0-4055-8fc7-c67f24ab5451" Jul 02 15:47:43.924979 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:43.924400 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wjzr" podUID="cfb1f722-afe7-4bb4-ae0a-8774a8a1c787" Jul 02 15:47:43.924979 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:43.924475 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:43.924979 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:43.924573 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wh5p" podUID="51cccf36-504c-42d9-85ef-8ce5a4d7b270" Jul 02 15:47:44.114979 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.114945 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-121.ec2.internal" event="NodeReady" Jul 02 15:47:44.115159 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.115100 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 15:47:44.149366 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.149326 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5997744fd7-clbjq"] Jul 02 15:47:44.153533 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.153493 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.158038 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.157909 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 15:47:44.158227 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.158073 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 15:47:44.158227 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.158211 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7gxs\"" Jul 02 15:47:44.158391 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.158369 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 15:47:44.162814 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.162225 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dsnbr"] Jul 02 15:47:44.166659 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.166628 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.167031 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.167002 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 15:47:44.169776 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.169267 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5997744fd7-clbjq"] Jul 02 15:47:44.169776 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.169552 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z549g\"" Jul 02 15:47:44.170027 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.170006 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 15:47:44.170240 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.170220 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 15:47:44.170436 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.170405 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jls4l"] Jul 02 15:47:44.174011 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.173982 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.177026 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.176710 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bw624\"" Jul 02 15:47:44.177026 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.177018 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 15:47:44.177434 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.177266 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 15:47:44.177852 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.177506 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 15:47:44.177852 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.177553 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dsnbr"] Jul 02 15:47:44.184308 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.184237 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jls4l"] Jul 02 15:47:44.234388 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234318 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-trusted-ca\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234388 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234381 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-installation-pull-secrets\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234673 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234484 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234673 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234523 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmbl\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-kube-api-access-xmmbl\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234673 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234627 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-certificates\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234673 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234667 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cbf7866-66cd-4357-83fe-bd5e45915ea8-ca-trust-extracted\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234890 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234698 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-image-registry-private-configuration\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.234890 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.234719 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-bound-sa-token\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336138 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336083 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.336138 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336135 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-tmp-dir\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336180 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-certificates\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336211 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-przz6\" (UniqueName: \"kubernetes.io/projected/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-kube-api-access-przz6\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336240 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cbf7866-66cd-4357-83fe-bd5e45915ea8-ca-trust-extracted\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336272 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-image-registry-private-configuration\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336299 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7874c5a3-0fcc-4012-bc54-38d00cdeff73-cert\") pod \"ingress-canary-jls4l\" (UID: \"7874c5a3-0fcc-4012-bc54-38d00cdeff73\") " pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336351 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-bound-sa-token\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336373 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-config-volume\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.336429 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336426 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-trusted-ca\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336470 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-installation-pull-secrets\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336498 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72pgj\" (UniqueName: \"kubernetes.io/projected/7874c5a3-0fcc-4012-bc54-38d00cdeff73-kube-api-access-72pgj\") pod \"ingress-canary-jls4l\" (UID: \"7874c5a3-0fcc-4012-bc54-38d00cdeff73\") " pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.336888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336543 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336571 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmbl\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-kube-api-access-xmmbl\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336888 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336778 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cbf7866-66cd-4357-83fe-bd5e45915ea8-ca-trust-extracted\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.336888 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.336886 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:47:44.337164 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.336913 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:47:44.337164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.336971 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-certificates\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.337164 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.336981 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:44.836961241 +0000 UTC m=+37.461595376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:47:44.337385 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.337361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-trusted-ca\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.342185 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.342150 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-image-registry-private-configuration\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.342381 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.342150 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-installation-pull-secrets\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.357670 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.357626 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-bound-sa-token\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.357853 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.357732 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmbl\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-kube-api-access-xmmbl\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.437715 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.437611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-config-volume\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.437715 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.437676 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72pgj\" (UniqueName: \"kubernetes.io/projected/7874c5a3-0fcc-4012-bc54-38d00cdeff73-kube-api-access-72pgj\") pod \"ingress-canary-jls4l\" (UID: \"7874c5a3-0fcc-4012-bc54-38d00cdeff73\") " pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.437963 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.437767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.437963 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.437793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-tmp-dir\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.437963 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.437826 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-przz6\" (UniqueName: \"kubernetes.io/projected/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-kube-api-access-przz6\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.437963 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.437861 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7874c5a3-0fcc-4012-bc54-38d00cdeff73-cert\") pod \"ingress-canary-jls4l\" (UID: \"7874c5a3-0fcc-4012-bc54-38d00cdeff73\") " pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.437963 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.437926 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:47:44.438203 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.437997 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:44.93797625 +0000 UTC m=+37.562610403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:47:44.438387 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.438350 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-config-volume\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.438521 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.438353 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-tmp-dir\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.440965 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.440926 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7874c5a3-0fcc-4012-bc54-38d00cdeff73-cert\") pod \"ingress-canary-jls4l\" (UID: \"7874c5a3-0fcc-4012-bc54-38d00cdeff73\") " pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.448248 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.448211 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-przz6\" (UniqueName: \"kubernetes.io/projected/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-kube-api-access-przz6\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.448423 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.448293 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72pgj\" (UniqueName: \"kubernetes.io/projected/7874c5a3-0fcc-4012-bc54-38d00cdeff73-kube-api-access-72pgj\") pod \"ingress-canary-jls4l\" (UID: \"7874c5a3-0fcc-4012-bc54-38d00cdeff73\") " pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.487549 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.487472 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jls4l" Jul 02 15:47:44.562192 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.562141 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:44.841594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.841472 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:44.841771 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.841643 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:47:44.841771 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.841667 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:47:44.841771 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.841730 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:45.841713749 +0000 UTC m=+38.466347896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:47:44.942894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:44.942844 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:44.943566 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.943019 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:47:44.943566 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:44.943123 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:45.943099903 +0000 UTC m=+38.567734044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:47:45.821115 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.820853 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jls4l"] Jul 02 15:47:45.825515 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:47:45.825417 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7874c5a3_0fcc_4012_bc54_38d00cdeff73.slice/crio-b803b5dfe0a1540c4ed84cc6adf564957b7d4046300d650822e2352b3ab65a4c WatchSource:0}: Error finding container b803b5dfe0a1540c4ed84cc6adf564957b7d4046300d650822e2352b3ab65a4c: Status 404 returned error can't find the container with id b803b5dfe0a1540c4ed84cc6adf564957b7d4046300d650822e2352b3ab65a4c Jul 02 15:47:45.851428 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.851398 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:45.851624 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:45.851602 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:47:45.851696 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:45.851628 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:47:45.851696 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:45.851691 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:47.851674579 +0000 UTC m=+40.476308719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:47:45.928462 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.928313 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:47:45.928462 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.928314 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:47:45.928698 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.928314 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:47:45.932601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.932354 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:47:45.932601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.932393 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:47:45.932601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.932410 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:47:45.932601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.932462 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:47:45.932601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.932473 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtlwt\"" Jul 02 15:47:45.932601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.932355 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hs2qc\"" Jul 02 15:47:45.952706 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:45.952667 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:45.953197 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:45.952860 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:47:45.953197 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:45.952947 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:47.952922036 +0000 UTC m=+40.577556172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:47:46.133598 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:46.133556 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jls4l" event={"ID":"7874c5a3-0fcc-4012-bc54-38d00cdeff73","Type":"ContainerStarted","Data":"b803b5dfe0a1540c4ed84cc6adf564957b7d4046300d650822e2352b3ab65a4c"} Jul 02 15:47:46.136647 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:46.136613 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d91359e-696a-44b1-aa72-242bbc989802" containerID="312b2160c31b2c1148ed02d784516c451ee1ce9c221615ee03a25f1082c9af0c" exitCode=0 Jul 02 15:47:46.136835 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:46.136662 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerDied","Data":"312b2160c31b2c1148ed02d784516c451ee1ce9c221615ee03a25f1082c9af0c"} Jul 02 15:47:46.795700 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:46.795656 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:46.895044 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:46.895008 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:47.143003 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.142906 2571 generic.go:356] "Generic (PLEG): container finished" podID="5d91359e-696a-44b1-aa72-242bbc989802" containerID="b94a1425b1e9d79194962004d000cfeac0e7e965f69b8ec42c68d21e7a9e6425" exitCode=0 Jul 02 15:47:47.143598 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.142997 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerDied","Data":"b94a1425b1e9d79194962004d000cfeac0e7e965f69b8ec42c68d21e7a9e6425"} Jul 02 15:47:47.177052 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.176117 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:47.270296 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.270247 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:47.371401 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.371361 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:47.873290 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.873238 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:47.873531 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:47.873392 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:47:47.873531 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:47.873414 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:47:47.873531 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:47.873501 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:51.87348388 +0000 UTC m=+44.498118019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:47:47.973843 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:47.973807 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:47.974047 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:47.973967 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:47:47.974112 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:47.974047 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:51.974025237 +0000 UTC m=+44.598659374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:47:48.149433 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:48.149327 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" event={"ID":"5d91359e-696a-44b1-aa72-242bbc989802","Type":"ContainerStarted","Data":"a5edcf47ff4052d9a3c24e62f74ac263f5b7c630c99189a97e2dc7d62e613f65"} Jul 02 15:47:48.173778 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:48.173693 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vtnq7" podStartSLOduration=9.043139978 podStartE2EDuration="40.173669593s" totalImagesPullingTime="31.130529615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:48.172920766 +0000 UTC m=+40.797554925" watchObservedRunningTime="2026-07-02 15:47:48.173669593 +0000 UTC m=+40.798303752" Jul 02 15:47:48.412476 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:48.412353 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:48.476788 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:48.476749 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:50.155682 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:50.155643 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jls4l" event={"ID":"7874c5a3-0fcc-4012-bc54-38d00cdeff73","Type":"ContainerStarted","Data":"aebd1f2d4ff0e02dad817aab746e5d6f9d6616f9eca878b226c1dfb8bd7f942c"} Jul 02 15:47:50.205485 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:50.205406 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jls4l" podStartSLOduration=2.840417496 podStartE2EDuration="6.205388931s" totalImagesPullingTime="3.364971435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:47:50.204762732 +0000 UTC m=+42.829396910" watchObservedRunningTime="2026-07-02 15:47:50.205388931 +0000 UTC m=+42.830023087" Jul 02 15:47:51.905784 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:51.905735 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:51.906205 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:51.905897 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:47:51.906205 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:51.905920 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:47:51.906205 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:51.906014 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:47:59.90599618 +0000 UTC m=+52.530630319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:47:52.006914 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:52.006850 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:47:52.007107 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:52.006993 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:47:52.007107 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:52.007079 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:00.00705781 +0000 UTC m=+52.631691964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:47:56.337740 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:56.337690 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:56.437624 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:56.437575 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:47:59.965833 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:47:59.965788 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:47:59.966252 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:59.965948 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:47:59.966252 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:59.965967 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:47:59.966252 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:47:59.966056 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:15.966036916 +0000 UTC m=+68.590671055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:48:00.066871 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:00.066832 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:48:00.067038 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:00.066960 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:48:00.067038 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:00.067011 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:16.066996534 +0000 UTC m=+68.691630669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:48:03.909281 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:03.909237 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:48:04.011554 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:04.011498 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:48:04.112554 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:04.112500 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" limit=1024 Jul 02 15:48:08.124291 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:08.124236 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kmq5" Jul 02 15:48:13.772896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.772849 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:48:13.773397 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.772908 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:48:13.773397 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.772928 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:48:13.776097 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.776073 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:48:13.776175 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.776157 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:48:13.776215 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.776157 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:48:13.783614 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:13.783577 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 15:48:13.783769 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:13.783686 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs podName:51cccf36-504c-42d9-85ef-8ce5a4d7b270 nodeName:}" failed. No retries permitted until 2026-07-02 15:49:17.78365879 +0000 UTC m=+130.408292942 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs") pod "network-metrics-daemon-2wh5p" (UID: "51cccf36-504c-42d9-85ef-8ce5a4d7b270") : secret "metrics-daemon-secret" not found Jul 02 15:48:13.785824 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.785804 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:48:13.787591 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.787567 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfb1f722-afe7-4bb4-ae0a-8774a8a1c787-original-pull-secret\") pod \"global-pull-secret-syncer-7wjzr\" (UID: \"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787\") " pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:48:13.814786 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.814747 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dtf9\" (UniqueName: \"kubernetes.io/projected/60054f48-cca0-4055-8fc7-c67f24ab5451-kube-api-access-7dtf9\") pod \"network-check-target-v9s2j\" (UID: \"60054f48-cca0-4055-8fc7-c67f24ab5451\") " pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:48:13.842514 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.842471 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wjzr" Jul 02 15:48:13.910631 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.910484 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hs2qc\"" Jul 02 15:48:13.917680 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.917641 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:48:13.979976 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:13.979926 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wjzr"] Jul 02 15:48:14.055481 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:14.055413 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v9s2j"] Jul 02 15:48:14.059190 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:14.059156 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60054f48_cca0_4055_8fc7_c67f24ab5451.slice/crio-39102c33df0281de34d24981bb70c260e73d6a2b9dab8c2575d59860fe3ea70a WatchSource:0}: Error finding container 39102c33df0281de34d24981bb70c260e73d6a2b9dab8c2575d59860fe3ea70a: Status 404 returned error can't find the container with id 39102c33df0281de34d24981bb70c260e73d6a2b9dab8c2575d59860fe3ea70a Jul 02 15:48:14.215794 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:14.215743 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v9s2j" event={"ID":"60054f48-cca0-4055-8fc7-c67f24ab5451","Type":"ContainerStarted","Data":"39102c33df0281de34d24981bb70c260e73d6a2b9dab8c2575d59860fe3ea70a"} Jul 02 15:48:14.216947 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:14.216916 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wjzr" event={"ID":"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787","Type":"ContainerStarted","Data":"84ac1cd047f4a89f1feae32aba02acecb468183d16714defcc2afea2dae6645b"} Jul 02 15:48:15.991159 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:15.991115 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:48:15.991634 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:15.991302 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:48:15.991634 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:15.991325 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5997744fd7-clbjq: secret "image-registry-tls" not found Jul 02 15:48:15.991634 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:15.991395 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls podName:0cbf7866-66cd-4357-83fe-bd5e45915ea8 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:47.991372757 +0000 UTC m=+100.616006916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls") pod "image-registry-5997744fd7-clbjq" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8") : secret "image-registry-tls" not found Jul 02 15:48:16.091879 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:16.091769 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:48:16.092073 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:16.091907 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:48:16.092073 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:16.091974 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls podName:20d07dcc-2cb8-4850-8bc2-8fb9aa72c488 nodeName:}" failed. No retries permitted until 2026-07-02 15:48:48.091953372 +0000 UTC m=+100.716587508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls") pod "dns-default-dsnbr" (UID: "20d07dcc-2cb8-4850-8bc2-8fb9aa72c488") : secret "dns-default-metrics-tls" not found Jul 02 15:48:17.227793 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:17.227743 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v9s2j" event={"ID":"60054f48-cca0-4055-8fc7-c67f24ab5451","Type":"ContainerStarted","Data":"fb3a942d58711d2a7631b930b6db2bf54dffd77ba6857b9cb048f11809729e29"} Jul 02 15:48:17.228259 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:17.227888 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:48:17.250121 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:17.250066 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v9s2j" podStartSLOduration=66.154595368 podStartE2EDuration="1m9.250045806s" totalImagesPullingTime="3.095450438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:17.249684479 +0000 UTC m=+69.874318705" watchObservedRunningTime="2026-07-02 15:48:17.250045806 +0000 UTC m=+69.874679966" Jul 02 15:48:21.239477 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:21.239423 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wjzr" event={"ID":"cfb1f722-afe7-4bb4-ae0a-8774a8a1c787","Type":"ContainerStarted","Data":"189d793e1572130360565b4acf2b3bdb3c64863a0bb4150d89e6581912b16251"} Jul 02 15:48:21.266310 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:21.266255 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7wjzr" podStartSLOduration=67.002829884 podStartE2EDuration="1m13.266239096s" totalImagesPullingTime="6.263409212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:21.266235466 +0000 UTC m=+73.890869634" watchObservedRunningTime="2026-07-02 15:48:21.266239096 +0000 UTC m=+73.890873254" Jul 02 15:48:22.175297 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.175255 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj"] Jul 02 15:48:22.208416 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.208382 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-hd6k8"] Jul 02 15:48:22.208605 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.208511 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.211179 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.211153 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 15:48:22.211341 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.211194 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 15:48:22.211341 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.211210 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 15:48:22.211499 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.211367 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:48:22.211636 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.211615 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4qr8j\"" Jul 02 15:48:22.222332 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.222281 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj"] Jul 02 15:48:22.222332 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.222339 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-hd6k8"] Jul 02 15:48:22.222597 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.222416 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.225183 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.225119 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 15:48:22.225183 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.225133 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 15:48:22.225183 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.225144 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 15:48:22.225183 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.225170 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wbml4\"" Jul 02 15:48:22.225489 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.225119 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 15:48:22.229855 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.229830 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 15:48:22.282622 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.282587 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-668b98cdb9-29d86"] Jul 02 15:48:22.308378 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.308343 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-668b98cdb9-29d86"] Jul 02 15:48:22.308588 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.308510 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.311423 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311394 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 15:48:22.311604 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311498 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 15:48:22.311728 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311710 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-cpghg\"" Jul 02 15:48:22.311786 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311741 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 15:48:22.311786 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311753 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 15:48:22.311871 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311786 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 15:48:22.311871 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.311740 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 15:48:22.344087 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344051 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f60e27cd-c881-41a3-9a58-d0423aaff80f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.344087 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344090 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz2bd\" (UniqueName: \"kubernetes.io/projected/949b44bf-795b-45ea-beab-94f2d405933e-kube-api-access-fz2bd\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.344313 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344115 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/949b44bf-795b-45ea-beab-94f2d405933e-snapshots\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.344313 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344232 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/949b44bf-795b-45ea-beab-94f2d405933e-service-ca-bundle\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.344313 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344271 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949b44bf-795b-45ea-beab-94f2d405933e-tmp\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.344313 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344298 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpcl8\" (UniqueName: \"kubernetes.io/projected/f60e27cd-c881-41a3-9a58-d0423aaff80f-kube-api-access-qpcl8\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.344521 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344345 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/949b44bf-795b-45ea-beab-94f2d405933e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.344521 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344392 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/949b44bf-795b-45ea-beab-94f2d405933e-serving-cert\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.344521 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.344490 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f60e27cd-c881-41a3-9a58-d0423aaff80f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.444896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.444802 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f60e27cd-c881-41a3-9a58-d0423aaff80f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.444896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.444844 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.444896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.444862 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz2bd\" (UniqueName: \"kubernetes.io/projected/949b44bf-795b-45ea-beab-94f2d405933e-kube-api-access-fz2bd\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.444896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.444883 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/949b44bf-795b-45ea-beab-94f2d405933e-snapshots\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.444939 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/949b44bf-795b-45ea-beab-94f2d405933e-service-ca-bundle\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.444988 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/949b44bf-795b-45ea-beab-94f2d405933e-serving-cert\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445019 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445044 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f60e27cd-c881-41a3-9a58-d0423aaff80f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445060 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-stats-auth\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445095 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2zl\" (UniqueName: \"kubernetes.io/projected/7b856a5b-a8df-48dd-9578-c40e281f480e-kube-api-access-mp2zl\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445128 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949b44bf-795b-45ea-beab-94f2d405933e-tmp\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445157 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpcl8\" (UniqueName: \"kubernetes.io/projected/f60e27cd-c881-41a3-9a58-d0423aaff80f-kube-api-access-qpcl8\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/949b44bf-795b-45ea-beab-94f2d405933e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445225 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445219 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-default-certificate\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.445727 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445647 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949b44bf-795b-45ea-beab-94f2d405933e-tmp\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445727 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445663 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/949b44bf-795b-45ea-beab-94f2d405933e-service-ca-bundle\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445727 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/949b44bf-795b-45ea-beab-94f2d405933e-snapshots\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.445727 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.445704 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f60e27cd-c881-41a3-9a58-d0423aaff80f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.446603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.446581 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/949b44bf-795b-45ea-beab-94f2d405933e-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.447278 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.447250 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f60e27cd-c881-41a3-9a58-d0423aaff80f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.447576 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.447559 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/949b44bf-795b-45ea-beab-94f2d405933e-serving-cert\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.453774 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.453740 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpcl8\" (UniqueName: \"kubernetes.io/projected/f60e27cd-c881-41a3-9a58-d0423aaff80f-kube-api-access-qpcl8\") pod \"kube-storage-version-migrator-operator-79964ff6f9-c5lkj\" (UID: \"f60e27cd-c881-41a3-9a58-d0423aaff80f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.453918 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.453857 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz2bd\" (UniqueName: \"kubernetes.io/projected/949b44bf-795b-45ea-beab-94f2d405933e-kube-api-access-fz2bd\") pod \"insights-operator-5f67b55555-hd6k8\" (UID: \"949b44bf-795b-45ea-beab-94f2d405933e\") " pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.518022 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.517980 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" Jul 02 15:48:22.532531 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.532501 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" Jul 02 15:48:22.546201 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.546165 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.546354 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.546223 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-stats-auth\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.546354 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:22.546329 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:48:22.546457 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:22.546418 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:23.046398585 +0000 UTC m=+75.671032724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : secret "router-metrics-certs-default" not found Jul 02 15:48:22.546524 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.546478 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2zl\" (UniqueName: \"kubernetes.io/projected/7b856a5b-a8df-48dd-9578-c40e281f480e-kube-api-access-mp2zl\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.546524 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.546516 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-default-certificate\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.546613 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.546550 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.546726 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:22.546703 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:23.0466876 +0000 UTC m=+75.671321737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : configmap references non-existent config key: service-ca.crt Jul 02 15:48:22.549003 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.548972 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-stats-auth\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.549119 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.548972 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-default-certificate\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.558467 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.558420 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2zl\" (UniqueName: \"kubernetes.io/projected/7b856a5b-a8df-48dd-9578-c40e281f480e-kube-api-access-mp2zl\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:22.672003 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.671960 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj"] Jul 02 15:48:22.676802 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:22.676775 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60e27cd_c881_41a3_9a58_d0423aaff80f.slice/crio-81d072d66ee1d7dbce431b4dc19121c194818cf74443c2202975625b87d3667e WatchSource:0}: Error finding container 81d072d66ee1d7dbce431b4dc19121c194818cf74443c2202975625b87d3667e: Status 404 returned error can't find the container with id 81d072d66ee1d7dbce431b4dc19121c194818cf74443c2202975625b87d3667e Jul 02 15:48:22.692803 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:22.692726 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-hd6k8"] Jul 02 15:48:22.697177 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:22.697150 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949b44bf_795b_45ea_beab_94f2d405933e.slice/crio-d6812681cdb8318b9969dd2b983944aabc1ebe4ee2196ea10576b9792d0bb42e WatchSource:0}: Error finding container d6812681cdb8318b9969dd2b983944aabc1ebe4ee2196ea10576b9792d0bb42e: Status 404 returned error can't find the container with id d6812681cdb8318b9969dd2b983944aabc1ebe4ee2196ea10576b9792d0bb42e Jul 02 15:48:23.049990 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:23.049882 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:23.050152 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:23.050024 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:23.050152 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:23.050061 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:24.050039034 +0000 UTC m=+76.674673170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : configmap references non-existent config key: service-ca.crt Jul 02 15:48:23.050152 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:23.050108 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:48:23.050152 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:23.050151 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:24.050138573 +0000 UTC m=+76.674772710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : secret "router-metrics-certs-default" not found Jul 02 15:48:23.246186 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:23.246144 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" event={"ID":"f60e27cd-c881-41a3-9a58-d0423aaff80f","Type":"ContainerStarted","Data":"81d072d66ee1d7dbce431b4dc19121c194818cf74443c2202975625b87d3667e"} Jul 02 15:48:23.247209 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:23.247181 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" event={"ID":"949b44bf-795b-45ea-beab-94f2d405933e","Type":"ContainerStarted","Data":"d6812681cdb8318b9969dd2b983944aabc1ebe4ee2196ea10576b9792d0bb42e"} Jul 02 15:48:24.060471 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:24.060416 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:24.060951 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:24.060537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:24.060951 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:24.060618 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:26.060593218 +0000 UTC m=+78.685227356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : configmap references non-existent config key: service-ca.crt Jul 02 15:48:24.060951 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:24.060693 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:48:24.060951 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:24.060762 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:26.060742321 +0000 UTC m=+78.685376462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : secret "router-metrics-certs-default" not found Jul 02 15:48:26.078057 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.078012 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:26.078526 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.078088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:26.078526 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.078215 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:48:26.078526 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.078229 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:30.078200994 +0000 UTC m=+82.702835148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : configmap references non-existent config key: service-ca.crt Jul 02 15:48:26.078526 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.078272 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:30.078246495 +0000 UTC m=+82.702880631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : secret "router-metrics-certs-default" not found Jul 02 15:48:26.257425 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.257386 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" event={"ID":"f60e27cd-c881-41a3-9a58-d0423aaff80f","Type":"ContainerStarted","Data":"abd07cb8b111c1faa57f945c9279c6937d1beae40ceb551b00e79c284e5f208b"} Jul 02 15:48:26.259110 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.259073 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" event={"ID":"949b44bf-795b-45ea-beab-94f2d405933e","Type":"ContainerStarted","Data":"51d0150cfcd3ccf657682d32e3b32a0eccd26f478161bfee6e2cf41c3b0d95ba"} Jul 02 15:48:26.278858 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.278456 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" podStartSLOduration=1.591864124 podStartE2EDuration="4.278416766s" totalImagesPullingTime="2.686552642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:26.277987526 +0000 UTC m=+78.902621685" watchObservedRunningTime="2026-07-02 15:48:26.278416766 +0000 UTC m=+78.903050925" Jul 02 15:48:26.300833 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.300789 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z88z6"] Jul 02 15:48:26.304963 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.304929 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.311211 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.310981 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 15:48:26.311427 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.311205 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 15:48:26.311632 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.311591 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pqcdd\"" Jul 02 15:48:26.321094 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.321022 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" podStartSLOduration=1.658394046 podStartE2EDuration="4.320997436s" totalImagesPullingTime="2.66260339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:26.319187679 +0000 UTC m=+78.943821837" watchObservedRunningTime="2026-07-02 15:48:26.320997436 +0000 UTC m=+78.945631595" Jul 02 15:48:26.323514 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.323480 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z88z6"] Jul 02 15:48:26.383523 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.383394 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.383523 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.383487 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e051a40-6245-4056-a110-3f1d066f2b8e-data-volume\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.383734 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.383559 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.384017 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.383988 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfnl9\" (UniqueName: \"kubernetes.io/projected/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-api-access-lfnl9\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.384162 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.384039 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e051a40-6245-4056-a110-3f1d066f2b8e-crio-socket\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485153 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485113 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfnl9\" (UniqueName: \"kubernetes.io/projected/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-api-access-lfnl9\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485153 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485157 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e051a40-6245-4056-a110-3f1d066f2b8e-crio-socket\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485232 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e051a40-6245-4056-a110-3f1d066f2b8e-data-volume\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485266 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485279 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e051a40-6245-4056-a110-3f1d066f2b8e-crio-socket\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.485348 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.485362 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.485412 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:26.985392134 +0000 UTC m=+79.610026283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:48:26.485424 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.485430 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:26.985420933 +0000 UTC m=+79.610055068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : configmap "kube-rbac-proxy" not found Jul 02 15:48:26.485763 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.485695 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e051a40-6245-4056-a110-3f1d066f2b8e-data-volume\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.495084 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.495051 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfnl9\" (UniqueName: \"kubernetes.io/projected/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-api-access-lfnl9\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.991382 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.991333 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.991603 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:26.991405 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:26.991603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.991512 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:48:26.991603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.991518 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:48:26.991603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.991574 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:27.991558672 +0000 UTC m=+80.616192808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : configmap "kube-rbac-proxy" not found Jul 02 15:48:26.991603 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:26.991587 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:27.991581194 +0000 UTC m=+80.616215330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:48:27.999348 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:27.999291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:27.999861 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:27.999411 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:27.999861 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:27.999475 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:48:27.999861 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:27.999568 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:48:27.999861 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:27.999578 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:29.999553886 +0000 UTC m=+82.624188023 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : configmap "kube-rbac-proxy" not found Jul 02 15:48:27.999861 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:27.999614 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:29.999599913 +0000 UTC m=+82.624234054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:48:28.293008 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:28.292922 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mf7b7_077692ea-c0ac-462e-b55d-bb7717b8b74e/dns-node-resolver/0.log" Jul 02 15:48:29.501555 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:29.501519 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7w29_abe76034-ddd9-4202-aff1-b9cb5b7685f1/node-ca/0.log" Jul 02 15:48:30.016376 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:30.016334 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:30.016560 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:30.016407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:30.016560 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.016511 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:48:30.016662 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.016563 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:34.016549853 +0000 UTC m=+86.641183989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : configmap "kube-rbac-proxy" not found Jul 02 15:48:30.016662 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.016512 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:48:30.016662 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.016637 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:34.016624564 +0000 UTC m=+86.641258700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:48:30.088083 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:30.088056 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jls4l_7874c5a3-0fcc-4012-bc54-38d00cdeff73/serve-healthcheck-canary/0.log" Jul 02 15:48:30.117874 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:30.117822 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:30.118134 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.118115 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:38.118095956 +0000 UTC m=+90.742730107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : configmap references non-existent config key: service-ca.crt Jul 02 15:48:30.118317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:30.118278 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:30.118730 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.118710 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:48:30.118840 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:30.118779 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:38.118755465 +0000 UTC m=+90.743389619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : secret "router-metrics-certs-default" not found Jul 02 15:48:34.052212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:34.052172 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:34.052734 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:34.052244 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:34.052734 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:34.052322 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:48:34.052734 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:34.052344 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:48:34.052734 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:34.052383 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:42.052368879 +0000 UTC m=+94.677003016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : configmap "kube-rbac-proxy" not found Jul 02 15:48:34.052734 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:34.052411 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:42.05239692 +0000 UTC m=+94.677031056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:48:38.188201 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:38.188143 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:38.188616 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:38.188245 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:38.188616 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:38.188321 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle podName:7b856a5b-a8df-48dd-9578-c40e281f480e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:54.188302267 +0000 UTC m=+106.812936403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle") pod "router-default-668b98cdb9-29d86" (UID: "7b856a5b-a8df-48dd-9578-c40e281f480e") : configmap references non-existent config key: service-ca.crt Jul 02 15:48:38.190652 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:38.190626 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b856a5b-a8df-48dd-9578-c40e281f480e-metrics-certs\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:42.121846 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:42.121805 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:42.122265 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:42.121889 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:42.122265 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:42.121991 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:48:42.122265 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:48:42.122052 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls podName:1e051a40-6245-4056-a110-3f1d066f2b8e nodeName:}" failed. No retries permitted until 2026-07-02 15:48:58.122036786 +0000 UTC m=+110.746670922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z88z6" (UID: "1e051a40-6245-4056-a110-3f1d066f2b8e") : secret "insights-runtime-extractor-tls" not found Jul 02 15:48:42.122370 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:42.122342 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e051a40-6245-4056-a110-3f1d066f2b8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:48.069381 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.069319 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:48:48.071817 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.071776 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"image-registry-5997744fd7-clbjq\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:48:48.169974 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.169929 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:48:48.172359 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.172326 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20d07dcc-2cb8-4850-8bc2-8fb9aa72c488-metrics-tls\") pod \"dns-default-dsnbr\" (UID: \"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488\") " pod="openshift-dns/dns-default-dsnbr" Jul 02 15:48:48.233494 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.233459 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v9s2j" Jul 02 15:48:48.368354 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.368267 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7gxs\"" Jul 02 15:48:48.375841 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.375811 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:48:48.382744 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.382720 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z549g\"" Jul 02 15:48:48.391072 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.391037 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dsnbr" Jul 02 15:48:48.528151 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.528113 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5997744fd7-clbjq"] Jul 02 15:48:48.531607 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:48.531562 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbf7866_66cd_4357_83fe_bd5e45915ea8.slice/crio-c097b82a9d9a674ae6cff299f2ce2b80a12d970b50226d79c6d9a92cab85629c WatchSource:0}: Error finding container c097b82a9d9a674ae6cff299f2ce2b80a12d970b50226d79c6d9a92cab85629c: Status 404 returned error can't find the container with id c097b82a9d9a674ae6cff299f2ce2b80a12d970b50226d79c6d9a92cab85629c Jul 02 15:48:48.536094 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:48.536069 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dsnbr"] Jul 02 15:48:48.538889 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:48.538861 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d07dcc_2cb8_4850_8bc2_8fb9aa72c488.slice/crio-cbc96a9e68dfd670f6ce04ba2796ced00a011a8166107e4ba08b425d523b0634 WatchSource:0}: Error finding container cbc96a9e68dfd670f6ce04ba2796ced00a011a8166107e4ba08b425d523b0634: Status 404 returned error can't find the container with id cbc96a9e68dfd670f6ce04ba2796ced00a011a8166107e4ba08b425d523b0634 Jul 02 15:48:49.325149 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:49.325106 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" event={"ID":"0cbf7866-66cd-4357-83fe-bd5e45915ea8","Type":"ContainerStarted","Data":"2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9"} Jul 02 15:48:49.325651 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:49.325164 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" event={"ID":"0cbf7866-66cd-4357-83fe-bd5e45915ea8","Type":"ContainerStarted","Data":"c097b82a9d9a674ae6cff299f2ce2b80a12d970b50226d79c6d9a92cab85629c"} Jul 02 15:48:49.325651 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:49.325205 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:48:49.326481 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:49.326435 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dsnbr" event={"ID":"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488","Type":"ContainerStarted","Data":"cbc96a9e68dfd670f6ce04ba2796ced00a011a8166107e4ba08b425d523b0634"} Jul 02 15:48:49.347134 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:49.347081 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" podStartSLOduration=101.347060977 podStartE2EDuration="1m41.347060977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:49.345277889 +0000 UTC m=+101.969912048" watchObservedRunningTime="2026-07-02 15:48:49.347060977 +0000 UTC m=+101.971695136" Jul 02 15:48:50.256058 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.256020 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn"] Jul 02 15:48:50.280774 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.280718 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn"] Jul 02 15:48:50.280962 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.280860 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.284664 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.284611 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 15:48:50.284664 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.284618 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 15:48:50.285601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.285576 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 15:48:50.285601 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.285575 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 15:48:50.285776 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.285642 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 15:48:50.285776 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.285640 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 15:48:50.286054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.286031 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 15:48:50.289716 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.289688 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.289862 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.289727 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.289862 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.289756 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.289979 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.289861 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7279w\" (UniqueName: \"kubernetes.io/projected/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-kube-api-access-7279w\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.290041 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.289997 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-hub\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.290041 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.290036 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-ca\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.390785 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.390745 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-hub\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.391242 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.390792 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-ca\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.391242 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.391067 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.391242 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.391104 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.391242 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.391135 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.391491 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.391251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7279w\" (UniqueName: \"kubernetes.io/projected/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-kube-api-access-7279w\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.392065 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.391992 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.394598 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.394521 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-ca\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.395280 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.394496 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-hub\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.395280 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.394696 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.395280 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.394842 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.403168 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.403120 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7279w\" (UniqueName: \"kubernetes.io/projected/7cfa6a66-5f67-4796-a5a2-6423f1aa9795-kube-api-access-7279w\") pod \"cluster-proxy-proxy-agent-74549f8456-6h6qn\" (UID: \"7cfa6a66-5f67-4796-a5a2-6423f1aa9795\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.602735 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.602696 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" Jul 02 15:48:50.746177 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:50.746142 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn"] Jul 02 15:48:50.816398 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:50.816367 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cfa6a66_5f67_4796_a5a2_6423f1aa9795.slice/crio-8e2f850189d387b6411603683125c7cfda0612a758b678e8e5fce9a7e0baaa79 WatchSource:0}: Error finding container 8e2f850189d387b6411603683125c7cfda0612a758b678e8e5fce9a7e0baaa79: Status 404 returned error can't find the container with id 8e2f850189d387b6411603683125c7cfda0612a758b678e8e5fce9a7e0baaa79 Jul 02 15:48:51.334418 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:51.334377 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" event={"ID":"7cfa6a66-5f67-4796-a5a2-6423f1aa9795","Type":"ContainerStarted","Data":"8e2f850189d387b6411603683125c7cfda0612a758b678e8e5fce9a7e0baaa79"} Jul 02 15:48:51.336095 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:51.336067 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dsnbr" event={"ID":"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488","Type":"ContainerStarted","Data":"4e7fc537815d50a6893044fe92a1eb3ce8415c4da17b7ae658879a92645ccd9a"} Jul 02 15:48:51.336201 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:51.336152 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dsnbr" event={"ID":"20d07dcc-2cb8-4850-8bc2-8fb9aa72c488","Type":"ContainerStarted","Data":"1509501ce9fd72d4a42daee5e8132afcb3ec65c87a3541468eead191b2022eff"} Jul 02 15:48:51.336255 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:51.336223 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dsnbr" Jul 02 15:48:51.356132 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:51.356076 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dsnbr" podStartSLOduration=65.053091807 podStartE2EDuration="1m7.35605278s" totalImagesPullingTime="2.302960973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:51.355473179 +0000 UTC m=+103.980107332" watchObservedRunningTime="2026-07-02 15:48:51.35605278 +0000 UTC m=+103.980686940" Jul 02 15:48:54.226765 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:54.226725 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:54.227494 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:54.227436 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b856a5b-a8df-48dd-9578-c40e281f480e-service-ca-bundle\") pod \"router-default-668b98cdb9-29d86\" (UID: \"7b856a5b-a8df-48dd-9578-c40e281f480e\") " pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:54.418177 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:54.418137 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:54.570625 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:54.570584 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-668b98cdb9-29d86"] Jul 02 15:48:54.574597 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:54.574565 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b856a5b_a8df_48dd_9578_c40e281f480e.slice/crio-c1b60ae91e82d9e1362e9c004bc230a09f16d3611ca626193825ac0dd1cbe18f WatchSource:0}: Error finding container c1b60ae91e82d9e1362e9c004bc230a09f16d3611ca626193825ac0dd1cbe18f: Status 404 returned error can't find the container with id c1b60ae91e82d9e1362e9c004bc230a09f16d3611ca626193825ac0dd1cbe18f Jul 02 15:48:55.351819 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:55.351773 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-668b98cdb9-29d86" event={"ID":"7b856a5b-a8df-48dd-9578-c40e281f480e","Type":"ContainerStarted","Data":"098710996c55ce5374f6e1dc6ac4e9ddb1f1e6a84a95c39cd8ed5c18c204ddba"} Jul 02 15:48:55.352248 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:55.351840 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-668b98cdb9-29d86" event={"ID":"7b856a5b-a8df-48dd-9578-c40e281f480e","Type":"ContainerStarted","Data":"c1b60ae91e82d9e1362e9c004bc230a09f16d3611ca626193825ac0dd1cbe18f"} Jul 02 15:48:55.372941 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:55.372876 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-668b98cdb9-29d86" podStartSLOduration=33.372858494 podStartE2EDuration="33.372858494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:55.371986272 +0000 UTC m=+107.996620453" watchObservedRunningTime="2026-07-02 15:48:55.372858494 +0000 UTC m=+107.997492652" Jul 02 15:48:55.418667 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:55.418631 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:55.421925 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:55.421893 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:56.357323 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:56.357277 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" event={"ID":"7cfa6a66-5f67-4796-a5a2-6423f1aa9795","Type":"ContainerStarted","Data":"570c61f2812823eb6fa077dd7844ebec5b2c646ab1233315b6ea8900299d5301"} Jul 02 15:48:56.357741 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:56.357340 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" event={"ID":"7cfa6a66-5f67-4796-a5a2-6423f1aa9795","Type":"ContainerStarted","Data":"31427280955d04521add784a2670b6ae6d2cc51b674a4cb5d0fcf9e0682d2dab"} Jul 02 15:48:56.357741 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:56.357420 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:56.357741 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:56.357477 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" event={"ID":"7cfa6a66-5f67-4796-a5a2-6423f1aa9795","Type":"ContainerStarted","Data":"b94825a7007701e4165a5f5cd5a57df90ab763d558b8f9450516cb3ed5e4e96d"} Jul 02 15:48:56.358791 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:56.358770 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-668b98cdb9-29d86" Jul 02 15:48:56.376261 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:56.376205 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74549f8456-6h6qn" podStartSLOduration=1.4227302769999999 podStartE2EDuration="6.37618865s" totalImagesPullingTime="4.953458373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:48:56.374360909 +0000 UTC m=+108.998995086" watchObservedRunningTime="2026-07-02 15:48:56.37618865 +0000 UTC m=+109.000822808" Jul 02 15:48:58.160572 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:58.160530 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:58.162911 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:58.162876 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e051a40-6245-4056-a110-3f1d066f2b8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z88z6\" (UID: \"1e051a40-6245-4056-a110-3f1d066f2b8e\") " pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:58.420099 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:58.420011 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z88z6" Jul 02 15:48:58.576102 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:58.576057 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z88z6"] Jul 02 15:48:58.579358 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:48:58.579328 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e051a40_6245_4056_a110_3f1d066f2b8e.slice/crio-963b9241fa1a1c39d161cf243f8910c92a64295897ea7a1001df9484a1e03c0d WatchSource:0}: Error finding container 963b9241fa1a1c39d161cf243f8910c92a64295897ea7a1001df9484a1e03c0d: Status 404 returned error can't find the container with id 963b9241fa1a1c39d161cf243f8910c92a64295897ea7a1001df9484a1e03c0d Jul 02 15:48:59.370433 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:48:59.370392 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z88z6" event={"ID":"1e051a40-6245-4056-a110-3f1d066f2b8e","Type":"ContainerStarted","Data":"963b9241fa1a1c39d161cf243f8910c92a64295897ea7a1001df9484a1e03c0d"} Jul 02 15:49:01.341923 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:01.341889 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dsnbr" Jul 02 15:49:03.388155 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:03.388116 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z88z6" event={"ID":"1e051a40-6245-4056-a110-3f1d066f2b8e","Type":"ContainerStarted","Data":"0920c3f73eabb72320f03e792f28fe3cb7b02aaf57ce49db874c93cafde0e936"} Jul 02 15:49:04.394278 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:04.394238 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z88z6" event={"ID":"1e051a40-6245-4056-a110-3f1d066f2b8e","Type":"ContainerStarted","Data":"5b4a14f66acf9d24f2817496cda536df95aa9b80a39bb4d91e5efed7751c6eab"} Jul 02 15:49:06.402572 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:06.402533 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z88z6" event={"ID":"1e051a40-6245-4056-a110-3f1d066f2b8e","Type":"ContainerStarted","Data":"b515745d0008affba366e04f81802ffe61f29741857fef54e60091e6c93cdda0"} Jul 02 15:49:06.421336 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:06.421282 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z88z6" podStartSLOduration=32.904034632 podStartE2EDuration="40.421265111s" totalImagesPullingTime="7.517230479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:48:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:49:06.419392247 +0000 UTC m=+119.044026450" watchObservedRunningTime="2026-07-02 15:49:06.421265111 +0000 UTC m=+119.045899270" Jul 02 15:49:10.334912 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.334880 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:49:10.775012 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.774934 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vh4kc"] Jul 02 15:49:10.779418 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.779393 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.781886 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.781856 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 15:49:10.782027 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.781888 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 15:49:10.782027 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.781858 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 15:49:10.782255 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.782239 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 15:49:10.782296 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.782280 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 15:49:10.782383 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.782369 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7vcsx\"" Jul 02 15:49:10.782540 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.782524 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 15:49:10.865277 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865230 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-accelerators-collector-config\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865277 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865279 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-sys\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865309 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5dt2\" (UniqueName: \"kubernetes.io/projected/3cf97a80-02d8-4957-a9c7-e20d04468afc-kube-api-access-m5dt2\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865410 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865472 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cf97a80-02d8-4957-a9c7-e20d04468afc-metrics-client-ca\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865498 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-textfile\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865521 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-tls\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865558 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-root\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.865814 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.865602 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-wtmp\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.966832 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.966788 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cf97a80-02d8-4957-a9c7-e20d04468afc-metrics-client-ca\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.966832 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.966836 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-textfile\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967072 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.966867 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-tls\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967072 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.966907 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-root\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967072 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.966934 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-wtmp\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967072 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.966974 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-accelerators-collector-config\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967072 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967030 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-root\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967315 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-sys\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967315 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967112 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-wtmp\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967315 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967143 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5dt2\" (UniqueName: \"kubernetes.io/projected/3cf97a80-02d8-4957-a9c7-e20d04468afc-kube-api-access-m5dt2\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967315 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967190 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cf97a80-02d8-4957-a9c7-e20d04468afc-sys\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967315 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967236 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967315 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967299 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-textfile\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967647 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967541 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-accelerators-collector-config\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.967647 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.967548 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cf97a80-02d8-4957-a9c7-e20d04468afc-metrics-client-ca\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.969484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.969462 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.969588 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.969573 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3cf97a80-02d8-4957-a9c7-e20d04468afc-node-exporter-tls\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:10.976763 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:10.976740 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5dt2\" (UniqueName: \"kubernetes.io/projected/3cf97a80-02d8-4957-a9c7-e20d04468afc-kube-api-access-m5dt2\") pod \"node-exporter-vh4kc\" (UID: \"3cf97a80-02d8-4957-a9c7-e20d04468afc\") " pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:11.088826 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:11.088782 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vh4kc" Jul 02 15:49:11.100478 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:49:11.100422 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf97a80_02d8_4957_a9c7_e20d04468afc.slice/crio-13e7359439a0b3592e357978aca0008db373f8a41b685dbd304525638127b075 WatchSource:0}: Error finding container 13e7359439a0b3592e357978aca0008db373f8a41b685dbd304525638127b075: Status 404 returned error can't find the container with id 13e7359439a0b3592e357978aca0008db373f8a41b685dbd304525638127b075 Jul 02 15:49:11.419789 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:11.419695 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vh4kc" event={"ID":"3cf97a80-02d8-4957-a9c7-e20d04468afc","Type":"ContainerStarted","Data":"13e7359439a0b3592e357978aca0008db373f8a41b685dbd304525638127b075"} Jul 02 15:49:12.424841 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:12.424789 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vh4kc" event={"ID":"3cf97a80-02d8-4957-a9c7-e20d04468afc","Type":"ContainerStarted","Data":"5cb85c3a7529fc4355768664fbac121fc2b50cb385a9804102dd822b9f30afa4"} Jul 02 15:49:12.900209 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:12.900171 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5997744fd7-clbjq"] Jul 02 15:49:13.429683 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:13.429644 2571 generic.go:356] "Generic (PLEG): container finished" podID="3cf97a80-02d8-4957-a9c7-e20d04468afc" containerID="5cb85c3a7529fc4355768664fbac121fc2b50cb385a9804102dd822b9f30afa4" exitCode=0 Jul 02 15:49:13.430061 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:13.429694 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vh4kc" event={"ID":"3cf97a80-02d8-4957-a9c7-e20d04468afc","Type":"ContainerDied","Data":"5cb85c3a7529fc4355768664fbac121fc2b50cb385a9804102dd822b9f30afa4"} Jul 02 15:49:14.436159 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:14.436119 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vh4kc" event={"ID":"3cf97a80-02d8-4957-a9c7-e20d04468afc","Type":"ContainerStarted","Data":"ce93b36fefecf02eb4d18c120c19f5aba35262b2af72e717e630cd183590ac07"} Jul 02 15:49:14.436682 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:14.436220 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vh4kc" event={"ID":"3cf97a80-02d8-4957-a9c7-e20d04468afc","Type":"ContainerStarted","Data":"2405539d0be6f3ce74a7effd6ba2b166531a33221b09838011b5c1e20ba6ab84"} Jul 02 15:49:14.455706 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:14.455637 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vh4kc" podStartSLOduration=3.148822124 podStartE2EDuration="4.455618724s" totalImagesPullingTime="1.238983007s" totalInitContainerRuntime="67.813593ms" isStatefulPod=true podCreationTimestamp="2026-07-02 15:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:49:14.454684045 +0000 UTC m=+127.079318205" watchObservedRunningTime="2026-07-02 15:49:14.455618724 +0000 UTC m=+127.080252883" Jul 02 15:49:17.289319 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.289284 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:49:17.292735 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.292715 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.302688 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.302662 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:49:17.303067 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.303046 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:49:17.303164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.303069 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:49:17.303164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.303084 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:49:17.303164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.303099 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:49:17.303164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.303144 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:49:17.303331 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.303173 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ah1k1bctqtdin\"" Jul 02 15:49:17.304031 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304014 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:49:17.304108 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304054 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:49:17.304108 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304059 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:49:17.304211 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304107 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:49:17.304319 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304304 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:49:17.304415 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304393 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:49:17.304505 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.304489 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:49:17.308430 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.308394 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l2lnp\"" Jul 02 15:49:17.311400 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.311380 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:49:17.312692 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.312670 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:49:17.324123 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.324086 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:49:17.423593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423552 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423591 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423836 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423617 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423836 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423643 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423836 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423732 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423836 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423769 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423836 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423805 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.423836 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423823 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423845 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423932 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423950 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423974 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.423994 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcbqv\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-kube-api-access-fcbqv\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.424014 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424311 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.424079 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424311 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.424097 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424311 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.424144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424311 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.424161 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.424311 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.424179 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525525 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525565 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525589 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525614 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525641 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525683 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525711 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525734 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525757 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525780 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcbqv\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-kube-api-access-fcbqv\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.525808 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525805 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525852 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525872 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525896 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525919 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525945 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.525984 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526015 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526036 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526064 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526220 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526206 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526546 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526557 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526739 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526575 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.526896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.526792 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.527617 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.527581 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.528348 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.528328 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.528764 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.528732 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config-out\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.529061 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.528985 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.529174 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.529153 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.529549 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.529356 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.529549 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.529477 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.530149 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.530126 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.530743 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.530685 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.531358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.531327 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.531592 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.531559 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.531711 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.531674 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.531863 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.531845 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.531951 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.531932 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-web-config\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.538392 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.538361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcbqv\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-kube-api-access-fcbqv\") pod \"prometheus-k8s-0\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.602047 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.602000 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:17.750416 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.750390 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:49:17.752369 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:49:17.752341 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c7774c_d6a0_4743_ac34_c29c3c6960d6.slice/crio-c10a20457546920b78657a9a4b4e3261952f3072cf9abfb11b87e62c0db33ebc WatchSource:0}: Error finding container c10a20457546920b78657a9a4b4e3261952f3072cf9abfb11b87e62c0db33ebc: Status 404 returned error can't find the container with id c10a20457546920b78657a9a4b4e3261952f3072cf9abfb11b87e62c0db33ebc Jul 02 15:49:17.827974 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.827928 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:49:17.830319 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:17.830286 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cccf36-504c-42d9-85ef-8ce5a4d7b270-metrics-certs\") pod \"network-metrics-daemon-2wh5p\" (UID: \"51cccf36-504c-42d9-85ef-8ce5a4d7b270\") " pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:49:18.114776 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:18.114746 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtlwt\"" Jul 02 15:49:18.122909 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:18.122871 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wh5p" Jul 02 15:49:18.261511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:18.261474 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wh5p"] Jul 02 15:49:18.265082 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:49:18.265052 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cccf36_504c_42d9_85ef_8ce5a4d7b270.slice/crio-57d1d75d1378b430ae6d69b7b175c3c025ce350d02a282b0169321a38cc2c6f1 WatchSource:0}: Error finding container 57d1d75d1378b430ae6d69b7b175c3c025ce350d02a282b0169321a38cc2c6f1: Status 404 returned error can't find the container with id 57d1d75d1378b430ae6d69b7b175c3c025ce350d02a282b0169321a38cc2c6f1 Jul 02 15:49:18.452435 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:18.452346 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wh5p" event={"ID":"51cccf36-504c-42d9-85ef-8ce5a4d7b270","Type":"ContainerStarted","Data":"57d1d75d1378b430ae6d69b7b175c3c025ce350d02a282b0169321a38cc2c6f1"} Jul 02 15:49:18.453908 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:18.453871 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"c10a20457546920b78657a9a4b4e3261952f3072cf9abfb11b87e62c0db33ebc"} Jul 02 15:49:19.459244 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:19.459203 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wh5p" event={"ID":"51cccf36-504c-42d9-85ef-8ce5a4d7b270","Type":"ContainerStarted","Data":"b699b6e577760f92b48c566f5088e4b9cfaa195888babb176e6555748b4f55fe"} Jul 02 15:49:19.460770 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:19.460741 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" exitCode=0 Jul 02 15:49:19.460896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:19.460792 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} Jul 02 15:49:20.467875 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:20.467803 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wh5p" event={"ID":"51cccf36-504c-42d9-85ef-8ce5a4d7b270","Type":"ContainerStarted","Data":"8f1af1519bf77a8f37d0daab41a252f0ee9dc6d2344345f2444ad0e92409ac61"} Jul 02 15:49:20.491725 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:20.491650 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2wh5p" podStartSLOduration=131.470442459 podStartE2EDuration="2m12.491625754s" totalImagesPullingTime="1.021183295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:49:20.490466279 +0000 UTC m=+133.115100433" watchObservedRunningTime="2026-07-02 15:49:20.491625754 +0000 UTC m=+133.116259891" Jul 02 15:49:23.481510 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:23.481468 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} Jul 02 15:49:23.481897 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:23.481550 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} Jul 02 15:49:26.496530 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:26.496487 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} Jul 02 15:49:26.497010 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:26.496568 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} Jul 02 15:49:26.497010 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:26.496613 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} Jul 02 15:49:26.497010 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:26.496661 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerStarted","Data":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} Jul 02 15:49:26.524159 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:26.524068 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.571355792 podStartE2EDuration="9.52404394s" totalImagesPullingTime="6.931896569s" totalInitContainerRuntime="20.791579ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:49:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:49:26.52213074 +0000 UTC m=+139.146764901" watchObservedRunningTime="2026-07-02 15:49:26.52404394 +0000 UTC m=+139.148678101" Jul 02 15:49:27.602434 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:27.602393 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:49:36.535127 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:36.535092 2571 generic.go:356] "Generic (PLEG): container finished" podID="949b44bf-795b-45ea-beab-94f2d405933e" containerID="51d0150cfcd3ccf657682d32e3b32a0eccd26f478161bfee6e2cf41c3b0d95ba" exitCode=0 Jul 02 15:49:36.535661 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:36.535143 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" event={"ID":"949b44bf-795b-45ea-beab-94f2d405933e","Type":"ContainerDied","Data":"51d0150cfcd3ccf657682d32e3b32a0eccd26f478161bfee6e2cf41c3b0d95ba"} Jul 02 15:49:36.535661 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:36.535647 2571 scope.go:117] "RemoveContainer" containerID="51d0150cfcd3ccf657682d32e3b32a0eccd26f478161bfee6e2cf41c3b0d95ba" Jul 02 15:49:37.541008 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:37.540967 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-hd6k8" event={"ID":"949b44bf-795b-45ea-beab-94f2d405933e","Type":"ContainerStarted","Data":"265d28c606b9422c29a9b2a1d9b32dcb79111adf3c190c79adb452fbf2017345"} Jul 02 15:49:37.920612 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:37.920572 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" podUID="0cbf7866-66cd-4357-83fe-bd5e45915ea8" containerName="registry" containerID="cri-o://2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9" gracePeriod=30 Jul 02 15:49:38.173494 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.173400 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:49:38.305119 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305055 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-bound-sa-token\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305119 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305126 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmmbl\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-kube-api-access-xmmbl\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305374 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305153 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-certificates\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305374 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305193 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-image-registry-private-configuration\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305374 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305218 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cbf7866-66cd-4357-83fe-bd5e45915ea8-ca-trust-extracted\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305374 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305249 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-installation-pull-secrets\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305374 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305310 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305374 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305351 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-trusted-ca\") pod \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\" (UID: \"0cbf7866-66cd-4357-83fe-bd5e45915ea8\") " Jul 02 15:49:38.305701 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.305648 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:49:38.306056 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.306031 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:49:38.307761 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.307696 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:49:38.307761 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.307725 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:49:38.307940 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.307869 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:49:38.307940 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.307906 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-kube-api-access-xmmbl" (OuterVolumeSpecName: "kube-api-access-xmmbl") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "kube-api-access-xmmbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:49:38.308051 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.307942 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:49:38.315252 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.315198 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbf7866-66cd-4357-83fe-bd5e45915ea8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0cbf7866-66cd-4357-83fe-bd5e45915ea8" (UID: "0cbf7866-66cd-4357-83fe-bd5e45915ea8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:49:38.406527 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406492 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-trusted-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406527 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406524 2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-bound-sa-token\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406527 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406534 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmmbl\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-kube-api-access-xmmbl\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406766 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406544 2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-certificates\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406766 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406554 2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-image-registry-private-configuration\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406766 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406563 2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cbf7866-66cd-4357-83fe-bd5e45915ea8-ca-trust-extracted\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406766 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406571 2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cbf7866-66cd-4357-83fe-bd5e45915ea8-installation-pull-secrets\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.406766 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.406580 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cbf7866-66cd-4357-83fe-bd5e45915ea8-registry-tls\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:49:38.546133 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.546033 2571 generic.go:356] "Generic (PLEG): container finished" podID="0cbf7866-66cd-4357-83fe-bd5e45915ea8" containerID="2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9" exitCode=0 Jul 02 15:49:38.546133 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.546091 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" Jul 02 15:49:38.546652 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.546087 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" event={"ID":"0cbf7866-66cd-4357-83fe-bd5e45915ea8","Type":"ContainerDied","Data":"2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9"} Jul 02 15:49:38.546652 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.546235 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5997744fd7-clbjq" event={"ID":"0cbf7866-66cd-4357-83fe-bd5e45915ea8","Type":"ContainerDied","Data":"c097b82a9d9a674ae6cff299f2ce2b80a12d970b50226d79c6d9a92cab85629c"} Jul 02 15:49:38.546652 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.546263 2571 scope.go:117] "RemoveContainer" containerID="2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9" Jul 02 15:49:38.556282 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.556260 2571 scope.go:117] "RemoveContainer" containerID="2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9" Jul 02 15:49:38.556679 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:49:38.556655 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9\": container with ID starting with 2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9 not found: ID does not exist" containerID="2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9" Jul 02 15:49:38.556750 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.556689 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9"} err="failed to get container status \"2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9\": rpc error: code = NotFound desc = could not find container \"2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9\": container with ID starting with 2272a981331b7c76502ed47cda8579b0c468920ef4eae8d56e3530cd2fb6eaa9 not found: ID does not exist" Jul 02 15:49:38.572027 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.571989 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5997744fd7-clbjq"] Jul 02 15:49:38.574284 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:38.574247 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5997744fd7-clbjq"] Jul 02 15:49:39.928741 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:39.928706 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cbf7866-66cd-4357-83fe-bd5e45915ea8" path="/var/lib/kubelet/pods/0cbf7866-66cd-4357-83fe-bd5e45915ea8/volumes" Jul 02 15:49:46.576896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:46.576863 2571 generic.go:356] "Generic (PLEG): container finished" podID="f60e27cd-c881-41a3-9a58-d0423aaff80f" containerID="abd07cb8b111c1faa57f945c9279c6937d1beae40ceb551b00e79c284e5f208b" exitCode=0 Jul 02 15:49:46.577316 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:46.576907 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" event={"ID":"f60e27cd-c881-41a3-9a58-d0423aaff80f","Type":"ContainerDied","Data":"abd07cb8b111c1faa57f945c9279c6937d1beae40ceb551b00e79c284e5f208b"} Jul 02 15:49:46.577316 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:46.577243 2571 scope.go:117] "RemoveContainer" containerID="abd07cb8b111c1faa57f945c9279c6937d1beae40ceb551b00e79c284e5f208b" Jul 02 15:49:47.583650 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:49:47.583609 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-c5lkj" event={"ID":"f60e27cd-c881-41a3-9a58-d0423aaff80f","Type":"ContainerStarted","Data":"02de9449999c7637b9cadb053672192a007a60c5d027d589b22776de58c10ed6"} Jul 02 15:50:17.602341 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:17.602289 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:17.619463 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:17.619422 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:17.713469 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:17.713416 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:35.431939 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.431898 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:50:35.432377 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.432203 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="prometheus" containerID="cri-o://855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" gracePeriod=600 Jul 02 15:50:35.432377 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.432265 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy" containerID="cri-o://60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" gracePeriod=600 Jul 02 15:50:35.432377 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.432287 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" gracePeriod=600 Jul 02 15:50:35.432377 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.432337 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-web" containerID="cri-o://2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" gracePeriod=600 Jul 02 15:50:35.432641 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.432296 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="thanos-sidecar" containerID="cri-o://e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" gracePeriod=600 Jul 02 15:50:35.432641 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.432277 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="config-reloader" containerID="cri-o://0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" gracePeriod=600 Jul 02 15:50:35.715024 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.714986 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:35.765623 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765589 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" exitCode=0 Jul 02 15:50:35.765623 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765614 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" exitCode=0 Jul 02 15:50:35.765623 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765620 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" exitCode=0 Jul 02 15:50:35.765623 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765626 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" exitCode=0 Jul 02 15:50:35.765623 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765632 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" exitCode=0 Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765639 2571 generic.go:356] "Generic (PLEG): container finished" podID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" exitCode=0 Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765675 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765707 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765774 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765828 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765836 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765871 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} Jul 02 15:50:35.765930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765910 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} Jul 02 15:50:35.766219 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765935 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} Jul 02 15:50:35.766219 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.765963 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48c7774c-d6a0-4743-ac34-c29c3c6960d6","Type":"ContainerDied","Data":"c10a20457546920b78657a9a4b4e3261952f3072cf9abfb11b87e62c0db33ebc"} Jul 02 15:50:35.774565 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.774535 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.782587 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.782563 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.790430 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.790406 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.798554 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.798533 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.806642 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.806619 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.814854 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.814831 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.822470 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.822420 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.822817 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.822771 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.822870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.822827 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} err="failed to get container status \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" Jul 02 15:50:35.822870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.822850 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.823129 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.823111 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.823186 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.823140 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} err="failed to get container status \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" Jul 02 15:50:35.823186 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.823153 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.823339 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.823323 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.823384 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.823341 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} err="failed to get container status \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" Jul 02 15:50:35.823384 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.823353 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.823784 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.823763 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.823861 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.823790 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} err="failed to get container status \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" Jul 02 15:50:35.823861 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.823806 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.824049 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.824032 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.824083 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824055 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} err="failed to get container status \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" Jul 02 15:50:35.824083 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824067 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.824278 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.824260 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.824317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824284 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} err="failed to get container status \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" Jul 02 15:50:35.824317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824300 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.824585 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:50:35.824566 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.824680 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824584 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} err="failed to get container status \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" Jul 02 15:50:35.824680 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824597 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.824781 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824770 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} err="failed to get container status \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" Jul 02 15:50:35.824835 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824782 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.825014 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.824998 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} err="failed to get container status \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" Jul 02 15:50:35.825014 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825014 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.825251 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825227 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} err="failed to get container status \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" Jul 02 15:50:35.825291 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825253 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.825480 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825463 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} err="failed to get container status \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" Jul 02 15:50:35.825538 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825480 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.825681 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825665 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} err="failed to get container status \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" Jul 02 15:50:35.825722 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825682 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.825908 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825888 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} err="failed to get container status \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" Jul 02 15:50:35.825948 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.825910 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.826125 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826106 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} err="failed to get container status \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" Jul 02 15:50:35.826171 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826126 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.826314 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826296 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} err="failed to get container status \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" Jul 02 15:50:35.826362 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826313 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.826513 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826494 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} err="failed to get container status \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" Jul 02 15:50:35.826513 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826512 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.826770 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826750 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} err="failed to get container status \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" Jul 02 15:50:35.826770 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826770 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.826989 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826970 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} err="failed to get container status \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" Jul 02 15:50:35.827037 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.826990 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.827196 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827179 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} err="failed to get container status \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" Jul 02 15:50:35.827196 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827195 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.827409 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827389 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} err="failed to get container status \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" Jul 02 15:50:35.827513 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827410 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.827640 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827621 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} err="failed to get container status \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" Jul 02 15:50:35.827683 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827641 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.827865 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827844 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} err="failed to get container status \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" Jul 02 15:50:35.827910 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.827866 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.828068 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828048 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} err="failed to get container status \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" Jul 02 15:50:35.828109 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828070 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.828318 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828300 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} err="failed to get container status \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" Jul 02 15:50:35.828318 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828318 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.828539 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828522 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} err="failed to get container status \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" Jul 02 15:50:35.828594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828539 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.828741 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828726 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} err="failed to get container status \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" Jul 02 15:50:35.828787 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828741 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.828936 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828919 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} err="failed to get container status \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" Jul 02 15:50:35.828977 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.828937 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.829129 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829113 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} err="failed to get container status \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" Jul 02 15:50:35.829171 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829130 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.829332 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829313 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} err="failed to get container status \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" Jul 02 15:50:35.829387 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829334 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.829558 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829542 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} err="failed to get container status \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" Jul 02 15:50:35.829609 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829557 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.829773 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829743 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} err="failed to get container status \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" Jul 02 15:50:35.829773 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829773 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.829974 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829957 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} err="failed to get container status \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" Jul 02 15:50:35.829974 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.829973 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.830162 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830147 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} err="failed to get container status \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" Jul 02 15:50:35.830162 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830162 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.830381 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830363 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} err="failed to get container status \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" Jul 02 15:50:35.830381 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830380 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.830615 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830593 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} err="failed to get container status \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" Jul 02 15:50:35.830660 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830616 2571 scope.go:117] "RemoveContainer" containerID="ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4" Jul 02 15:50:35.830816 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830800 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4"} err="failed to get container status \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": rpc error: code = NotFound desc = could not find container \"ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4\": container with ID starting with ba68b6045e7ecc13514f5849444df8404502ddc3c4a2ebd27df7a2cf404ae1f4 not found: ID does not exist" Jul 02 15:50:35.830857 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830816 2571 scope.go:117] "RemoveContainer" containerID="60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad" Jul 02 15:50:35.831018 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.830999 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad"} err="failed to get container status \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": rpc error: code = NotFound desc = could not find container \"60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad\": container with ID starting with 60fe84a1e3ac19cba64b333b3fee37dfb3b7f394ab0817892ea853e9d31cfbad not found: ID does not exist" Jul 02 15:50:35.831060 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831018 2571 scope.go:117] "RemoveContainer" containerID="2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1" Jul 02 15:50:35.831243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831224 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1"} err="failed to get container status \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": rpc error: code = NotFound desc = could not find container \"2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1\": container with ID starting with 2eb1e31b4d2f433f429e8a65a61c59f397bd05e644fa404ab096526c1bfa56b1 not found: ID does not exist" Jul 02 15:50:35.831243 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831242 2571 scope.go:117] "RemoveContainer" containerID="e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20" Jul 02 15:50:35.831431 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831416 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20"} err="failed to get container status \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": rpc error: code = NotFound desc = could not find container \"e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20\": container with ID starting with e78469778882dadb5e5f9935e3c2769e2495315f648960963fead07d2495dc20 not found: ID does not exist" Jul 02 15:50:35.831498 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831430 2571 scope.go:117] "RemoveContainer" containerID="0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c" Jul 02 15:50:35.831651 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831634 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c"} err="failed to get container status \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": rpc error: code = NotFound desc = could not find container \"0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c\": container with ID starting with 0999247be466d87610e6de85808e2eb466c552af1c4416dcb783281c0849b48c not found: ID does not exist" Jul 02 15:50:35.831696 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831651 2571 scope.go:117] "RemoveContainer" containerID="855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6" Jul 02 15:50:35.831909 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831891 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6"} err="failed to get container status \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": rpc error: code = NotFound desc = could not find container \"855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6\": container with ID starting with 855551ca157f405ac6863c4d5715703896537f18e553671d63e233ca82497cb6 not found: ID does not exist" Jul 02 15:50:35.831909 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.831908 2571 scope.go:117] "RemoveContainer" containerID="c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5" Jul 02 15:50:35.832124 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.832105 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5"} err="failed to get container status \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": rpc error: code = NotFound desc = could not find container \"c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5\": container with ID starting with c5fe2982c0bb508583e41e9c3a3598b17ce33945b583c6830c2b5ae19db434d5 not found: ID does not exist" Jul 02 15:50:35.866511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866472 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-tls\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866513 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-kube-rbac-proxy\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866693 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866539 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866693 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866558 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866693 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866573 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866693 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866629 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-metrics-client-ca\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866693 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866653 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config-out\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866693 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866683 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-2\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866722 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-db\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866756 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcbqv\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-kube-api-access-fcbqv\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866791 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-kubelet-serving-ca-bundle\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866815 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-trusted-ca-bundle\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866853 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-tls-assets\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866890 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-thanos-prometheus-http-client-file\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866945 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-serving-certs-ca-bundle\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.866975 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.866975 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-1\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867001 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-grpc-tls\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867044 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-metrics-client-certs\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867081 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-web-config\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867109 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-0\") pod \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\" (UID: \"48c7774c-d6a0-4743-ac34-c29c3c6960d6\") " Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867107 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867103 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.867358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867347 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-metrics-client-ca\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.867749 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867365 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.867749 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.867512 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.868873 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.868839 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.869345 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.869311 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:50:35.869775 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.869746 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.870178 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.870154 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config-out" (OuterVolumeSpecName: "config-out") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:50:35.870321 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.870179 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.870321 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.870213 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:50:35.871001 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.870957 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.871001 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.870988 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.871153 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.871067 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.871153 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.871093 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config" (OuterVolumeSpecName: "config") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.871363 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.871334 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.871706 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.871680 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.871967 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.871942 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-kube-api-access-fcbqv" (OuterVolumeSpecName: "kube-api-access-fcbqv") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "kube-api-access-fcbqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:50:35.872198 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.872176 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.872264 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.872195 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:50:35.872264 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.872206 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.882327 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.882275 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-web-config" (OuterVolumeSpecName: "web-config") pod "48c7774c-d6a0-4743-ac34-c29c3c6960d6" (UID: "48c7774c-d6a0-4743-ac34-c29c3c6960d6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968374 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968409 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968420 2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-grpc-tls\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968429 2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-metrics-client-certs\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968439 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-web-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968461 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968469 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968477 2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-kube-rbac-proxy\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968486 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968495 2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968504 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968513 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-config-out\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968522 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-k8s-db\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968530 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcbqv\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-kube-api-access-fcbqv\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968538 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968546 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48c7774c-d6a0-4743-ac34-c29c3c6960d6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968556 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48c7774c-d6a0-4743-ac34-c29c3c6960d6-tls-assets\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:35.968894 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:35.968564 2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48c7774c-d6a0-4743-ac34-c29c3c6960d6-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-121.ec2.internal\" DevicePath \"\"" Jul 02 15:50:36.085645 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.085607 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:50:36.096594 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.095062 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:50:36.120487 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120433 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:50:36.120748 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120733 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="prometheus" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120751 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="prometheus" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120761 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-web" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120767 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-web" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120775 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="init-config-reloader" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120781 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="init-config-reloader" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120787 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="thanos-sidecar" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120793 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="thanos-sidecar" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120800 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cbf7866-66cd-4357-83fe-bd5e45915ea8" containerName="registry" Jul 02 15:50:36.120807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120805 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cbf7866-66cd-4357-83fe-bd5e45915ea8" containerName="registry" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120812 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-thanos" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120817 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-thanos" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120826 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120831 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120838 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="config-reloader" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120842 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="config-reloader" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120887 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="prometheus" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120897 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="thanos-sidecar" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120904 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cbf7866-66cd-4357-83fe-bd5e45915ea8" containerName="registry" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120909 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-thanos" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120914 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="config-reloader" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120919 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy-web" Jul 02 15:50:36.121054 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.120924 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" containerName="kube-rbac-proxy" Jul 02 15:50:36.126125 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.126096 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.128965 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.128933 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 15:50:36.129113 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.128987 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 15:50:36.129113 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.128989 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 15:50:36.129113 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.129108 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 15:50:36.129247 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.129135 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 15:50:36.129431 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.129416 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 15:50:36.129502 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.129484 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 15:50:36.129996 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.129973 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 15:50:36.130122 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.130020 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ah1k1bctqtdin\"" Jul 02 15:50:36.130122 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.130041 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 15:50:36.130624 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.130602 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l2lnp\"" Jul 02 15:50:36.130735 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.130687 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 15:50:36.130735 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.130689 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 15:50:36.130735 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.130724 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 15:50:36.131154 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.131132 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 15:50:36.132304 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.132283 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 15:50:36.135510 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.135487 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 15:50:36.142395 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.142361 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:50:36.269978 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.269876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.269978 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.269924 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.269988 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-config\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270015 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270035 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270063 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqr2\" (UniqueName: \"kubernetes.io/projected/ed17424f-afdb-4083-a809-b937200f9d7b-kube-api-access-trqr2\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270084 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270121 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270205 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270243 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270271 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed17424f-afdb-4083-a809-b937200f9d7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270305 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270357 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed17424f-afdb-4083-a809-b937200f9d7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270386 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270409 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270439 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270499 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270527 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.270593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.270574 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.371855 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.371809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.371871 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-config\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.371902 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.371926 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.371959 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqr2\" (UniqueName: \"kubernetes.io/projected/ed17424f-afdb-4083-a809-b937200f9d7b-kube-api-access-trqr2\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.371985 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372008 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372059 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372031 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372070 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372098 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372125 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed17424f-afdb-4083-a809-b937200f9d7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372158 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372191 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed17424f-afdb-4083-a809-b937200f9d7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372225 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372258 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372484 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372321 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372909 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372767 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.372909 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.372867 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.373325 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.373293 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.373750 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.373723 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375248 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375218 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-config\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375350 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375216 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375350 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375250 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375350 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375271 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed17424f-afdb-4083-a809-b937200f9d7b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375352 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375378 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375556 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375800 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375759 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.375800 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.375354 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.376097 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.376070 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.376274 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.376238 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.376388 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.376356 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.377117 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.377094 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed17424f-afdb-4083-a809-b937200f9d7b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.377586 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.377565 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.377760 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.377718 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.378093 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.378066 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed17424f-afdb-4083-a809-b937200f9d7b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.379004 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.378981 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed17424f-afdb-4083-a809-b937200f9d7b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.380130 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.380104 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqr2\" (UniqueName: \"kubernetes.io/projected/ed17424f-afdb-4083-a809-b937200f9d7b-kube-api-access-trqr2\") pod \"prometheus-k8s-0\" (UID: \"ed17424f-afdb-4083-a809-b937200f9d7b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.436920 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.436879 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:50:36.587405 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.587372 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 15:50:36.590647 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:50:36.590614 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded17424f_afdb_4083_a809_b937200f9d7b.slice/crio-e850b3e1d838597eeafba4dd9b77eff88f347b758270661338ff1fc98894a3f7 WatchSource:0}: Error finding container e850b3e1d838597eeafba4dd9b77eff88f347b758270661338ff1fc98894a3f7: Status 404 returned error can't find the container with id e850b3e1d838597eeafba4dd9b77eff88f347b758270661338ff1fc98894a3f7 Jul 02 15:50:36.771181 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.771140 2571 generic.go:356] "Generic (PLEG): container finished" podID="ed17424f-afdb-4083-a809-b937200f9d7b" containerID="b5bd16a555dccce661170ca1c18b47bd71fefe5dcff21436f09181a70cae2337" exitCode=0 Jul 02 15:50:36.771351 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.771199 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerDied","Data":"b5bd16a555dccce661170ca1c18b47bd71fefe5dcff21436f09181a70cae2337"} Jul 02 15:50:36.771351 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:36.771268 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"e850b3e1d838597eeafba4dd9b77eff88f347b758270661338ff1fc98894a3f7"} Jul 02 15:50:37.777921 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.777884 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"809f3fe1109f94b5453900a809b479b53f513b30cacd6c5d31d4085ea49998bc"} Jul 02 15:50:37.778317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.777948 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"9fbfde9b9982ece659ec46a6a8bdb97ce3b27d0866be7dbaac51ed272b11a587"} Jul 02 15:50:37.778317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.777973 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"4d58e9d34be47956d11582f1909306d591635a8f119c47679648c687484cce5d"} Jul 02 15:50:37.778317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.777996 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"06f5c89f58926db12b76726db77030ddf4d28c171312d435bd707ee732d93216"} Jul 02 15:50:37.778317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.778024 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"bb53f1f69c21be6e51b97c7a31dc6c7fe49cf94b7cdb25fd855f630ed0780e96"} Jul 02 15:50:37.778317 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.778047 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed17424f-afdb-4083-a809-b937200f9d7b","Type":"ContainerStarted","Data":"5622bb149b11d4a1a928664700ecba5351341956f00efb0e8b31fcc2e7b4914f"} Jul 02 15:50:37.809722 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.809652 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.790183527 podStartE2EDuration="1.809629118s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.445591ms" isStatefulPod=false podCreationTimestamp="2026-07-02 15:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:50:37.807227912 +0000 UTC m=+210.431862069" watchObservedRunningTime="2026-07-02 15:50:37.809629118 +0000 UTC m=+210.434263279" Jul 02 15:50:37.928532 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:37.928496 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c7774c-d6a0-4743-ac34-c29c3c6960d6" path="/var/lib/kubelet/pods/48c7774c-d6a0-4743-ac34-c29c3c6960d6/volumes" Jul 02 15:50:41.438050 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:50:41.437991 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:51:36.437566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:51:36.437470 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:51:36.453517 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:51:36.453489 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:51:37.013557 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:51:37.013529 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 15:52:07.843924 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:07.843893 2571 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 15:52:36.489232 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.489158 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7"] Jul 02 15:52:36.492679 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.492657 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.495127 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.495103 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 15:52:36.495436 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.495416 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 15:52:36.495807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.495787 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 15:52:36.496091 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.496076 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q2rzx\"" Jul 02 15:52:36.496213 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.496198 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 15:52:36.514690 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.514647 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7"] Jul 02 15:52:36.631639 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.631595 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.631845 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.631640 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-manifests\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.631845 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.631742 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.631845 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.631783 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-tmp\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.631845 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.631809 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztsvx\" (UniqueName: \"kubernetes.io/projected/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-kube-api-access-ztsvx\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.732604 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.732566 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.732604 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.732606 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-manifests\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.732838 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.732635 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.732838 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.732749 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-tmp\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.732838 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.732788 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztsvx\" (UniqueName: \"kubernetes.io/projected/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-kube-api-access-ztsvx\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.733048 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.733024 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-manifests\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.735048 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.735018 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-tmp\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.735192 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.735169 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.735366 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.735346 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.741107 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.741034 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztsvx\" (UniqueName: \"kubernetes.io/projected/f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3-kube-api-access-ztsvx\") pod \"opendatahub-operator-controller-manager-f4f645848-72hg7\" (UID: \"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3\") " pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.803203 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.803164 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:36.961593 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.961286 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7"] Jul 02 15:52:36.966498 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:52:36.966468 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bb39b4_8c95_4dd2_bc46_0d2c6c3695f3.slice/crio-816c17fb75e8ef7ec9e48f16f6acac3372aa2a41c944b6bcf36bd0189baada6f WatchSource:0}: Error finding container 816c17fb75e8ef7ec9e48f16f6acac3372aa2a41c944b6bcf36bd0189baada6f: Status 404 returned error can't find the container with id 816c17fb75e8ef7ec9e48f16f6acac3372aa2a41c944b6bcf36bd0189baada6f Jul 02 15:52:36.968251 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:36.968234 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:52:37.204914 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:37.204879 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" event={"ID":"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3","Type":"ContainerStarted","Data":"816c17fb75e8ef7ec9e48f16f6acac3372aa2a41c944b6bcf36bd0189baada6f"} Jul 02 15:52:40.219192 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:40.219098 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" event={"ID":"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3","Type":"ContainerStarted","Data":"4120a84bff85920847ed6df2ff84fe4387dcbb41b3160608913048636cc8b05e"} Jul 02 15:52:41.227020 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:41.226981 2571 generic.go:356] "Generic (PLEG): container finished" podID="f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3" containerID="4120a84bff85920847ed6df2ff84fe4387dcbb41b3160608913048636cc8b05e" exitCode=0 Jul 02 15:52:41.227470 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:41.227058 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" event={"ID":"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3","Type":"ContainerDied","Data":"4120a84bff85920847ed6df2ff84fe4387dcbb41b3160608913048636cc8b05e"} Jul 02 15:52:42.232643 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:42.232600 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" event={"ID":"f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3","Type":"ContainerStarted","Data":"480d328183a4fa78ebefeff876efc210b5d095e26db97c5d38ec777a8c08a8dd"} Jul 02 15:52:42.233056 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:42.232715 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:52:42.254358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:42.254282 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" podStartSLOduration=1.827373862 podStartE2EDuration="6.254262378s" totalImagesPullingTime="3.273404799s" totalInitContainerRuntime="1.153483717s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:52:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:52:42.252044245 +0000 UTC m=+334.876678423" watchObservedRunningTime="2026-07-02 15:52:42.254262378 +0000 UTC m=+334.878896537" Jul 02 15:52:53.239282 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:52:53.239249 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f4f645848-72hg7" Jul 02 15:53:03.722564 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.722462 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq"] Jul 02 15:53:03.725912 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.725890 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.730487 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.730465 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fqbk6\"" Jul 02 15:53:03.730688 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.730664 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 15:53:03.752968 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.752936 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq"] Jul 02 15:53:03.856845 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.856804 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.856845 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.856850 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/477a089f-787f-41ea-b24d-a7c4a526b785-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857118 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.856888 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857118 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.856938 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857118 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.856959 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/477a089f-787f-41ea-b24d-a7c4a526b785-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857118 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.857009 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/477a089f-787f-41ea-b24d-a7c4a526b785-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857118 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.857066 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857323 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.857126 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.857323 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.857162 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t59d\" (UniqueName: \"kubernetes.io/projected/477a089f-787f-41ea-b24d-a7c4a526b785-kube-api-access-7t59d\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958194 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958146 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t59d\" (UniqueName: \"kubernetes.io/projected/477a089f-787f-41ea-b24d-a7c4a526b785-kube-api-access-7t59d\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958194 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958196 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958215 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/477a089f-787f-41ea-b24d-a7c4a526b785-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958253 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958273 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/477a089f-787f-41ea-b24d-a7c4a526b785-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958334 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/477a089f-787f-41ea-b24d-a7c4a526b785-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958371 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958478 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958405 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958802 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958657 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958802 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958698 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.958900 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958840 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.959014 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.958995 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.959170 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.959143 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/477a089f-787f-41ea-b24d-a7c4a526b785-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.960827 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.960799 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/477a089f-787f-41ea-b24d-a7c4a526b785-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.960995 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.960977 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/477a089f-787f-41ea-b24d-a7c4a526b785-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.970275 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.970147 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/477a089f-787f-41ea-b24d-a7c4a526b785-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:03.970417 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:03.970308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t59d\" (UniqueName: \"kubernetes.io/projected/477a089f-787f-41ea-b24d-a7c4a526b785-kube-api-access-7t59d\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4b5qqq\" (UID: \"477a089f-787f-41ea-b24d-a7c4a526b785\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:04.036882 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:04.036781 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:04.197487 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:04.197439 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq"] Jul 02 15:53:04.200289 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:53:04.200260 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477a089f_787f_41ea_b24d_a7c4a526b785.slice/crio-4eb529188d93ed5a44047d0e2994991142dccce414bad398f7ca70ff9374faea WatchSource:0}: Error finding container 4eb529188d93ed5a44047d0e2994991142dccce414bad398f7ca70ff9374faea: Status 404 returned error can't find the container with id 4eb529188d93ed5a44047d0e2994991142dccce414bad398f7ca70ff9374faea Jul 02 15:53:04.320365 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:04.320324 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" event={"ID":"477a089f-787f-41ea-b24d-a7c4a526b785","Type":"ContainerStarted","Data":"4eb529188d93ed5a44047d0e2994991142dccce414bad398f7ca70ff9374faea"} Jul 02 15:53:06.210848 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.210349 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27"] Jul 02 15:53:06.217628 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.217592 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.222265 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.222235 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 15:53:06.222523 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.222331 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 15:53:06.223608 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.223577 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 15:53:06.223795 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.223681 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 15:53:06.223870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.223795 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:53:06.223870 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.223830 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h99kp\"" Jul 02 15:53:06.230688 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.230657 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27"] Jul 02 15:53:06.275236 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.275196 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0870e558-38bc-4c77-b03b-f8905408ad65-cert\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.275418 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.275263 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0870e558-38bc-4c77-b03b-f8905408ad65-metrics-cert\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.275418 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.275327 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0870e558-38bc-4c77-b03b-f8905408ad65-manager-config\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.275566 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.275416 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6k57\" (UniqueName: \"kubernetes.io/projected/0870e558-38bc-4c77-b03b-f8905408ad65-kube-api-access-m6k57\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.336770 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.336727 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts"] Jul 02 15:53:06.340367 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.340332 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.343949 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.343834 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 15:53:06.344249 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.344227 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t8k7k\"" Jul 02 15:53:06.357245 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.357209 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts"] Jul 02 15:53:06.376290 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.376251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0870e558-38bc-4c77-b03b-f8905408ad65-metrics-cert\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.376511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.376311 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10281945-e36f-472a-bb8f-9f1e81882f25-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.376511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.376356 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0870e558-38bc-4c77-b03b-f8905408ad65-manager-config\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.376511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.376409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6k57\" (UniqueName: \"kubernetes.io/projected/0870e558-38bc-4c77-b03b-f8905408ad65-kube-api-access-m6k57\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.376511 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.376489 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjdf5\" (UniqueName: \"kubernetes.io/projected/10281945-e36f-472a-bb8f-9f1e81882f25-kube-api-access-sjdf5\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.376746 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.376518 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0870e558-38bc-4c77-b03b-f8905408ad65-cert\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.377123 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.377097 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0870e558-38bc-4c77-b03b-f8905408ad65-manager-config\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.379196 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.379141 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0870e558-38bc-4c77-b03b-f8905408ad65-metrics-cert\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.379395 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.379369 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0870e558-38bc-4c77-b03b-f8905408ad65-cert\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.385673 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.385600 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6k57\" (UniqueName: \"kubernetes.io/projected/0870e558-38bc-4c77-b03b-f8905408ad65-kube-api-access-m6k57\") pod \"lws-controller-manager-66d8cd6446-95q27\" (UID: \"0870e558-38bc-4c77-b03b-f8905408ad65\") " pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.477580 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.477495 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjdf5\" (UniqueName: \"kubernetes.io/projected/10281945-e36f-472a-bb8f-9f1e81882f25-kube-api-access-sjdf5\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.477580 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.477563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10281945-e36f-472a-bb8f-9f1e81882f25-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.477847 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:53:06.477817 2571 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 02 15:53:06.477943 ip-10-0-141-121 kubenswrapper[2571]: E0702 15:53:06.477920 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10281945-e36f-472a-bb8f-9f1e81882f25-cert podName:10281945-e36f-472a-bb8f-9f1e81882f25 nodeName:}" failed. No retries permitted until 2026-07-02 15:53:06.977895689 +0000 UTC m=+359.602529828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/10281945-e36f-472a-bb8f-9f1e81882f25-cert") pod "llmisvc-controller-manager-777c6bd7d5-6c8ts" (UID: "10281945-e36f-472a-bb8f-9f1e81882f25") : secret "llmisvc-webhook-server-cert" not found Jul 02 15:53:06.491692 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.491659 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjdf5\" (UniqueName: \"kubernetes.io/projected/10281945-e36f-472a-bb8f-9f1e81882f25-kube-api-access-sjdf5\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.530999 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.530959 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:06.810427 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.810361 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 15:53:06.810597 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.810481 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 15:53:06.810597 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.810513 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 15:53:06.883163 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.883122 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27"] Jul 02 15:53:06.886201 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:53:06.886171 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0870e558_38bc_4c77_b03b_f8905408ad65.slice/crio-30f4c3637da28ed74da38e9acb97fcbd3d5e47b0fc20c085f9e68621895a190f WatchSource:0}: Error finding container 30f4c3637da28ed74da38e9acb97fcbd3d5e47b0fc20c085f9e68621895a190f: Status 404 returned error can't find the container with id 30f4c3637da28ed74da38e9acb97fcbd3d5e47b0fc20c085f9e68621895a190f Jul 02 15:53:06.982685 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.982640 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10281945-e36f-472a-bb8f-9f1e81882f25-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:06.985268 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:06.985235 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10281945-e36f-472a-bb8f-9f1e81882f25-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6c8ts\" (UID: \"10281945-e36f-472a-bb8f-9f1e81882f25\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:07.253495 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:07.253431 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:07.337028 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:07.336982 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" event={"ID":"477a089f-787f-41ea-b24d-a7c4a526b785","Type":"ContainerStarted","Data":"b03a4a4a518d6e1adf460b1d5e79daf5879251ca857e39947fa6f06dc11cefa3"} Jul 02 15:53:07.338350 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:07.338281 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" event={"ID":"0870e558-38bc-4c77-b03b-f8905408ad65","Type":"ContainerStarted","Data":"30f4c3637da28ed74da38e9acb97fcbd3d5e47b0fc20c085f9e68621895a190f"} Jul 02 15:53:07.403242 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:07.403188 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" podStartSLOduration=1.7954483620000001 podStartE2EDuration="4.403164357s" totalImagesPullingTime="2.607715995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:53:07.383768873 +0000 UTC m=+360.008403030" watchObservedRunningTime="2026-07-02 15:53:07.403164357 +0000 UTC m=+360.027798514" Jul 02 15:53:07.404277 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:07.404254 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts"] Jul 02 15:53:07.406725 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:53:07.406699 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod10281945_e36f_472a_bb8f_9f1e81882f25.slice/crio-b97544a82e1bb5ae8b3ca3ca76a11a7c0a703f60f3285692ec64aae3869a0a57 WatchSource:0}: Error finding container b97544a82e1bb5ae8b3ca3ca76a11a7c0a703f60f3285692ec64aae3869a0a57: Status 404 returned error can't find the container with id b97544a82e1bb5ae8b3ca3ca76a11a7c0a703f60f3285692ec64aae3869a0a57 Jul 02 15:53:08.036989 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:08.036958 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:08.044723 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:08.044622 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:08.346299 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:08.346256 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" event={"ID":"10281945-e36f-472a-bb8f-9f1e81882f25","Type":"ContainerStarted","Data":"b97544a82e1bb5ae8b3ca3ca76a11a7c0a703f60f3285692ec64aae3869a0a57"} Jul 02 15:53:08.346830 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:08.346488 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:08.347874 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:08.347845 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4b5qqq" Jul 02 15:53:10.356498 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:10.356434 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" event={"ID":"0870e558-38bc-4c77-b03b-f8905408ad65","Type":"ContainerStarted","Data":"08273722cb02cfaf7a403348e19fd75f8d02a2ee0c6566b32b2486754c90d55f"} Jul 02 15:53:10.376204 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:10.376135 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" podStartSLOduration=1.301371985 podStartE2EDuration="4.376109565s" totalImagesPullingTime="3.07473758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:53:10.375566102 +0000 UTC m=+363.000200261" watchObservedRunningTime="2026-07-02 15:53:10.376109565 +0000 UTC m=+363.000743728" Jul 02 15:53:11.362318 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:11.362273 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" event={"ID":"10281945-e36f-472a-bb8f-9f1e81882f25","Type":"ContainerStarted","Data":"b78622b3da5f53263b0f5608e55e1954429e30f547f303dd9f0e63f5b57b9b5d"} Jul 02 15:53:11.363015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:11.362342 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:11.363015 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:11.362477 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:53:11.381872 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:11.381819 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" podStartSLOduration=1.924905298 podStartE2EDuration="5.381802135s" totalImagesPullingTime="3.456896837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:53:11.380918467 +0000 UTC m=+364.005552626" watchObservedRunningTime="2026-07-02 15:53:11.381802135 +0000 UTC m=+364.006436295" Jul 02 15:53:22.368517 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:22.368485 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66d8cd6446-95q27" Jul 02 15:53:42.368129 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:53:42.368097 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6c8ts" Jul 02 15:59:12.941331 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:12.941247 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6c8ts_10281945-e36f-472a-bb8f-9f1e81882f25/manager/0.log" Jul 02 15:59:13.323475 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:13.323422 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4f645848-72hg7_f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3/copy-manifests/0.log" Jul 02 15:59:13.346712 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:13.346672 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4f645848-72hg7_f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3/manager/0.log" Jul 02 15:59:14.657164 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:14.657127 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4b5qqq_477a089f-787f-41ea-b24d-a7c4a526b785/istio-proxy/0.log" Jul 02 15:59:15.135412 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:15.135382 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b98cdb9-29d86_7b856a5b-a8df-48dd-9578-c40e281f480e/router/0.log" Jul 02 15:59:22.907833 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:22.907798 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7wjzr_cfb1f722-afe7-4bb4-ae0a-8774a8a1c787/global-pull-secret-syncer/0.log" Jul 02 15:59:23.074524 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:23.074476 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cxjcb_7a0d76ac-9d58-4558-8419-e8c608fb3b61/konnectivity-agent/0.log" Jul 02 15:59:23.163896 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:23.163781 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-121.ec2.internal_ff8112a09a92e79e1fba8f9541e6f8d7/haproxy/0.log" Jul 02 15:59:27.971678 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:27.971644 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vh4kc_3cf97a80-02d8-4957-a9c7-e20d04468afc/node-exporter/0.log" Jul 02 15:59:27.992128 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:27.992076 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vh4kc_3cf97a80-02d8-4957-a9c7-e20d04468afc/kube-rbac-proxy/0.log" Jul 02 15:59:28.019227 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.019173 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vh4kc_3cf97a80-02d8-4957-a9c7-e20d04468afc/init-textfile/0.log" Jul 02 15:59:28.144498 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.144391 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/prometheus/0.log" Jul 02 15:59:28.167834 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.167804 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/config-reloader/0.log" Jul 02 15:59:28.196577 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.196548 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/thanos-sidecar/0.log" Jul 02 15:59:28.213813 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.213789 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/kube-rbac-proxy-web/0.log" Jul 02 15:59:28.234682 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.234656 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/kube-rbac-proxy/0.log" Jul 02 15:59:28.262024 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.261996 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/kube-rbac-proxy-thanos/0.log" Jul 02 15:59:28.283653 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:28.283619 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ed17424f-afdb-4083-a809-b937200f9d7b/init-config-reloader/0.log" Jul 02 15:59:32.223942 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.223897 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk"] Jul 02 15:59:32.227597 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.227571 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.229988 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.229961 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6l2fx\"/\"openshift-service-ca.crt\"" Jul 02 15:59:32.230930 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.230911 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6l2fx\"/\"default-dockercfg-h7xth\"" Jul 02 15:59:32.231051 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.230916 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6l2fx\"/\"kube-root-ca.crt\"" Jul 02 15:59:32.237377 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.237341 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk"] Jul 02 15:59:32.328627 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.328582 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-lib-modules\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.328807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.328638 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-podres\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.328807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.328662 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mpk\" (UniqueName: \"kubernetes.io/projected/84fec051-6e87-456b-83ef-7e795453a824-kube-api-access-q9mpk\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.328807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.328737 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-sys\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.328807 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.328764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-proc\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430028 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.429980 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-lib-modules\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430174 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430053 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-podres\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430174 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430103 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mpk\" (UniqueName: \"kubernetes.io/projected/84fec051-6e87-456b-83ef-7e795453a824-kube-api-access-q9mpk\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430174 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430167 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-sys\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430294 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430188 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-lib-modules\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430294 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430197 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-proc\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430294 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430232 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-podres\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430294 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430255 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-sys\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.430294 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.430255 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84fec051-6e87-456b-83ef-7e795453a824-proc\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.438241 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.438208 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mpk\" (UniqueName: \"kubernetes.io/projected/84fec051-6e87-456b-83ef-7e795453a824-kube-api-access-q9mpk\") pod \"perf-node-gather-daemonset-bwrtk\" (UID: \"84fec051-6e87-456b-83ef-7e795453a824\") " pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.538361 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.538270 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.673422 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.673319 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk"] Jul 02 15:59:32.676178 ip-10-0-141-121 kubenswrapper[2571]: W0702 15:59:32.676144 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84fec051_6e87_456b_83ef_7e795453a824.slice/crio-35f9b70ed41fb6394984748c86396c1e1378cc071dfc353511fae2ef24380255 WatchSource:0}: Error finding container 35f9b70ed41fb6394984748c86396c1e1378cc071dfc353511fae2ef24380255: Status 404 returned error can't find the container with id 35f9b70ed41fb6394984748c86396c1e1378cc071dfc353511fae2ef24380255 Jul 02 15:59:32.782271 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.782233 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" event={"ID":"84fec051-6e87-456b-83ef-7e795453a824","Type":"ContainerStarted","Data":"c6df5a255ac2ee82fa68c571f686661d8043bb06e1a9db1866b0b50b3b916b06"} Jul 02 15:59:32.782498 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.782287 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" event={"ID":"84fec051-6e87-456b-83ef-7e795453a824","Type":"ContainerStarted","Data":"35f9b70ed41fb6394984748c86396c1e1378cc071dfc353511fae2ef24380255"} Jul 02 15:59:32.782498 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.782355 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:32.797481 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:32.797331 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" podStartSLOduration=0.797312374 podStartE2EDuration="797.312374ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:59:32.797070954 +0000 UTC m=+745.421705113" watchObservedRunningTime="2026-07-02 15:59:32.797312374 +0000 UTC m=+745.421946532" Jul 02 15:59:33.213064 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:33.213034 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dsnbr_20d07dcc-2cb8-4850-8bc2-8fb9aa72c488/dns/0.log" Jul 02 15:59:33.234737 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:33.234691 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dsnbr_20d07dcc-2cb8-4850-8bc2-8fb9aa72c488/kube-rbac-proxy/0.log" Jul 02 15:59:33.400958 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:33.400927 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mf7b7_077692ea-c0ac-462e-b55d-bb7717b8b74e/dns-node-resolver/0.log" Jul 02 15:59:34.032344 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:34.032314 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7w29_abe76034-ddd9-4202-aff1-b9cb5b7685f1/node-ca/0.log" Jul 02 15:59:34.952226 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:34.952189 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4b5qqq_477a089f-787f-41ea-b24d-a7c4a526b785/istio-proxy/0.log" Jul 02 15:59:35.056280 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:35.056247 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b98cdb9-29d86_7b856a5b-a8df-48dd-9578-c40e281f480e/router/0.log" Jul 02 15:59:35.614827 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:35.614790 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jls4l_7874c5a3-0fcc-4012-bc54-38d00cdeff73/serve-healthcheck-canary/0.log" Jul 02 15:59:36.097458 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:36.097414 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-hd6k8_949b44bf-795b-45ea-beab-94f2d405933e/insights-operator/1.log" Jul 02 15:59:36.097928 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:36.097600 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-hd6k8_949b44bf-795b-45ea-beab-94f2d405933e/insights-operator/0.log" Jul 02 15:59:36.301358 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:36.301334 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z88z6_1e051a40-6245-4056-a110-3f1d066f2b8e/kube-rbac-proxy/0.log" Jul 02 15:59:36.326974 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:36.326949 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z88z6_1e051a40-6245-4056-a110-3f1d066f2b8e/exporter/0.log" Jul 02 15:59:36.353995 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:36.353914 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z88z6_1e051a40-6245-4056-a110-3f1d066f2b8e/extractor/0.log" Jul 02 15:59:38.259505 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:38.259467 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6c8ts_10281945-e36f-472a-bb8f-9f1e81882f25/manager/0.log" Jul 02 15:59:38.395284 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:38.395246 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4f645848-72hg7_f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3/manager/0.log" Jul 02 15:59:38.412383 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:38.412355 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4f645848-72hg7_f1bb39b4-8c95-4dd2-bc46-0d2c6c3695f3/copy-manifests/0.log" Jul 02 15:59:38.796702 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:38.796676 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6l2fx/perf-node-gather-daemonset-bwrtk" Jul 02 15:59:39.640248 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:39.640213 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66d8cd6446-95q27_0870e558-38bc-4c77-b03b-f8905408ad65/manager/0.log" Jul 02 15:59:42.023386 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:42.023307 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4b5qqq_477a089f-787f-41ea-b24d-a7c4a526b785/istio-proxy/0.log" Jul 02 15:59:42.100813 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:42.100780 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b98cdb9-29d86_7b856a5b-a8df-48dd-9578-c40e281f480e/router/0.log" Jul 02 15:59:43.106877 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:43.106846 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4b5qqq_477a089f-787f-41ea-b24d-a7c4a526b785/istio-proxy/0.log" Jul 02 15:59:43.197366 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:43.197323 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-668b98cdb9-29d86_7b856a5b-a8df-48dd-9578-c40e281f480e/router/0.log" Jul 02 15:59:45.188395 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:45.188344 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-c5lkj_f60e27cd-c881-41a3-9a58-d0423aaff80f/kube-storage-version-migrator-operator/1.log" Jul 02 15:59:45.190035 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:45.190014 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-c5lkj_f60e27cd-c881-41a3-9a58-d0423aaff80f/kube-storage-version-migrator-operator/0.log" Jul 02 15:59:46.459714 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.459686 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/kube-multus-additional-cni-plugins/0.log" Jul 02 15:59:46.480232 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.480204 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/egress-router-binary-copy/0.log" Jul 02 15:59:46.501241 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.501201 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/cni-plugins/0.log" Jul 02 15:59:46.525105 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.525079 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/bond-cni-plugin/0.log" Jul 02 15:59:46.549582 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.549549 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/routeoverride-cni/0.log" Jul 02 15:59:46.571212 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.571176 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/whereabouts-cni-bincopy/0.log" Jul 02 15:59:46.593395 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.593362 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vtnq7_5d91359e-696a-44b1-aa72-242bbc989802/whereabouts-cni/0.log" Jul 02 15:59:46.622396 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.622359 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xvsdx_1617fa55-96af-468c-90ee-53e97764869d/kube-multus/0.log" Jul 02 15:59:46.700246 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.700215 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2wh5p_51cccf36-504c-42d9-85ef-8ce5a4d7b270/network-metrics-daemon/0.log" Jul 02 15:59:46.720286 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:46.720208 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2wh5p_51cccf36-504c-42d9-85ef-8ce5a4d7b270/kube-rbac-proxy/0.log" Jul 02 15:59:47.811037 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.811004 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/ovn-controller/0.log" Jul 02 15:59:47.827609 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.827578 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/ovn-acl-logging/0.log" Jul 02 15:59:47.853687 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.853655 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/kube-rbac-proxy-node/0.log" Jul 02 15:59:47.874513 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.874483 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 15:59:47.892833 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.892802 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/northd/0.log" Jul 02 15:59:47.912545 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.912509 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/nbdb/0.log" Jul 02 15:59:47.933514 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.933479 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/sbdb/0.log" Jul 02 15:59:47.991319 ip-10-0-141-121 kubenswrapper[2571]: I0702 15:59:47.991270 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kmq5_0d4571b5-a9a3-4a52-89be-fb924dbf680d/ovnkube-controller/0.log"