Jul 17 13:56:25.605253 ip-10-0-134-16 systemd[1]: Starting Kubernetes Kubelet... Jul 17 13:56:25.896205 ip-10-0-134-16 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:25.896205 ip-10-0-134-16 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 13:56:25.896205 ip-10-0-134-16 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:25.896205 ip-10-0-134-16 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 13:56:25.896205 ip-10-0-134-16 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:25.897618 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.897478 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 13:56:25.903708 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903685 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:25.903708 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903703 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:25.903708 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903707 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:25.903708 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903716 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:25.903708 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903722 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:25.903708 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903725 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903728 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903731 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903733 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903736 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903738 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903742 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903745 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903747 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903750 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903752 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903755 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903757 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903760 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903765 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903772 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903775 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903777 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903780 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:25.903956 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903783 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903785 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903788 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903791 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903793 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903796 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903798 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903801 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903803 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903806 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903808 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903811 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903814 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903817 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903819 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903822 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903825 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903829 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903833 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:25.904410 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903835 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903839 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903842 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903844 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903847 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903849 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903852 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903854 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903857 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903860 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903862 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903865 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903867 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903870 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903872 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903875 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903878 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903880 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903883 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903885 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:25.904866 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903887 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903890 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903892 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903894 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903898 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903902 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903907 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903910 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903914 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903916 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903919 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903922 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903925 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903928 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903931 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903934 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903937 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903958 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903962 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:25.905371 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903965 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903968 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903971 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903974 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903976 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903979 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903982 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903984 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903987 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903989 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903991 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903994 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903996 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.903999 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904002 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904005 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904007 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904698 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904704 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904707 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:25.905831 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904710 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904714 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904716 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904719 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904721 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904724 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904727 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904729 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904732 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904734 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904736 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904739 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904741 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904744 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904747 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904751 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904756 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904759 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904762 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:25.906323 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904765 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904767 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904770 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904772 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904775 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904777 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904779 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904782 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904785 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904788 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904790 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904793 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904795 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904798 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904802 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904805 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904807 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904810 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904812 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904815 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:25.906789 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904817 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904820 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904822 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904825 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904827 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904830 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904832 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904834 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904838 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904840 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904843 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904845 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904847 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904851 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904854 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904857 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904859 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904862 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904864 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904867 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:25.907285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904870 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904872 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904875 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904877 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904881 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904883 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904886 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904889 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904891 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904893 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904896 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904898 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904901 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904903 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904905 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904908 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904910 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904913 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904915 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904917 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:25.907780 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904920 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904923 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904926 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904928 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904931 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904933 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904936 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904938 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904960 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904964 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904967 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904969 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904973 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904976 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904979 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904981 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.904984 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905356 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905363 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:25.908378 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905366 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905370 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905373 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905376 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905379 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905382 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905386 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905389 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905392 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905394 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905397 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905399 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905402 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905405 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905411 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905414 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905416 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905419 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905421 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:25.908839 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905423 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905426 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905430 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905433 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905435 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905438 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905441 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905444 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905446 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905449 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905451 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905454 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905456 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905459 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905461 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905463 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905466 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905468 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905471 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905473 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:25.909341 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905476 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905478 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905480 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905483 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905485 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905487 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905490 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905492 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905495 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905498 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905500 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905503 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905505 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905513 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905518 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905521 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905523 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905526 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905529 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:25.909815 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905532 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905535 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905537 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905540 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905542 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905545 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905547 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905550 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905553 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905555 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905558 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905560 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905562 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905565 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905567 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905569 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905572 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905574 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905576 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:25.910273 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905579 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905581 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905584 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905587 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905589 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905592 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905594 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905598 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905601 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905603 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905606 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905608 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905611 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905613 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905616 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905618 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905620 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905623 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905625 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.905628 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905698 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 13:56:25.910754 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905706 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905714 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905718 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905723 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905726 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905729 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905733 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905736 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905739 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905743 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905746 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905749 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905752 2558 flags.go:64] FLAG: --cgroup-root="" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905755 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905758 2558 flags.go:64] FLAG: --client-ca-file="" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905763 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905766 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905771 2558 flags.go:64] FLAG: --cluster-domain="" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905775 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905778 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905781 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905785 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905789 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 13:56:25.911271 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905792 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905794 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905797 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905800 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905803 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905806 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905809 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905812 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905816 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905819 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905822 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905824 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905827 2558 flags.go:64] FLAG: --enable-server="true" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905830 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905834 2558 flags.go:64] FLAG: --event-burst="100" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905838 2558 flags.go:64] FLAG: --event-qps="50" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905840 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905843 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905846 2558 flags.go:64] FLAG: --eviction-hard="" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905850 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905853 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905856 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905859 2558 flags.go:64] FLAG: --eviction-soft="" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905862 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905864 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 13:56:25.911811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905868 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905871 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905875 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905878 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905881 2558 flags.go:64] FLAG: --feature-gates="" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905884 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905887 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905890 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905893 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905895 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905898 2558 flags.go:64] FLAG: --help="false" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905901 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-16.ec2.internal" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905904 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905907 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905909 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905912 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905915 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905918 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905921 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905924 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905926 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905929 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905932 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905934 2558 flags.go:64] FLAG: --kube-reserved="" Jul 17 13:56:25.912465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905937 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905939 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905962 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905965 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905968 2558 flags.go:64] FLAG: --lock-file="" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905970 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905973 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905976 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905982 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905986 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905989 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905993 2558 flags.go:64] FLAG: --logging-format="text" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905996 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.905999 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906002 2558 flags.go:64] FLAG: --manifest-url="" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906005 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906009 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906012 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906016 2558 flags.go:64] FLAG: --max-pods="110" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906019 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906022 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906025 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906029 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906031 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906034 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 13:56:25.913049 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906037 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906044 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906047 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906050 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906053 2558 flags.go:64] FLAG: --pod-cidr="" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906055 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906060 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906063 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906066 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906069 2558 flags.go:64] FLAG: --port="10250" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906072 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906075 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc08712ada6905ba" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906078 2558 flags.go:64] FLAG: --qos-reserved="" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906080 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906083 2558 flags.go:64] FLAG: --register-node="true" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906086 2558 flags.go:64] FLAG: --register-with-taints="" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906089 2558 flags.go:64] FLAG: --registry-burst="10" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906092 2558 flags.go:64] FLAG: --registry-qps="5" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906097 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906099 2558 flags.go:64] FLAG: --reserved-memory="" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906103 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906106 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906109 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906112 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906114 2558 flags.go:64] FLAG: --runonce="false" Jul 17 13:56:25.913648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906117 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906120 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906122 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906125 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906128 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906130 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906133 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906136 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906138 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906141 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906143 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906146 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906149 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906151 2558 flags.go:64] FLAG: --system-cgroups="" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906154 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906159 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906162 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906164 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906169 2558 flags.go:64] FLAG: --tls-min-version="" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906171 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906174 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906177 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906180 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906182 2558 flags.go:64] FLAG: --v="2" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906186 2558 flags.go:64] FLAG: --version="false" Jul 17 13:56:25.914261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906192 2558 flags.go:64] FLAG: --vmodule="" Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906195 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906199 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906315 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906319 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906322 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906325 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906328 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906331 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906334 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906337 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906340 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906342 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906345 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906348 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906351 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906353 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906356 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906358 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906361 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:25.914861 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906363 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906367 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906370 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906373 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906376 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906379 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906381 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906383 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906388 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906391 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906394 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906397 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906401 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906404 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906407 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906410 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906412 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906415 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906418 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:25.915417 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906420 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906423 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906425 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906427 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906430 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906432 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906435 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906437 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906440 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906442 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906444 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906447 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906450 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906452 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906454 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906457 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906459 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906462 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906464 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906466 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:25.915913 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906469 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906472 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906475 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906478 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906480 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906484 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906486 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906489 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906492 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906494 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906496 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906499 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906501 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906503 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906506 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906508 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906510 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906513 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906515 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906518 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:25.916413 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906520 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906522 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906525 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906527 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906530 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906532 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906534 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906537 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906539 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906541 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906545 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906547 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906550 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906553 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906556 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906558 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906560 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906565 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906567 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906569 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:25.916894 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906572 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906575 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.906577 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.906582 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.913331 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.913348 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.913959 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.913967 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914024 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914030 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914033 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914036 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914039 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914042 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914045 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:25.917402 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914047 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914049 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914052 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914054 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914057 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914059 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914062 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914064 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914067 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914070 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914072 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914075 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914078 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914081 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914083 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914085 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914088 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914090 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914093 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914095 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:25.917765 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914098 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914100 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914104 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914106 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914109 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914111 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914114 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914116 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914118 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914121 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914123 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914126 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914128 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914131 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914133 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914136 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914138 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914140 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914143 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:25.918327 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914145 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914148 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914151 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914154 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914156 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914158 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914162 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914166 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914168 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914171 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914174 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914177 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914179 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914182 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914185 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914188 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914191 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914194 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914196 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914199 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:25.918783 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914201 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914204 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914206 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914208 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914211 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914213 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914216 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914220 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914222 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914225 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914228 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914231 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914233 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914235 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914238 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914241 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914243 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914246 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914248 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914251 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:25.919279 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914253 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914256 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914259 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914262 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914264 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914267 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914270 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914274 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914277 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914280 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914283 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914285 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914288 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.914293 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:25.919753 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914420 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914424 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914428 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914430 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914433 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914435 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914438 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914440 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914443 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914445 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914448 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914451 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914453 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914456 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914458 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914460 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914463 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914465 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914467 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914469 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:25.920115 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914472 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914475 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914479 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914482 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914485 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914488 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914490 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914492 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914495 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914499 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914502 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914505 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914508 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914511 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914513 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914516 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914519 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914521 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914524 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:25.920598 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914526 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914528 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914531 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914533 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914535 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914538 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914540 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914542 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914545 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914548 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914550 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914552 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914554 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914557 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914559 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914562 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914564 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914566 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914569 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914571 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:25.921062 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914574 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914576 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914579 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914582 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914584 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914588 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914591 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914594 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914597 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914599 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914602 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914604 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914607 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914609 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914611 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914614 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914616 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914618 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914621 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914623 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:25.921650 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914626 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914628 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914631 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914633 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914636 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914638 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914641 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914643 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914646 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914648 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914651 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914653 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914655 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914658 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914660 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914665 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914668 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914670 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914673 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:25.922431 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:25.914675 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.914680 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.914785 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.916622 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.917631 2558 server.go:1019] "Starting client certificate rotation" Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.917737 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.917774 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.919908 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:56:25.923033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.922743 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:56:25.929431 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.929412 2558 log.go:25] "Validated CRI v1 runtime API" Jul 17 13:56:25.931268 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.931255 2558 log.go:25] "Validated CRI v1 image API" Jul 17 13:56:25.932426 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.932410 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 13:56:25.934732 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.934715 2558 fs.go:135] Filesystem UUIDs: map[69147f92-ddf6-45b0-a4ee-a2f55d0a7690:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7d56bc78-02f4-42c9-9870-be2e490cbc5b:/dev/nvme0n1p4] Jul 17 13:56:25.934780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.934732 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 13:56:25.939492 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.939383 2558 manager.go:216] Machine: {Timestamp:2026-07-17 13:56:25.938303683 +0000 UTC m=+0.242528169 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101481 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec227f328795f5a2c9395a83aefde1a3 SystemUUID:ec227f32-8795-f5a2-c939-5a83aefde1a3 BootID:7e80e1ec-3183-4651-bdca-28fb997ea41c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8b:2f:d1:76:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8b:2f:d1:76:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:ac:29:d7:e5:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 13:56:25.939492 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.939491 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 13:56:25.939597 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.939570 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 13:56:25.941916 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.941888 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 13:56:25.942070 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.941922 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-16.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 13:56:25.942515 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.942506 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 13:56:25.942543 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.942518 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 13:56:25.942543 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.942525 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:56:25.943016 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.943007 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:56:25.944055 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.944046 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 13:56:25.947513 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947498 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:56:25.947633 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947623 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 13:56:25.947676 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947654 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 17 13:56:25.947676 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947664 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 13:56:25.947770 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947681 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 13:56:25.947770 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947694 2558 kubelet.go:398] "Adding apiserver pod source" Jul 17 13:56:25.947770 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947705 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 13:56:25.947912 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.947893 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:56:25.948315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.948297 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:56:25.948315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.948323 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:56:25.949992 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.949974 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 13:56:25.951184 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951169 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 13:56:25.951248 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951205 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 13:56:25.951746 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951735 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 13:56:25.951778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951752 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 13:56:25.951778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951758 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 13:56:25.951778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951763 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 13:56:25.951778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951772 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 13:56:25.951778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951777 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 13:56:25.951906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951786 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 13:56:25.951906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951791 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 13:56:25.951906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951797 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 13:56:25.951906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951802 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 13:56:25.951906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951810 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 13:56:25.951906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.951815 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 13:56:25.952379 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.952366 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 13:56:25.952417 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.952381 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 13:56:25.957137 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.957123 2558 server.go:1268] "Started kubelet" Jul 17 13:56:25.957267 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.957245 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 13:56:25.957368 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.957327 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 13:56:25.957412 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.957395 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 13:56:25.958222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.958191 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-16.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 13:56:25.958594 ip-10-0-134-16 systemd[1]: Started Kubernetes Kubelet. Jul 17 13:56:25.958763 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.958626 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 13:56:25.958763 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.958727 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 13:56:25.958957 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.958928 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 17 13:56:25.960223 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.960204 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 13:56:25.961340 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.961313 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 13:56:25.963242 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.962564 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-16.ec2.internal.18c3184a93ea3a9b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-16.ec2.internal,UID:ip-10-0-134-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-16.ec2.internal,},FirstTimestamp:2026-07-17 13:56:25.957096091 +0000 UTC m=+0.261320575,LastTimestamp:2026-07-17 13:56:25.957096091 +0000 UTC m=+0.261320575,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-16.ec2.internal,}" Jul 17 13:56:25.964875 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.964860 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 13:56:25.964963 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.964874 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 13:56:25.965025 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.965009 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:25.965504 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.965462 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 13:56:25.965504 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.965484 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 13:56:25.965504 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.965495 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 13:56:25.965684 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.965668 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 17 13:56:25.965684 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.965680 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 17 13:56:25.966100 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966082 2558 factory.go:55] Registering systemd factory Jul 17 13:56:25.966100 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966103 2558 factory.go:223] Registration of the systemd container factory successfully Jul 17 13:56:25.966333 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966318 2558 factory.go:153] Registering CRI-O factory Jul 17 13:56:25.966394 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966336 2558 factory.go:223] Registration of the crio container factory successfully Jul 17 13:56:25.966446 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966397 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 13:56:25.966446 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966419 2558 factory.go:103] Registering Raw factory Jul 17 13:56:25.966446 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.966437 2558 manager.go:1196] Started watching for new ooms in manager Jul 17 13:56:25.967107 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.967093 2558 manager.go:349] Starting recovery of all containers Jul 17 13:56:25.969321 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.969298 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-16.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 13:56:25.970177 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.970152 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 13:56:25.978372 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.978351 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-969lm" Jul 17 13:56:25.978660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.978643 2558 manager.go:354] Recovery completed Jul 17 13:56:25.983484 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.983469 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:25.984083 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.984069 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-969lm" Jul 17 13:56:25.985446 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.985428 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:25.985531 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.985463 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:25.985531 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.985473 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:25.985997 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.985978 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 13:56:25.985997 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.985988 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:25.985997 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.985995 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 13:56:25.986113 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.986012 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:56:25.986658 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.986644 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:25.986712 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.986669 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:25.986712 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.986679 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:25.987737 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:25.987650 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-16.ec2.internal.18c3184a959accfa default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-16.ec2.internal,UID:ip-10-0-134-16.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-16.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-16.ec2.internal,},FirstTimestamp:2026-07-17 13:56:25.985445114 +0000 UTC m=+0.289669604,LastTimestamp:2026-07-17 13:56:25.985445114 +0000 UTC m=+0.289669604,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-16.ec2.internal,}" Jul 17 13:56:25.988915 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.988902 2558 policy_none.go:49] "None policy: Start" Jul 17 13:56:25.988988 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.988918 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 13:56:25.988988 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.988929 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 13:56:25.990999 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:25.990985 2558 policy_none.go:47] "Start" Jul 17 13:56:26.030788 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.030576 2558 manager.go:337] "Starting Device Plugin manager" Jul 17 13:56:26.030927 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.030822 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 13:56:26.030927 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.030836 2558 server.go:87] "Starting device plugin registration server" Jul 17 13:56:26.031152 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.031141 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 13:56:26.031183 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.031156 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 13:56:26.031310 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.031289 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 13:56:26.031423 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.031382 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 13:56:26.031423 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.031392 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 13:56:26.031933 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.031913 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 13:56:26.032021 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.031979 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.131485 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.131453 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:26.133699 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.132458 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:26.133699 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.132493 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:26.133699 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.132503 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:26.133699 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.132529 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.139640 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.139614 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 13:56:26.139972 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.139931 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.140071 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.139984 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-16.ec2.internal\": node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.141095 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.141081 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 13:56:26.141158 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.141124 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 13:56:26.141158 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.141151 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 13:56:26.141249 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.141190 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 13:56:26.143696 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.143674 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:26.207677 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.207594 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.241709 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.241675 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal"] Jul 17 13:56:26.241853 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.241755 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:26.242791 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.242778 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:26.242833 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.242822 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:26.242875 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.242834 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:26.245212 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.245200 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:26.245330 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.245317 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.245368 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.245344 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:26.246020 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.245998 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:26.246121 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.245998 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:26.246121 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.246036 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:26.246121 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.246048 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:26.246121 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.246053 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:26.246121 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.246062 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:26.248284 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.248269 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.248364 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.248293 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:26.248931 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.248912 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:26.249034 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.248964 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:26.249034 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.248979 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:26.259454 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.259435 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-16.ec2.internal\" not found" node="ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.262802 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.262785 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-16.ec2.internal\" not found" node="ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.267239 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.267221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3e9fe71abb26609a391ecb4a06dc6f1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-16.ec2.internal\" (UID: \"e3e9fe71abb26609a391ecb4a06dc6f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.267311 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.267246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db69650ddb5c4800f0a495957d25812f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal\" (UID: \"db69650ddb5c4800f0a495957d25812f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.267311 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.267264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db69650ddb5c4800f0a495957d25812f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal\" (UID: \"db69650ddb5c4800f0a495957d25812f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.307856 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.307825 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.368389 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.368362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db69650ddb5c4800f0a495957d25812f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal\" (UID: \"db69650ddb5c4800f0a495957d25812f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.368479 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.368391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3e9fe71abb26609a391ecb4a06dc6f1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-16.ec2.internal\" (UID: \"e3e9fe71abb26609a391ecb4a06dc6f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.368479 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.368409 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db69650ddb5c4800f0a495957d25812f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal\" (UID: \"db69650ddb5c4800f0a495957d25812f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.368479 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.368436 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db69650ddb5c4800f0a495957d25812f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal\" (UID: \"db69650ddb5c4800f0a495957d25812f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.368479 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.368454 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db69650ddb5c4800f0a495957d25812f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal\" (UID: \"db69650ddb5c4800f0a495957d25812f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.368617 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.368473 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e3e9fe71abb26609a391ecb4a06dc6f1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-16.ec2.internal\" (UID: \"e3e9fe71abb26609a391ecb4a06dc6f1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.408866 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.408837 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.509707 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.509628 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.560759 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.560734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.566748 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.566727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" Jul 17 13:56:26.610367 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.610334 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.710881 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.710839 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.811374 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.811303 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.891024 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.891001 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:26.912378 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:26.912343 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:26.917517 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.917495 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 13:56:26.917640 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.917621 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:56:26.917677 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.917659 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:56:26.988532 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.988497 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 13:51:26 +0000 UTC" deadline="2028-02-08 23:36:47.093661418 +0000 UTC" Jul 17 13:56:26.988532 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:26.988527 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13713h40m20.10513838s" Jul 17 13:56:27.012680 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:27.012652 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-16.ec2.internal\" not found" Jul 17 13:56:27.074749 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.074673 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:27.085720 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:27.085691 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e9fe71abb26609a391ecb4a06dc6f1.slice/crio-23b77c492e5b9b7c27f5273628ddcf07ffa371caeec382fc5808c5da02f070f7 WatchSource:0}: Error finding container 23b77c492e5b9b7c27f5273628ddcf07ffa371caeec382fc5808c5da02f070f7: Status 404 returned error can't find the container with id 23b77c492e5b9b7c27f5273628ddcf07ffa371caeec382fc5808c5da02f070f7 Jul 17 13:56:27.086030 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:27.086009 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb69650ddb5c4800f0a495957d25812f.slice/crio-ce625a7890f50b96751ab3dc5113ec30fa25d50375fef381b5d8299d0b6d47e9 WatchSource:0}: Error finding container ce625a7890f50b96751ab3dc5113ec30fa25d50375fef381b5d8299d0b6d47e9: Status 404 returned error can't find the container with id ce625a7890f50b96751ab3dc5113ec30fa25d50375fef381b5d8299d0b6d47e9 Jul 17 13:56:27.091318 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.091250 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:56:27.146423 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.146367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" event={"ID":"db69650ddb5c4800f0a495957d25812f","Type":"ContainerStarted","Data":"ce625a7890f50b96751ab3dc5113ec30fa25d50375fef381b5d8299d0b6d47e9"} Jul 17 13:56:27.147465 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.147443 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" event={"ID":"e3e9fe71abb26609a391ecb4a06dc6f1","Type":"ContainerStarted","Data":"23b77c492e5b9b7c27f5273628ddcf07ffa371caeec382fc5808c5da02f070f7"} Jul 17 13:56:27.165636 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.165610 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" Jul 17 13:56:27.178506 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.178486 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:56:27.179990 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.179976 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" Jul 17 13:56:27.188992 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.188969 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:56:27.304548 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.304515 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:27.772759 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.772726 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:27.949780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.949749 2558 apiserver.go:52] "Watching apiserver" Jul 17 13:56:27.959372 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.959348 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 13:56:27.959800 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.959768 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal","openshift-multus/multus-additional-cni-plugins-lkxgv","openshift-dns/node-resolver-xp828","openshift-image-registry/node-ca-cnv6g","openshift-multus/multus-j7bgz","openshift-multus/network-metrics-daemon-pjbcl","openshift-network-diagnostics/network-check-target-87p6v","openshift-network-operator/iptables-alerter-hh659","openshift-ovn-kubernetes/ovnkube-node-sf8nn","kube-system/global-pull-secret-syncer-k9p82","kube-system/konnectivity-agent-px25f","kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq","openshift-cluster-node-tuning-operator/tuned-nj9rr"] Jul 17 13:56:27.962618 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.962595 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:27.962760 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:27.962683 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:27.965847 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.965822 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 13:56:27.965962 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.965894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.968839 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.968296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:27.969223 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.969199 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 13:56:27.969478 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.969462 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 13:56:27.969872 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.969851 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qpvqf\"" Jul 17 13:56:27.969991 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.969977 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.970485 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.970466 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:27.970796 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.970754 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.971323 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.971131 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rnfj\"" Jul 17 13:56:27.971411 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.971386 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 13:56:27.973469 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.973448 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7bgz" Jul 17 13:56:27.974330 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.973793 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9qjq\"" Jul 17 13:56:27.974330 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.974078 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.974520 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.974426 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 13:56:27.974520 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.974437 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 13:56:27.976007 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.975990 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:27.976121 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:27.976065 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:27.976193 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.976151 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.976860 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.976835 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5f86\"" Jul 17 13:56:27.977236 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.977218 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 13:56:27.977332 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.977297 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:56:27.978010 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.977988 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 13:56:27.978509 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.978271 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.978638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-sys-fs\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60ab99af-b28e-46ef-89b4-f9764467afd5-hosts-file\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt9sz\" (UniqueName: \"kubernetes.io/projected/60ab99af-b28e-46ef-89b4-f9764467afd5-kube-api-access-dt9sz\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-registration-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-device-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-etc-selinux\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5694\" (UniqueName: \"kubernetes.io/projected/10a100dd-e35b-408a-91ec-b638776fdddd-kube-api-access-r5694\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab99af-b28e-46ef-89b4-f9764467afd5-tmp-dir\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:27.979604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.979483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-socket-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:27.981890 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.981583 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:27.981890 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.981750 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.982058 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.982035 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 13:56:27.982058 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.982046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 13:56:27.982419 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.982397 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8cg6\"" Jul 17 13:56:27.983759 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.983428 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 13:56:27.983759 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.983504 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 13:56:27.983759 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.983714 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 13:56:27.984325 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.984292 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:27.987691 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.987675 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:27.989813 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.989669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:27.989813 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:27.989752 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:27.991695 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.991674 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:27.992183 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.991756 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.992183 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.991793 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 13:56:27.992497 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.992460 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:27.992955 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.992927 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z6dwj\"" Jul 17 13:56:27.993064 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.993038 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 13:56:27.993190 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.993174 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 13:56:27.993309 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.993274 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qvww4\"" Jul 17 13:56:27.993512 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.993424 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 13:56:27.993612 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.993516 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 13:56:27.993694 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.993673 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wtc7c\"" Jul 17 13:56:27.994824 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.994772 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:27.994913 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.994860 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6wfw9\"" Jul 17 13:56:27.995528 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:27.995491 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:28.011578 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.011555 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbwgf" Jul 17 13:56:28.019294 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.019275 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbwgf" Jul 17 13:56:28.067204 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.067180 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 13:56:28.079675 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.079648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.079827 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.079679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84926149-0ab6-4860-b50f-953947c3662d-host-slash\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.079827 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.079707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysctl-conf\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.079827 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.079731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95cbed5b-456c-4238-809c-84ad9160bc6c-tmp\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.080011 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.079994 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-device-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.080234 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-hostroot\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.080300 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-daemon-config\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.080300 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-kubelet\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.080464 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080312 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-etc-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.080464 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjwh\" (UniqueName: \"kubernetes.io/projected/57d54756-8102-4290-9421-76f8e6cf35ba-kube-api-access-vrjwh\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.080464 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppdnd\" (UniqueName: \"kubernetes.io/projected/da2a5494-1918-4868-908b-d8da3b8e555a-kube-api-access-ppdnd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.080464 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.080678 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080534 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-device-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.080678 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvpg\" (UniqueName: \"kubernetes.io/projected/80fd97b5-28ff-41f5-a5c3-165adb0a9658-kube-api-access-tjvpg\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.080780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-sys\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.080780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-lib-modules\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.080880 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-netns\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.080880 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-systemd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.080880 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081050 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-ovnkube-config\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081050 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a7db551-5085-4639-951b-cfb8e086fbea-agent-certs\") pod \"konnectivity-agent-px25f\" (UID: \"5a7db551-5085-4639-951b-cfb8e086fbea\") " pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.081050 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a7db551-5085-4639-951b-cfb8e086fbea-konnectivity-ca\") pod \"konnectivity-agent-px25f\" (UID: \"5a7db551-5085-4639-951b-cfb8e086fbea\") " pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.081050 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.080993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-modprobe-d\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.081050 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-var-lib-kubelet\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d54756-8102-4290-9421-76f8e6cf35ba-host\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-systemd-units\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-slash\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-cni-bin\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da2a5494-1918-4868-908b-d8da3b8e555a-ovn-node-metrics-cert\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eebe6ce6-e0a9-4843-8637-50442dae55cc-kubelet-config\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.081315 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-multus-certs\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-env-overrides\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-log-socket\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cnibin\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysconfig\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-systemd\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq6w5\" (UniqueName: \"kubernetes.io/projected/95cbed5b-456c-4238-809c-84ad9160bc6c-kube-api-access-pq6w5\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.081660 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-etc-selinux\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-conf-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84926149-0ab6-4860-b50f-953947c3662d-iptables-alerter-script\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eebe6ce6-e0a9-4843-8637-50442dae55cc-dbus\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-kubernetes\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081834 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysctl-d\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-sys-fs\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.082177 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.081929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60ab99af-b28e-46ef-89b4-f9764467afd5-hosts-file\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.082898 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.082870 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-sys-fs\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.083062 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.082934 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d54756-8102-4290-9421-76f8e6cf35ba-serviceca\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.083062 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.082995 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-etc-selinux\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.083062 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.082994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-var-lib-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.083228 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.083228 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-os-release\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.083228 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.083382 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083242 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-registration-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.083382 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-k8s-cni-cncf-io\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.083488 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083409 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60ab99af-b28e-46ef-89b4-f9764467afd5-hosts-file\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.083488 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-run\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.083607 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083575 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-registration-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.083662 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-socket-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.083721 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt9sz\" (UniqueName: \"kubernetes.io/projected/60ab99af-b28e-46ef-89b4-f9764467afd5-kube-api-access-dt9sz\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.083780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083718 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-socket-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.083780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-cni-bin\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.083888 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083779 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2n6\" (UniqueName: \"kubernetes.io/projected/84926149-0ab6-4860-b50f-953947c3662d-kube-api-access-tf2n6\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.083888 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-cni-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.084004 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-etc-kubernetes\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.084004 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.083978 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-cnibin\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.084128 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.084047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/103dfdec-f2be-4ef0-96cd-c79da288d4ea-cni-binary-copy\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.084128 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.084086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-socket-dir-parent\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.084239 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.084156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:28.084239 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.084189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-system-cni-dir\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.085341 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-kubelet\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.085459 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttcz\" (UniqueName: \"kubernetes.io/projected/103dfdec-f2be-4ef0-96cd-c79da288d4ea-kube-api-access-lttcz\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.085459 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085386 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10a100dd-e35b-408a-91ec-b638776fdddd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.085459 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-run-netns\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.085625 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.085625 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-node-log\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.085722 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-ovnkube-script-lib\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.085722 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-tuned\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.085806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-cni-multus\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.085853 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5694\" (UniqueName: \"kubernetes.io/projected/10a100dd-e35b-408a-91ec-b638776fdddd-kube-api-access-r5694\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.086269 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.085888 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab99af-b28e-46ef-89b4-f9764467afd5-tmp-dir\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.086354 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-os-release\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.086354 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086319 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqtvg\" (UniqueName: \"kubernetes.io/projected/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-kube-api-access-vqtvg\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:28.086354 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-ovn\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.086523 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-cni-netd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.086523 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-host\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.086523 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-system-cni-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.086664 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.086592 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab99af-b28e-46ef-89b4-f9764467afd5-tmp-dir\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.093909 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.093890 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:28.094073 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.093914 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:28.094073 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.093929 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:28.094073 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.093997 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:28.593980657 +0000 UTC m=+2.898205131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:28.094292 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.094146 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 13:56:28.097906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.097883 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5694\" (UniqueName: \"kubernetes.io/projected/10a100dd-e35b-408a-91ec-b638776fdddd-kube-api-access-r5694\") pod \"aws-ebs-csi-driver-node-87cbq\" (UID: \"10a100dd-e35b-408a-91ec-b638776fdddd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.098011 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.097893 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt9sz\" (UniqueName: \"kubernetes.io/projected/60ab99af-b28e-46ef-89b4-f9764467afd5-kube-api-access-dt9sz\") pod \"node-resolver-xp828\" (UID: \"60ab99af-b28e-46ef-89b4-f9764467afd5\") " pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.186882 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.186844 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.187090 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.186892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysconfig\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187090 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.186917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-systemd\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187090 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.186942 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq6w5\" (UniqueName: \"kubernetes.io/projected/95cbed5b-456c-4238-809c-84ad9160bc6c-kube-api-access-pq6w5\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187090 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187048 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysconfig\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-conf-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187120 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-systemd\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187153 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84926149-0ab6-4860-b50f-953947c3662d-iptables-alerter-script\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187188 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-conf-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eebe6ce6-e0a9-4843-8637-50442dae55cc-dbus\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eebe6ce6-e0a9-4843-8637-50442dae55cc-dbus\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.187327 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-kubernetes\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysctl-d\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187397 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d54756-8102-4290-9421-76f8e6cf35ba-serviceca\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187398 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-var-lib-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187477 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-os-release\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187529 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-k8s-cni-cncf-io\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-run\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187606 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-kubernetes\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187617 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-cni-bin\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2n6\" (UniqueName: \"kubernetes.io/projected/84926149-0ab6-4860-b50f-953947c3662d-kube-api-access-tf2n6\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-run-ovn-kubernetes\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-k8s-cni-cncf-io\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.187707 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187711 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-var-lib-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187561 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysctl-d\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187732 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-os-release\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.187761 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-cni-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-run\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-etc-kubernetes\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187807 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187822 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-cni-bin\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.187827 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:56:28.687808455 +0000 UTC m=+2.992032945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187849 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-cnibin\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187868 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84926149-0ab6-4860-b50f-953947c3662d-iptables-alerter-script\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187883 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-etc-kubernetes\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-cnibin\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/103dfdec-f2be-4ef0-96cd-c79da288d4ea-cni-binary-copy\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-cni-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-socket-dir-parent\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188375 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.187987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188015 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-system-cni-dir\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-kubelet\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttcz\" (UniqueName: \"kubernetes.io/projected/103dfdec-f2be-4ef0-96cd-c79da288d4ea-kube-api-access-lttcz\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188096 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-socket-dir-parent\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-run-netns\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188161 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-run-netns\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.188204 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188129 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-system-cni-dir\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-node-log\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188208 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57d54756-8102-4290-9421-76f8e6cf35ba-serviceca\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.188254 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:56:28.688237388 +0000 UTC m=+2.992461864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-kubelet\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-ovnkube-script-lib\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-tuned\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-cni-multus\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.188924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-os-release\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtvg\" (UniqueName: \"kubernetes.io/projected/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-kube-api-access-vqtvg\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188423 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-ovn\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-cni-netd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188430 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-var-lib-cni-multus\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-host\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-system-cni-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84926149-0ab6-4860-b50f-953947c3662d-host-slash\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysctl-conf\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95cbed5b-456c-4238-809c-84ad9160bc6c-tmp\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188642 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/103dfdec-f2be-4ef0-96cd-c79da288d4ea-cni-binary-copy\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-hostroot\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188666 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188685 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-daemon-config\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-kubelet\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188729 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-os-release\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.189971 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-etc-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjwh\" (UniqueName: \"kubernetes.io/projected/57d54756-8102-4290-9421-76f8e6cf35ba-kube-api-access-vrjwh\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188798 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppdnd\" (UniqueName: \"kubernetes.io/projected/da2a5494-1918-4868-908b-d8da3b8e555a-kube-api-access-ppdnd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188820 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-sysctl-conf\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188852 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-host\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvpg\" (UniqueName: \"kubernetes.io/projected/80fd97b5-28ff-41f5-a5c3-165adb0a9658-kube-api-access-tjvpg\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188889 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-system-cni-dir\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-node-log\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-sys\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-lib-modules\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188944 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84926149-0ab6-4860-b50f-953947c3662d-host-slash\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.188959 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-netns\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189002 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-cni-netd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189057 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-netns\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189070 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-ovnkube-script-lib\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.190877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-systemd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-etc-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189184 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-openvswitch\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189208 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-sys\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189264 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-systemd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189298 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-hostroot\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189312 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-lib-modules\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189361 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-run-ovn\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-ovnkube-config\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189403 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-kubelet\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189422 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/103dfdec-f2be-4ef0-96cd-c79da288d4ea-multus-daemon-config\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a7db551-5085-4639-951b-cfb8e086fbea-agent-certs\") pod \"konnectivity-agent-px25f\" (UID: \"5a7db551-5085-4639-951b-cfb8e086fbea\") " pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189491 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a7db551-5085-4639-951b-cfb8e086fbea-konnectivity-ca\") pod \"konnectivity-agent-px25f\" (UID: \"5a7db551-5085-4639-951b-cfb8e086fbea\") " pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-modprobe-d\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-var-lib-kubelet\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d54756-8102-4290-9421-76f8e6cf35ba-host\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-systemd-units\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.191637 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-slash\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-cni-bin\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da2a5494-1918-4868-908b-d8da3b8e555a-ovn-node-metrics-cert\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189735 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eebe6ce6-e0a9-4843-8637-50442dae55cc-kubelet-config\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-multus-certs\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189792 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-env-overrides\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189808 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-ovnkube-config\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-log-socket\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189854 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-systemd-units\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189899 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-slash\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189898 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-log-socket\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cnibin\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.189939 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da2a5494-1918-4868-908b-d8da3b8e555a-host-cni-bin\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190004 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cni-binary-copy\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190038 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-modprobe-d\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190044 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80fd97b5-28ff-41f5-a5c3-165adb0a9658-cnibin\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190076 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d54756-8102-4290-9421-76f8e6cf35ba-host\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190115 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/103dfdec-f2be-4ef0-96cd-c79da288d4ea-host-run-multus-certs\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.192214 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190160 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eebe6ce6-e0a9-4843-8637-50442dae55cc-kubelet-config\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190436 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da2a5494-1918-4868-908b-d8da3b8e555a-env-overrides\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190529 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95cbed5b-456c-4238-809c-84ad9160bc6c-var-lib-kubelet\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.190549 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a7db551-5085-4639-951b-cfb8e086fbea-konnectivity-ca\") pod \"konnectivity-agent-px25f\" (UID: \"5a7db551-5085-4639-951b-cfb8e086fbea\") " pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.191661 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95cbed5b-456c-4238-809c-84ad9160bc6c-etc-tuned\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.191718 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95cbed5b-456c-4238-809c-84ad9160bc6c-tmp\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.192690 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a7db551-5085-4639-951b-cfb8e086fbea-agent-certs\") pod \"konnectivity-agent-px25f\" (UID: \"5a7db551-5085-4639-951b-cfb8e086fbea\") " pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.192806 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.192768 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da2a5494-1918-4868-908b-d8da3b8e555a-ovn-node-metrics-cert\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.196032 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.195989 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq6w5\" (UniqueName: \"kubernetes.io/projected/95cbed5b-456c-4238-809c-84ad9160bc6c-kube-api-access-pq6w5\") pod \"tuned-nj9rr\" (UID: \"95cbed5b-456c-4238-809c-84ad9160bc6c\") " pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.198108 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.198012 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttcz\" (UniqueName: \"kubernetes.io/projected/103dfdec-f2be-4ef0-96cd-c79da288d4ea-kube-api-access-lttcz\") pod \"multus-j7bgz\" (UID: \"103dfdec-f2be-4ef0-96cd-c79da288d4ea\") " pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.199799 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.199774 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2n6\" (UniqueName: \"kubernetes.io/projected/84926149-0ab6-4860-b50f-953947c3662d-kube-api-access-tf2n6\") pod \"iptables-alerter-hh659\" (UID: \"84926149-0ab6-4860-b50f-953947c3662d\") " pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.201017 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.200969 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppdnd\" (UniqueName: \"kubernetes.io/projected/da2a5494-1918-4868-908b-d8da3b8e555a-kube-api-access-ppdnd\") pod \"ovnkube-node-sf8nn\" (UID: \"da2a5494-1918-4868-908b-d8da3b8e555a\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.201424 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.201405 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvpg\" (UniqueName: \"kubernetes.io/projected/80fd97b5-28ff-41f5-a5c3-165adb0a9658-kube-api-access-tjvpg\") pod \"multus-additional-cni-plugins-lkxgv\" (UID: \"80fd97b5-28ff-41f5-a5c3-165adb0a9658\") " pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.202033 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.202006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqtvg\" (UniqueName: \"kubernetes.io/projected/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-kube-api-access-vqtvg\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:28.205309 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.205287 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjwh\" (UniqueName: \"kubernetes.io/projected/57d54756-8102-4290-9421-76f8e6cf35ba-kube-api-access-vrjwh\") pod \"node-ca-cnv6g\" (UID: \"57d54756-8102-4290-9421-76f8e6cf35ba\") " pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.280408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.280312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" Jul 17 13:56:28.291526 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.291496 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xp828" Jul 17 13:56:28.302551 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.302525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cnv6g" Jul 17 13:56:28.309575 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.309551 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7bgz" Jul 17 13:56:28.316807 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.316786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:28.324780 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.324752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hh659" Jul 17 13:56:28.333768 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.333728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" Jul 17 13:56:28.340822 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.340799 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:28.348169 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.348146 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" Jul 17 13:56:28.694379 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.694287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:28.694379 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.694352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:28.694379 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:28.694379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694488 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694514 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694491 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694565 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:56:29.694550673 +0000 UTC m=+3.998775146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694565 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694580 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:56:29.694573199 +0000 UTC m=+3.998797672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694584 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:28.694682 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:28.694633 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:29.694614711 +0000 UTC m=+3.998839201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:29.023398 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.023268 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:51:28 +0000 UTC" deadline="2028-04-04 10:47:44.597256166 +0000 UTC" Jul 17 13:56:29.023398 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.023342 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15044h51m15.573918839s" Jul 17 13:56:29.112133 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.112092 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a100dd_e35b_408a_91ec_b638776fdddd.slice/crio-5744ad9c2b663f502b14cbcbec63d327fb32722e72ee900ab5b60e8bb6f7dd2e WatchSource:0}: Error finding container 5744ad9c2b663f502b14cbcbec63d327fb32722e72ee900ab5b60e8bb6f7dd2e: Status 404 returned error can't find the container with id 5744ad9c2b663f502b14cbcbec63d327fb32722e72ee900ab5b60e8bb6f7dd2e Jul 17 13:56:29.112901 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.112625 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84926149_0ab6_4860_b50f_953947c3662d.slice/crio-5ce16e0731060cfb66a39e4a09542cb329688cb05048e9a049435c0d2a8c6b50 WatchSource:0}: Error finding container 5ce16e0731060cfb66a39e4a09542cb329688cb05048e9a049435c0d2a8c6b50: Status 404 returned error can't find the container with id 5ce16e0731060cfb66a39e4a09542cb329688cb05048e9a049435c0d2a8c6b50 Jul 17 13:56:29.114658 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.114604 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7db551_5085_4639_951b_cfb8e086fbea.slice/crio-8df6d8af1e424eabc9767ec403e92a2407fbed1c6ad5d650d02cdf3bfa481c15 WatchSource:0}: Error finding container 8df6d8af1e424eabc9767ec403e92a2407fbed1c6ad5d650d02cdf3bfa481c15: Status 404 returned error can't find the container with id 8df6d8af1e424eabc9767ec403e92a2407fbed1c6ad5d650d02cdf3bfa481c15 Jul 17 13:56:29.117551 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.117523 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d54756_8102_4290_9421_76f8e6cf35ba.slice/crio-a4b60caf9f022805da2e4e152fbc4b330743ac6ddeb51e129828f31dd0954100 WatchSource:0}: Error finding container a4b60caf9f022805da2e4e152fbc4b330743ac6ddeb51e129828f31dd0954100: Status 404 returned error can't find the container with id a4b60caf9f022805da2e4e152fbc4b330743ac6ddeb51e129828f31dd0954100 Jul 17 13:56:29.139535 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.139507 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103dfdec_f2be_4ef0_96cd_c79da288d4ea.slice/crio-f1b48f77f6450e44ea9d145d4646b22e38c5b5b886bf14e4f90e37b9c7181394 WatchSource:0}: Error finding container f1b48f77f6450e44ea9d145d4646b22e38c5b5b886bf14e4f90e37b9c7181394: Status 404 returned error can't find the container with id f1b48f77f6450e44ea9d145d4646b22e38c5b5b886bf14e4f90e37b9c7181394 Jul 17 13:56:29.140316 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.140283 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fd97b5_28ff_41f5_a5c3_165adb0a9658.slice/crio-58ee7b20ca04e86ed8edef84ed3414d332eb6025aa80fe89431cc4bcfa62efb8 WatchSource:0}: Error finding container 58ee7b20ca04e86ed8edef84ed3414d332eb6025aa80fe89431cc4bcfa62efb8: Status 404 returned error can't find the container with id 58ee7b20ca04e86ed8edef84ed3414d332eb6025aa80fe89431cc4bcfa62efb8 Jul 17 13:56:29.141452 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.141400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:29.141560 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.141532 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:29.141904 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.141859 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2a5494_1918_4868_908b_d8da3b8e555a.slice/crio-2ac269c2df88e652ed7bc0a80430e8795fc49e8c24a9d62ef915851250ce0b69 WatchSource:0}: Error finding container 2ac269c2df88e652ed7bc0a80430e8795fc49e8c24a9d62ef915851250ce0b69: Status 404 returned error can't find the container with id 2ac269c2df88e652ed7bc0a80430e8795fc49e8c24a9d62ef915851250ce0b69 Jul 17 13:56:29.143711 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.143687 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cbed5b_456c_4238_809c_84ad9160bc6c.slice/crio-b0675847b62108b120898997f572f3118327f65e723fa7ef8da274eeb5ee56cc WatchSource:0}: Error finding container b0675847b62108b120898997f572f3118327f65e723fa7ef8da274eeb5ee56cc: Status 404 returned error can't find the container with id b0675847b62108b120898997f572f3118327f65e723fa7ef8da274eeb5ee56cc Jul 17 13:56:29.144472 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:56:29.144449 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ab99af_b28e_46ef_89b4_f9764467afd5.slice/crio-c4ebd7cc2eb3bff31f892569944da590c08536eec88030d14781af5d81a5893c WatchSource:0}: Error finding container c4ebd7cc2eb3bff31f892569944da590c08536eec88030d14781af5d81a5893c: Status 404 returned error can't find the container with id c4ebd7cc2eb3bff31f892569944da590c08536eec88030d14781af5d81a5893c Jul 17 13:56:29.151469 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.151445 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hh659" event={"ID":"84926149-0ab6-4860-b50f-953947c3662d","Type":"ContainerStarted","Data":"5ce16e0731060cfb66a39e4a09542cb329688cb05048e9a049435c0d2a8c6b50"} Jul 17 13:56:29.152831 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.152805 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" event={"ID":"95cbed5b-456c-4238-809c-84ad9160bc6c","Type":"ContainerStarted","Data":"b0675847b62108b120898997f572f3118327f65e723fa7ef8da274eeb5ee56cc"} Jul 17 13:56:29.154168 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.154085 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnv6g" event={"ID":"57d54756-8102-4290-9421-76f8e6cf35ba","Type":"ContainerStarted","Data":"a4b60caf9f022805da2e4e152fbc4b330743ac6ddeb51e129828f31dd0954100"} Jul 17 13:56:29.155468 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.155444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" event={"ID":"10a100dd-e35b-408a-91ec-b638776fdddd","Type":"ContainerStarted","Data":"5744ad9c2b663f502b14cbcbec63d327fb32722e72ee900ab5b60e8bb6f7dd2e"} Jul 17 13:56:29.156740 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.156713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xp828" event={"ID":"60ab99af-b28e-46ef-89b4-f9764467afd5","Type":"ContainerStarted","Data":"c4ebd7cc2eb3bff31f892569944da590c08536eec88030d14781af5d81a5893c"} Jul 17 13:56:29.157751 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.157728 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerStarted","Data":"58ee7b20ca04e86ed8edef84ed3414d332eb6025aa80fe89431cc4bcfa62efb8"} Jul 17 13:56:29.158872 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.158852 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7bgz" event={"ID":"103dfdec-f2be-4ef0-96cd-c79da288d4ea","Type":"ContainerStarted","Data":"f1b48f77f6450e44ea9d145d4646b22e38c5b5b886bf14e4f90e37b9c7181394"} Jul 17 13:56:29.160307 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.160267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"2ac269c2df88e652ed7bc0a80430e8795fc49e8c24a9d62ef915851250ce0b69"} Jul 17 13:56:29.161527 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.161503 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-px25f" event={"ID":"5a7db551-5085-4639-951b-cfb8e086fbea","Type":"ContainerStarted","Data":"8df6d8af1e424eabc9767ec403e92a2407fbed1c6ad5d650d02cdf3bfa481c15"} Jul 17 13:56:29.702108 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.701665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:29.702108 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.702021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:29.702108 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.701989 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:29.702108 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702063 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:29.702108 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702080 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:29.702108 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.702085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:29.702540 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702151 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:31.702131332 +0000 UTC m=+6.006355822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:29.702540 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702198 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:29.702540 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702249 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:56:31.702234207 +0000 UTC m=+6.006458683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:29.702540 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702306 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:29.702540 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:29.702430 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:56:31.70232927 +0000 UTC m=+6.006553748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:29.904980 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:29.904768 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:30.024393 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.024274 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:51:28 +0000 UTC" deadline="2028-04-02 23:20:13.89846388 +0000 UTC" Jul 17 13:56:30.024393 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.024322 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15009h23m43.874147832s" Jul 17 13:56:30.144599 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.144565 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:30.144822 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:30.144705 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:30.145183 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.145159 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:30.145291 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:30.145269 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:30.201063 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.200235 2558 generic.go:356] "Generic (PLEG): container finished" podID="db69650ddb5c4800f0a495957d25812f" containerID="d7588aabde0189f962872fa2409c31ed436c164ec5cd49a02866940ddf0da4ac" exitCode=0 Jul 17 13:56:30.201063 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.200342 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" event={"ID":"db69650ddb5c4800f0a495957d25812f","Type":"ContainerDied","Data":"d7588aabde0189f962872fa2409c31ed436c164ec5cd49a02866940ddf0da4ac"} Jul 17 13:56:30.212338 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.212305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" event={"ID":"e3e9fe71abb26609a391ecb4a06dc6f1","Type":"ContainerStarted","Data":"9160b2b5e6edb3cfe9916f8ca014bd571f409e287053c10684f8cd6db46c4e21"} Jul 17 13:56:30.235188 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:30.235129 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-16.ec2.internal" podStartSLOduration=3.235106135 podStartE2EDuration="3.235106135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:30.234685654 +0000 UTC m=+4.538910160" watchObservedRunningTime="2026-07-17 13:56:30.235106135 +0000 UTC m=+4.539330633" Jul 17 13:56:31.142351 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:31.141735 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:31.142351 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.141902 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:31.250399 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:31.250043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" event={"ID":"db69650ddb5c4800f0a495957d25812f","Type":"ContainerStarted","Data":"f2514b4144dbcbd0098168d608e33150a13eb77d3d226fc0890c941bbdca7b5a"} Jul 17 13:56:31.725877 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:31.725832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:31.726118 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:31.725908 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:31.726118 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:31.725946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:31.726118 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726104 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:31.726323 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726169 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:56:35.726150637 +0000 UTC m=+10.030375113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:31.726323 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726266 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:31.726323 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726280 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:31.726323 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726293 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:31.726584 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726327 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:35.726315264 +0000 UTC m=+10.030539741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:31.726584 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726414 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:31.726584 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:31.726447 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:56:35.726436488 +0000 UTC m=+10.030660964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:32.145270 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:32.141574 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:32.145270 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:32.141725 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:32.145270 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:32.141817 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:32.145270 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:32.141903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:33.142176 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:33.142139 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:33.142383 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:33.142303 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:34.141370 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:34.141333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:34.141858 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:34.141486 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:34.142003 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:34.141982 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:34.142245 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:34.142123 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:35.142357 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:35.142321 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:35.142856 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.142473 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:35.763348 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:35.763303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:35.763513 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:35.763370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:35.763513 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:35.763405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:35.763611 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.763537 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:35.763611 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.763603 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:56:43.763583098 +0000 UTC m=+18.067807593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:35.764013 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.763984 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:35.764013 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.764014 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:35.764211 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.764045 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:35.764211 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.764098 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:43.764080438 +0000 UTC m=+18.068304916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:35.764211 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.764166 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:35.764211 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:35.764209 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:56:43.764197127 +0000 UTC m=+18.068421603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:36.142361 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:36.142279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:36.142535 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:36.142395 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:36.142830 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:36.142715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:36.142830 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:36.142783 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:37.142139 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:37.141626 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:37.142139 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:37.141770 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:38.145478 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:38.145449 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:38.145939 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:38.145577 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:38.145939 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:38.145613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:38.145939 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:38.145698 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:39.141469 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:39.141428 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:39.141641 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:39.141582 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:40.145461 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:40.145432 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:40.145862 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:40.145543 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:40.145862 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:40.145583 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:40.145862 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:40.145644 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:41.142354 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:41.142324 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:41.142519 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:41.142453 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:42.141749 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:42.141717 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:42.142175 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:42.141848 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:42.142175 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:42.141904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:42.142175 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:42.142032 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:43.142147 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:43.142109 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:43.142630 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.142244 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:43.824893 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:43.824847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:43.824893 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:43.824896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:43.824924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825035 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825035 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825053 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825074 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825084 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825100 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:56:59.825081459 +0000 UTC m=+34.129305946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825116 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:56:59.82510855 +0000 UTC m=+34.129333022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:43.825248 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:43.825126 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:56:59.825120517 +0000 UTC m=+34.129344989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:44.142074 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:44.142041 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:44.142252 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:44.142041 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:44.142252 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:44.142167 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:44.142594 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:44.142258 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:45.142284 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:45.142243 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:45.142747 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:45.142372 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:46.142415 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:46.142360 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:46.142847 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:46.142496 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:46.142847 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:46.142551 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:46.142847 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:46.142686 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:47.141662 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:47.141632 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:47.141857 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:47.141750 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:48.141845 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:48.141817 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:48.142378 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:48.141957 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:48.142378 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:48.142000 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:48.142378 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:48.142111 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:49.141894 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.141575 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:49.141894 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:49.141726 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:49.302216 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.301767 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7bgz" event={"ID":"103dfdec-f2be-4ef0-96cd-c79da288d4ea","Type":"ContainerStarted","Data":"e341ca305e6b6e19efcf8c7df9289d3b8c759128cf02366f669f122efdeee40b"} Jul 17 13:56:49.303626 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.303603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"9ba89a1cfb3f60cb8df54587aa5b137dcd1d3df164861ce94d40743bbb9e7cf8"} Jul 17 13:56:49.303740 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.303667 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"fb719b55c979ce0ed318c8d09663af72957ec429debccaa998f94929babac505"} Jul 17 13:56:49.305185 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.305161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-px25f" event={"ID":"5a7db551-5085-4639-951b-cfb8e086fbea","Type":"ContainerStarted","Data":"1b2959336fcfc214f41a450dc4a858d947454e972b39580a49cd83dc2a05218c"} Jul 17 13:56:49.306723 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.306689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" event={"ID":"95cbed5b-456c-4238-809c-84ad9160bc6c","Type":"ContainerStarted","Data":"e82dfaf222f080af2ac9fefb7ce2032b9d5551bd6d7b16e92cb32c485387fee8"} Jul 17 13:56:49.308260 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.308152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cnv6g" event={"ID":"57d54756-8102-4290-9421-76f8e6cf35ba","Type":"ContainerStarted","Data":"3b5ce114059bd40b036eb5f3c52629ec48571afeb1c90280a0357424741d26f0"} Jul 17 13:56:49.309849 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.309818 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" event={"ID":"10a100dd-e35b-408a-91ec-b638776fdddd","Type":"ContainerStarted","Data":"ca8de6f67c2b9536ad49a1e9cafba8c4a8d9a4ab3c5a18133b83c01a67d0e0ec"} Jul 17 13:56:49.311337 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.311308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xp828" event={"ID":"60ab99af-b28e-46ef-89b4-f9764467afd5","Type":"ContainerStarted","Data":"ae5a66a50c4af2792a3d5d3acf418f48300d9298fcd4add87f627a76115b885e"} Jul 17 13:56:49.313040 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.312990 2558 generic.go:356] "Generic (PLEG): container finished" podID="80fd97b5-28ff-41f5-a5c3-165adb0a9658" containerID="28b518995f2f3b2670d795443b997dd26db0cb2ce25849d151fc7a638eeb2fa5" exitCode=0 Jul 17 13:56:49.313040 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.313031 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerDied","Data":"28b518995f2f3b2670d795443b997dd26db0cb2ce25849d151fc7a638eeb2fa5"} Jul 17 13:56:49.320284 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.320247 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j7bgz" podStartSLOduration=3.409065483 podStartE2EDuration="23.320235038s" totalImagesPullingTime="19.911169555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.320119293 +0000 UTC m=+23.624343787" watchObservedRunningTime="2026-07-17 13:56:49.320235038 +0000 UTC m=+23.624459532" Jul 17 13:56:49.320788 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.320758 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-16.ec2.internal" podStartSLOduration=22.320750614 podStartE2EDuration="22.320750614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:31.268722342 +0000 UTC m=+5.572946841" watchObservedRunningTime="2026-07-17 13:56:49.320750614 +0000 UTC m=+23.624975108" Jul 17 13:56:49.338346 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.338300 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nj9rr" podStartSLOduration=2.487466678 podStartE2EDuration="22.338280011s" totalImagesPullingTime="19.850813333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.337708065 +0000 UTC m=+23.641932559" watchObservedRunningTime="2026-07-17 13:56:49.338280011 +0000 UTC m=+23.642504506" Jul 17 13:56:49.376821 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.376774 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xp828" podStartSLOduration=3.527519771 podStartE2EDuration="23.376758461s" totalImagesPullingTime="19.84923869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.376418562 +0000 UTC m=+23.680643067" watchObservedRunningTime="2026-07-17 13:56:49.376758461 +0000 UTC m=+23.680982956" Jul 17 13:56:49.413452 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:49.413413 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cnv6g" podStartSLOduration=3.554729373 podStartE2EDuration="23.413398937s" totalImagesPullingTime="19.858669564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.394091041 +0000 UTC m=+23.698315546" watchObservedRunningTime="2026-07-17 13:56:49.413398937 +0000 UTC m=+23.717623434" Jul 17 13:56:50.141747 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.141713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:50.141984 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:50.141859 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:50.142684 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.142214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:50.142684 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:50.142366 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:50.319193 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.319153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"1db1c5a874cba0be3137fd65a6fcf536f3ac73166f8d0eed4c0675282a420504"} Jul 17 13:56:50.319428 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.319245 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"6b415287a54817f0bc363373b7630b6b87e646ba76a5415fc684c00ea5344d36"} Jul 17 13:56:50.319428 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.319297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"8e52cbcf6d7399a7aa20eea9c88f3ae8875140431a867c4544b6392816e7d002"} Jul 17 13:56:50.319428 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.319343 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"831bc94b91edd3808b376b6328cee6b7235c00698bc1cf992dddf0fb8d7583bf"} Jul 17 13:56:50.571429 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:50.571395 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 13:56:51.044995 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.044862 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T13:56:50.571417301Z","UUID":"f2efd94e-6ce2-4604-b780-10616f8bc78e","Handler":null,"Name":"","Endpoint":""} Jul 17 13:56:51.046762 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.046550 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 13:56:51.046762 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.046592 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 13:56:51.141926 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.141893 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:51.142194 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:51.142065 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:51.323607 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.323518 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" event={"ID":"10a100dd-e35b-408a-91ec-b638776fdddd","Type":"ContainerStarted","Data":"d85258d1fab811ffb8ee9a7edc9cc3211876c6029456e1658ad08fa1c3f178ae"} Jul 17 13:56:51.325783 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.325348 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hh659" event={"ID":"84926149-0ab6-4860-b50f-953947c3662d","Type":"ContainerStarted","Data":"8f24362743c63a456215407d6c10d00fecd222d568af0ddc5838d3cefee36a5b"} Jul 17 13:56:51.340088 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.340041 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-px25f" podStartSLOduration=9.755091264 podStartE2EDuration="25.34002732s" totalImagesPullingTime="15.584936056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.413189097 +0000 UTC m=+23.717413590" watchObservedRunningTime="2026-07-17 13:56:51.34002732 +0000 UTC m=+25.644251818" Jul 17 13:56:51.340566 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:51.340540 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hh659" podStartSLOduration=5.464764633 podStartE2EDuration="25.340533887s" totalImagesPullingTime="19.875769254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:51.339932641 +0000 UTC m=+25.644157135" watchObservedRunningTime="2026-07-17 13:56:51.340533887 +0000 UTC m=+25.644758431" Jul 17 13:56:52.141471 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:52.141441 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:52.141636 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:52.141576 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:52.141704 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:52.141638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:52.141779 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:52.141758 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:52.426178 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:52.426097 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:52.426785 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:52.426760 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:53.141418 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:53.141392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:53.141596 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:53.141527 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:53.330077 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:53.330004 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:53.330661 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:53.330637 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-px25f" Jul 17 13:56:54.142451 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.142283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:54.142814 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.142345 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:54.142814 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:54.142525 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:54.142814 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:54.142622 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:54.333585 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.333502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" event={"ID":"10a100dd-e35b-408a-91ec-b638776fdddd","Type":"ContainerStarted","Data":"5611c80350bff7bf0a0a0c3afe9c6dccf0cf9ab2c2ca038ff3fd1adaefb2fd22"} Jul 17 13:56:54.335239 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.335210 2558 generic.go:356] "Generic (PLEG): container finished" podID="80fd97b5-28ff-41f5-a5c3-165adb0a9658" containerID="b783d978a20ca8afe08bb60e6bceb95d873923ceb2f4b128182ca5791359e734" exitCode=0 Jul 17 13:56:54.335378 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.335286 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerDied","Data":"b783d978a20ca8afe08bb60e6bceb95d873923ceb2f4b128182ca5791359e734"} Jul 17 13:56:54.338506 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.338485 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"7510425c4b4f52b2af46a72c6b3cd323c04965f54860d84afb70e10d3ec1366e"} Jul 17 13:56:54.352457 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:54.352419 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87cbq" podStartSLOduration=6.1203574 podStartE2EDuration="28.352406626s" totalImagesPullingTime="22.232049226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:54.35184948 +0000 UTC m=+28.656073975" watchObservedRunningTime="2026-07-17 13:56:54.352406626 +0000 UTC m=+28.656631121" Jul 17 13:56:55.142143 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:55.142119 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:55.142368 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:55.142213 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:56.142696 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.142515 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:56.143472 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:56.142746 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:56.143472 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.142593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:56.143472 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:56.142808 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:56.345313 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.345273 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" event={"ID":"da2a5494-1918-4868-908b-d8da3b8e555a","Type":"ContainerStarted","Data":"09f095fe1d58793d1889b00e74fb1d811030b8a92582087cadd4072e991d0482"} Jul 17 13:56:56.345562 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.345537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:56.347288 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.347268 2558 generic.go:356] "Generic (PLEG): container finished" podID="80fd97b5-28ff-41f5-a5c3-165adb0a9658" containerID="59f3ce9aca577e8c4bd1e319bbfab60f9d092a2a532d7ddaf80be38469f8acd3" exitCode=0 Jul 17 13:56:56.347385 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.347296 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerDied","Data":"59f3ce9aca577e8c4bd1e319bbfab60f9d092a2a532d7ddaf80be38469f8acd3"} Jul 17 13:56:56.362358 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.362338 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:56.372261 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:56.372218 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" podStartSLOduration=10.461205307 podStartE2EDuration="30.37220697s" totalImagesPullingTime="19.911001663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:56.370661039 +0000 UTC m=+30.674885552" watchObservedRunningTime="2026-07-17 13:56:56.37220697 +0000 UTC m=+30.676431463" Jul 17 13:56:57.141785 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.141759 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:57.141986 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:57.141889 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:57.353412 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.353370 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerStarted","Data":"73c789b64e5a564da9611c67150499275a36b1f79e444509b97bdf56442dc4ac"} Jul 17 13:56:57.353854 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.353835 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:57.353961 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.353929 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:57.371270 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.371243 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:56:57.636328 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.636261 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjbcl"] Jul 17 13:56:57.636483 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.636417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:57.636569 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:57.636539 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:57.636964 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.636927 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87p6v"] Jul 17 13:56:57.637065 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.637052 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:57.637180 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:57.637148 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:57.637640 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.637616 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9p82"] Jul 17 13:56:57.637734 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:57.637714 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:57.637807 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:57.637786 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:58.359543 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:58.359505 2558 generic.go:356] "Generic (PLEG): container finished" podID="80fd97b5-28ff-41f5-a5c3-165adb0a9658" containerID="73c789b64e5a564da9611c67150499275a36b1f79e444509b97bdf56442dc4ac" exitCode=0 Jul 17 13:56:58.360026 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:58.359557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerDied","Data":"73c789b64e5a564da9611c67150499275a36b1f79e444509b97bdf56442dc4ac"} Jul 17 13:56:59.141331 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:59.141298 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:59.141331 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:59.141325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:59.141582 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.141444 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:56:59.141582 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.141506 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:56:59.141582 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:59.141532 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:59.141724 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.141650 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:56:59.847196 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:59.847160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:59.847206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:56:59.847252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847319 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847382 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847391 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret podName:eebe6ce6-e0a9-4843-8637-50442dae55cc nodeName:}" failed. No retries permitted until 2026-07-17 13:57:31.847375082 +0000 UTC m=+66.151599558 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret") pod "global-pull-secret-syncer-k9p82" (UID: "eebe6ce6-e0a9-4843-8637-50442dae55cc") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847401 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847402 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847475 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs podName:a714ebca-dbfe-48ad-9e99-9b6233cb37bd nodeName:}" failed. No retries permitted until 2026-07-17 13:57:31.847456276 +0000 UTC m=+66.151680753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs") pod "network-metrics-daemon-pjbcl" (UID: "a714ebca-dbfe-48ad-9e99-9b6233cb37bd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847414 2558 projected.go:196] Error preparing data for projected volume kube-api-access-cscpn for pod openshift-network-diagnostics/network-check-target-87p6v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:59.847621 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:56:59.847529 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn podName:4bd06048-0a13-4f9c-9059-2a4a761adc5c nodeName:}" failed. No retries permitted until 2026-07-17 13:57:31.847519488 +0000 UTC m=+66.151743965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cscpn" (UniqueName: "kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn") pod "network-check-target-87p6v" (UID: "4bd06048-0a13-4f9c-9059-2a4a761adc5c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:57:01.142113 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:01.142082 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:57:01.142113 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:01.142098 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:57:01.142680 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:01.142202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:57:01.142680 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:01.142221 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k9p82" podUID="eebe6ce6-e0a9-4843-8637-50442dae55cc" Jul 17 13:57:01.142680 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:01.142272 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87p6v" podUID="4bd06048-0a13-4f9c-9059-2a4a761adc5c" Jul 17 13:57:01.142680 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:01.142343 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pjbcl" podUID="a714ebca-dbfe-48ad-9e99-9b6233cb37bd" Jul 17 13:57:02.042888 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.042855 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-16.ec2.internal" event="NodeReady" Jul 17 13:57:02.043066 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.043018 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 13:57:02.118567 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.118531 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kp7vp"] Jul 17 13:57:02.124762 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.124737 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ktvbb"] Jul 17 13:57:02.124897 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.124883 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.128386 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.128368 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.128683 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.128658 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf4sj\"" Jul 17 13:57:02.128888 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.128869 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 13:57:02.129231 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.129214 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 13:57:02.132604 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.132583 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 13:57:02.132710 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.132594 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 13:57:02.132710 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.132668 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 13:57:02.132825 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.132722 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn6fd\"" Jul 17 13:57:02.137929 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.137911 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ktvbb"] Jul 17 13:57:02.145663 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.145643 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kp7vp"] Jul 17 13:57:02.266512 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.266482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.266512 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.266514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf205cc-9b0c-4922-887c-f4c649997a45-config-volume\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.266700 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.266532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1bee57-cec3-45a0-8528-778b1f82a7fe-cert\") pod \"ingress-canary-ktvbb\" (UID: \"ae1bee57-cec3-45a0-8528-778b1f82a7fe\") " pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.266700 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.266590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf205cc-9b0c-4922-887c-f4c649997a45-tmp-dir\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.266700 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.266636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqg8\" (UniqueName: \"kubernetes.io/projected/ae1bee57-cec3-45a0-8528-778b1f82a7fe-kube-api-access-6tqg8\") pod \"ingress-canary-ktvbb\" (UID: \"ae1bee57-cec3-45a0-8528-778b1f82a7fe\") " pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.266700 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.266661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d27jz\" (UniqueName: \"kubernetes.io/projected/bdf205cc-9b0c-4922-887c-f4c649997a45-kube-api-access-d27jz\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.366927 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.366901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf205cc-9b0c-4922-887c-f4c649997a45-tmp-dir\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.367101 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.366962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqg8\" (UniqueName: \"kubernetes.io/projected/ae1bee57-cec3-45a0-8528-778b1f82a7fe-kube-api-access-6tqg8\") pod \"ingress-canary-ktvbb\" (UID: \"ae1bee57-cec3-45a0-8528-778b1f82a7fe\") " pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.367101 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.366986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27jz\" (UniqueName: \"kubernetes.io/projected/bdf205cc-9b0c-4922-887c-f4c649997a45-kube-api-access-d27jz\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.367300 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.367139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.367300 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.367183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf205cc-9b0c-4922-887c-f4c649997a45-config-volume\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.367300 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.367211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1bee57-cec3-45a0-8528-778b1f82a7fe-cert\") pod \"ingress-canary-ktvbb\" (UID: \"ae1bee57-cec3-45a0-8528-778b1f82a7fe\") " pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.367300 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.367275 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdf205cc-9b0c-4922-887c-f4c649997a45-tmp-dir\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.367300 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:02.367292 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:02.367528 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:02.367367 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls podName:bdf205cc-9b0c-4922-887c-f4c649997a45 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:02.867344794 +0000 UTC m=+37.171569269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls") pod "dns-default-kp7vp" (UID: "bdf205cc-9b0c-4922-887c-f4c649997a45") : secret "dns-default-metrics-tls" not found Jul 17 13:57:02.367756 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.367733 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdf205cc-9b0c-4922-887c-f4c649997a45-config-volume\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.371393 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.371371 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae1bee57-cec3-45a0-8528-778b1f82a7fe-cert\") pod \"ingress-canary-ktvbb\" (UID: \"ae1bee57-cec3-45a0-8528-778b1f82a7fe\") " pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.377111 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.377087 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d27jz\" (UniqueName: \"kubernetes.io/projected/bdf205cc-9b0c-4922-887c-f4c649997a45-kube-api-access-d27jz\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.377745 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.377729 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqg8\" (UniqueName: \"kubernetes.io/projected/ae1bee57-cec3-45a0-8528-778b1f82a7fe-kube-api-access-6tqg8\") pod \"ingress-canary-ktvbb\" (UID: \"ae1bee57-cec3-45a0-8528-778b1f82a7fe\") " pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.443797 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.443755 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ktvbb" Jul 17 13:57:02.582505 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.582423 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ktvbb"] Jul 17 13:57:02.587855 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:02.587820 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1bee57_cec3_45a0_8528_778b1f82a7fe.slice/crio-ee408738b3935c66f267b4fa1fb9e0c4502cb1d9fa8a0c34b85e3dbac80e591e WatchSource:0}: Error finding container ee408738b3935c66f267b4fa1fb9e0c4502cb1d9fa8a0c34b85e3dbac80e591e: Status 404 returned error can't find the container with id ee408738b3935c66f267b4fa1fb9e0c4502cb1d9fa8a0c34b85e3dbac80e591e Jul 17 13:57:02.870862 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:02.870825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:02.871062 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:02.870994 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:02.871109 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:02.871066 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls podName:bdf205cc-9b0c-4922-887c-f4c649997a45 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:03.871043649 +0000 UTC m=+38.175268120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls") pod "dns-default-kp7vp" (UID: "bdf205cc-9b0c-4922-887c-f4c649997a45") : secret "dns-default-metrics-tls" not found Jul 17 13:57:03.142589 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.142296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:57:03.142749 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.142296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:57:03.142901 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.142297 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:57:03.145614 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.145586 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 13:57:03.145614 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.145591 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctrdf\"" Jul 17 13:57:03.146368 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.145624 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 13:57:03.146628 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.146608 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:57:03.146704 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.146644 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:57:03.146704 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.146697 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnkr8\"" Jul 17 13:57:03.372215 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.372169 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ktvbb" event={"ID":"ae1bee57-cec3-45a0-8528-778b1f82a7fe","Type":"ContainerStarted","Data":"ee408738b3935c66f267b4fa1fb9e0c4502cb1d9fa8a0c34b85e3dbac80e591e"} Jul 17 13:57:03.376612 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.375654 2558 generic.go:356] "Generic (PLEG): container finished" podID="80fd97b5-28ff-41f5-a5c3-165adb0a9658" containerID="b03d341ef270d879d668208b754fab5092764b73e7bb8860eccc3841a48923d8" exitCode=0 Jul 17 13:57:03.376612 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.375807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerDied","Data":"b03d341ef270d879d668208b754fab5092764b73e7bb8860eccc3841a48923d8"} Jul 17 13:57:03.879218 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:03.879183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:03.879374 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:03.879330 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:03.879415 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:03.879396 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls podName:bdf205cc-9b0c-4922-887c-f4c649997a45 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:05.879379661 +0000 UTC m=+40.183604135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls") pod "dns-default-kp7vp" (UID: "bdf205cc-9b0c-4922-887c-f4c649997a45") : secret "dns-default-metrics-tls" not found Jul 17 13:57:04.381771 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:04.381731 2558 generic.go:356] "Generic (PLEG): container finished" podID="80fd97b5-28ff-41f5-a5c3-165adb0a9658" containerID="5f05a80bced29a6c912c7870bc4d26eb9ca060d8b8f9c12a07291aac610b97f3" exitCode=0 Jul 17 13:57:04.382227 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:04.381788 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerDied","Data":"5f05a80bced29a6c912c7870bc4d26eb9ca060d8b8f9c12a07291aac610b97f3"} Jul 17 13:57:05.385533 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:05.385494 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ktvbb" event={"ID":"ae1bee57-cec3-45a0-8528-778b1f82a7fe","Type":"ContainerStarted","Data":"c2306197a9c0193b9ec9e84ec4df9d8eaaeda1b699b0d751cdd1872433e3bc54"} Jul 17 13:57:05.388665 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:05.388636 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" event={"ID":"80fd97b5-28ff-41f5-a5c3-165adb0a9658","Type":"ContainerStarted","Data":"615b005382b1dfe864bfe20fda64d38ceb4a0d515cf224e526ae09235c42dcbb"} Jul 17 13:57:05.402888 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:05.402846 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ktvbb" podStartSLOduration=1.075477059 podStartE2EDuration="3.402831803s" totalImagesPullingTime="2.327354744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:05.402373499 +0000 UTC m=+39.706598015" watchObservedRunningTime="2026-07-17 13:57:05.402831803 +0000 UTC m=+39.707056296" Jul 17 13:57:05.433888 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:05.433834 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lkxgv" podStartSLOduration=9.357966549 podStartE2EDuration="39.433813192s" totalImagesPullingTime="30.075846643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:05.4322172 +0000 UTC m=+39.736441693" watchObservedRunningTime="2026-07-17 13:57:05.433813192 +0000 UTC m=+39.738037688" Jul 17 13:57:05.892638 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:05.892597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:05.892797 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:05.892760 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:05.892844 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:05.892825 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls podName:bdf205cc-9b0c-4922-887c-f4c649997a45 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:09.892808454 +0000 UTC m=+44.197032925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls") pod "dns-default-kp7vp" (UID: "bdf205cc-9b0c-4922-887c-f4c649997a45") : secret "dns-default-metrics-tls" not found Jul 17 13:57:06.933011 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:06.932814 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4"] Jul 17 13:57:06.962467 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:06.962432 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4"] Jul 17 13:57:06.962603 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:06.962553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" Jul 17 13:57:06.965363 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:06.965345 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 13:57:06.965758 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:06.965743 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 13:57:06.966615 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:06.966598 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2rp4c\"" Jul 17 13:57:07.101982 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.101931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddlt\" (UniqueName: \"kubernetes.io/projected/008685d0-d9e2-4fb2-bc34-0a3565b526bd-kube-api-access-mddlt\") pod \"migrator-7cc9c7ffd7-dvmw4\" (UID: \"008685d0-d9e2-4fb2-bc34-0a3565b526bd\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" Jul 17 13:57:07.188376 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.188313 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2trzp"] Jul 17 13:57:07.202860 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.202837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddlt\" (UniqueName: \"kubernetes.io/projected/008685d0-d9e2-4fb2-bc34-0a3565b526bd-kube-api-access-mddlt\") pod \"migrator-7cc9c7ffd7-dvmw4\" (UID: \"008685d0-d9e2-4fb2-bc34-0a3565b526bd\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" Jul 17 13:57:07.203437 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.203422 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.206619 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.206602 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 13:57:07.207778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.207379 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hg4xg\"" Jul 17 13:57:07.207778 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.207629 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 13:57:07.210059 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.208091 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 13:57:07.212437 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.212389 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 13:57:07.214986 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.214965 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2trzp"] Jul 17 13:57:07.253197 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.253169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddlt\" (UniqueName: \"kubernetes.io/projected/008685d0-d9e2-4fb2-bc34-0a3565b526bd-kube-api-access-mddlt\") pod \"migrator-7cc9c7ffd7-dvmw4\" (UID: \"008685d0-d9e2-4fb2-bc34-0a3565b526bd\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" Jul 17 13:57:07.270906 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.270888 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" Jul 17 13:57:07.303251 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.303231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.303347 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.303269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58f769ee-bef0-4091-85b5-e0c672ac8d5a-data-volume\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.303385 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.303345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58f769ee-bef0-4091-85b5-e0c672ac8d5a-crio-socket\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.303385 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.303382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs9rx\" (UniqueName: \"kubernetes.io/projected/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-api-access-fs9rx\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.303454 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.303400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404204 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs9rx\" (UniqueName: \"kubernetes.io/projected/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-api-access-fs9rx\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404204 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404400 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404400 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58f769ee-bef0-4091-85b5-e0c672ac8d5a-data-volume\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404400 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58f769ee-bef0-4091-85b5-e0c672ac8d5a-crio-socket\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404400 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.404319 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.404400 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.404365 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:07.404400 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.404393 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:07.904371799 +0000 UTC m=+42.208596272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.404623 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.404425 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:07.904411656 +0000 UTC m=+42.208636132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : configmap "kube-rbac-proxy" not found Jul 17 13:57:07.404623 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404526 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58f769ee-bef0-4091-85b5-e0c672ac8d5a-crio-socket\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.404623 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.404612 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58f769ee-bef0-4091-85b5-e0c672ac8d5a-data-volume\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.414166 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.414143 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4"] Jul 17 13:57:07.417128 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.417108 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs9rx\" (UniqueName: \"kubernetes.io/projected/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-api-access-fs9rx\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.417672 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:07.417653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008685d0_d9e2_4fb2_bc34_0a3565b526bd.slice/crio-0c3045fe804e43d8690243634bdeac266febad5b5b740e15518565fb4264f2f7 WatchSource:0}: Error finding container 0c3045fe804e43d8690243634bdeac266febad5b5b740e15518565fb4264f2f7: Status 404 returned error can't find the container with id 0c3045fe804e43d8690243634bdeac266febad5b5b740e15518565fb4264f2f7 Jul 17 13:57:07.908741 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.908710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.908897 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:07.908747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:07.908897 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.908842 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:07.908897 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.908865 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.908897 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.908895 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.908879101 +0000 UTC m=+43.213103573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : configmap "kube-rbac-proxy" not found Jul 17 13:57:07.909061 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:07.908928 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.90891441 +0000 UTC m=+43.213138887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:08.396938 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:08.396906 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" event={"ID":"008685d0-d9e2-4fb2-bc34-0a3565b526bd","Type":"ContainerStarted","Data":"0c3045fe804e43d8690243634bdeac266febad5b5b740e15518565fb4264f2f7"} Jul 17 13:57:08.916037 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:08.916007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:08.916037 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:08.916043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:08.916228 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:08.916112 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:08.916228 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:08.916145 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:08.916228 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:08.916168 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:10.916150304 +0000 UTC m=+45.220374780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : configmap "kube-rbac-proxy" not found Jul 17 13:57:08.916228 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:08.916197 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:10.916184206 +0000 UTC m=+45.220408678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:09.401132 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:09.401096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" event={"ID":"008685d0-d9e2-4fb2-bc34-0a3565b526bd","Type":"ContainerStarted","Data":"7511862978c3a54f4a3dd610c2449e53ccf212680752b712a1b47e160e8d2ed7"} Jul 17 13:57:09.401485 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:09.401145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" event={"ID":"008685d0-d9e2-4fb2-bc34-0a3565b526bd","Type":"ContainerStarted","Data":"1a5aa131a3275af0d7ace3bd2a65182d483216f9a15ba410c451ca97cd4652b0"} Jul 17 13:57:09.419710 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:09.419662 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-dvmw4" podStartSLOduration=1.879905954 podStartE2EDuration="3.419646861s" totalImagesPullingTime="1.539740907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:09.41940119 +0000 UTC m=+43.723625698" watchObservedRunningTime="2026-07-17 13:57:09.419646861 +0000 UTC m=+43.723871398" Jul 17 13:57:09.923063 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:09.923018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:09.923244 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:09.923160 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:09.923244 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:09.923223 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls podName:bdf205cc-9b0c-4922-887c-f4c649997a45 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:17.923207456 +0000 UTC m=+52.227431932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls") pod "dns-default-kp7vp" (UID: "bdf205cc-9b0c-4922-887c-f4c649997a45") : secret "dns-default-metrics-tls" not found Jul 17 13:57:10.124198 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:10.124170 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xp828_60ab99af-b28e-46ef-89b4-f9764467afd5/dns-node-resolver/0.log" Jul 17 13:57:10.723507 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:10.723480 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnv6g_57d54756-8102-4290-9421-76f8e6cf35ba/node-ca/0.log" Jul 17 13:57:10.932841 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:10.932806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:10.933004 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:10.932913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:10.933004 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:10.932933 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:10.933075 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:10.933018 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:14.932998333 +0000 UTC m=+49.237222817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : configmap "kube-rbac-proxy" not found Jul 17 13:57:10.933075 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:10.933026 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:10.933075 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:10.933061 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:14.933051058 +0000 UTC m=+49.237275532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:11.923084 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:11.923046 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktvbb_ae1bee57-cec3-45a0-8528-778b1f82a7fe/serve-healthcheck-canary/0.log" Jul 17 13:57:12.126417 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:12.126385 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dvmw4_008685d0-d9e2-4fb2-bc34-0a3565b526bd/migrator/0.log" Jul 17 13:57:12.323630 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:12.323549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dvmw4_008685d0-d9e2-4fb2-bc34-0a3565b526bd/graceful-termination/0.log" Jul 17 13:57:14.965178 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:14.965142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:14.965546 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:14.965244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:14.965546 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:14.965341 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:14.965546 ip-10-0-134-16 kubenswrapper[2558]: E0717 13:57:14.965402 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls podName:58f769ee-bef0-4091-85b5-e0c672ac8d5a nodeName:}" failed. No retries permitted until 2026-07-17 13:57:22.965383494 +0000 UTC m=+57.269607986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2trzp" (UID: "58f769ee-bef0-4091-85b5-e0c672ac8d5a") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:14.965658 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:14.965644 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58f769ee-bef0-4091-85b5-e0c672ac8d5a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:17.989225 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:17.989181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:17.991525 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:17.991506 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdf205cc-9b0c-4922-887c-f4c649997a45-metrics-tls\") pod \"dns-default-kp7vp\" (UID: \"bdf205cc-9b0c-4922-887c-f4c649997a45\") " pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:18.037669 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:18.037636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:18.181376 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:18.181344 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kp7vp"] Jul 17 13:57:18.184367 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:18.184343 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf205cc_9b0c_4922_887c_f4c649997a45.slice/crio-5824b0ac1184dad374fa113e5e46b2031bacaefa7ab388f72af42ba39ee134e2 WatchSource:0}: Error finding container 5824b0ac1184dad374fa113e5e46b2031bacaefa7ab388f72af42ba39ee134e2: Status 404 returned error can't find the container with id 5824b0ac1184dad374fa113e5e46b2031bacaefa7ab388f72af42ba39ee134e2 Jul 17 13:57:18.422355 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:18.422317 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kp7vp" event={"ID":"bdf205cc-9b0c-4922-887c-f4c649997a45","Type":"ContainerStarted","Data":"5824b0ac1184dad374fa113e5e46b2031bacaefa7ab388f72af42ba39ee134e2"} Jul 17 13:57:21.431257 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:21.431223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kp7vp" event={"ID":"bdf205cc-9b0c-4922-887c-f4c649997a45","Type":"ContainerStarted","Data":"e09ea7dc56788697d559216f3d154c8f6809555d5338810951003456ab5cda18"} Jul 17 13:57:21.431625 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:21.431277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kp7vp" event={"ID":"bdf205cc-9b0c-4922-887c-f4c649997a45","Type":"ContainerStarted","Data":"b33f746935d5c9048f67c3b201de50c3cf55d04fa03fa61a4e60257d35e343cd"} Jul 17 13:57:21.431625 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:21.431347 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:21.451646 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:21.451591 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kp7vp" podStartSLOduration=17.260605741 podStartE2EDuration="19.451576538s" totalImagesPullingTime="2.190970797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:21.450780114 +0000 UTC m=+55.755004609" watchObservedRunningTime="2026-07-17 13:57:21.451576538 +0000 UTC m=+55.755801032" Jul 17 13:57:23.023753 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:23.023714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:23.026164 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:23.026143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58f769ee-bef0-4091-85b5-e0c672ac8d5a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2trzp\" (UID: \"58f769ee-bef0-4091-85b5-e0c672ac8d5a\") " pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:23.115405 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:23.115379 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2trzp" Jul 17 13:57:23.239919 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:23.239886 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2trzp"] Jul 17 13:57:23.242558 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:23.242530 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f769ee_bef0_4091_85b5_e0c672ac8d5a.slice/crio-b8ded8de44df9b4cb05789be4b6ab6876b9556419cedbf26226724418ce63e6f WatchSource:0}: Error finding container b8ded8de44df9b4cb05789be4b6ab6876b9556419cedbf26226724418ce63e6f: Status 404 returned error can't find the container with id b8ded8de44df9b4cb05789be4b6ab6876b9556419cedbf26226724418ce63e6f Jul 17 13:57:23.437232 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:23.437203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2trzp" event={"ID":"58f769ee-bef0-4091-85b5-e0c672ac8d5a","Type":"ContainerStarted","Data":"b8ded8de44df9b4cb05789be4b6ab6876b9556419cedbf26226724418ce63e6f"} Jul 17 13:57:29.374223 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:29.374191 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf8nn" Jul 17 13:57:29.459980 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:29.459927 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2trzp" event={"ID":"58f769ee-bef0-4091-85b5-e0c672ac8d5a","Type":"ContainerStarted","Data":"2484f5151fac19fd9c440e2ccc3761e864d742c059aa75f1db387503680cb16f"} Jul 17 13:57:30.148448 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.148418 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr"] Jul 17 13:57:30.158284 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.158258 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw"] Jul 17 13:57:30.158407 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.158390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.161442 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.161421 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p"] Jul 17 13:57:30.161936 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.161706 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.162928 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.162899 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 13:57:30.163263 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.163243 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 13:57:30.168252 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.168223 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 13:57:30.168750 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.168492 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 13:57:30.169312 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.168975 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kcwrd\"" Jul 17 13:57:30.170325 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.170302 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 17 13:57:30.171259 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.171234 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw"] Jul 17 13:57:30.171362 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.171270 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr"] Jul 17 13:57:30.171419 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.171402 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p"] Jul 17 13:57:30.171523 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.171509 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.173902 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.173733 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 17 13:57:30.174390 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.174203 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 17 13:57:30.174390 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.174212 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 17 13:57:30.174390 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.174326 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 17 13:57:30.177442 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.177423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtwxb\" (UniqueName: \"kubernetes.io/projected/b015c35c-e35c-43c5-a067-0fa9bd2a20f7-kube-api-access-xtwxb\") pod \"managed-serviceaccount-addon-agent-68f56479d8-ddbhw\" (UID: \"b015c35c-e35c-43c5-a067-0fa9bd2a20f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.177519 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.177470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c95a322-36e6-445f-8e32-4c47eba9d39d-tmp\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.177519 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.177496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c95a322-36e6-445f-8e32-4c47eba9d39d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.177589 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.177527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b015c35c-e35c-43c5-a067-0fa9bd2a20f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68f56479d8-ddbhw\" (UID: \"b015c35c-e35c-43c5-a067-0fa9bd2a20f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.177589 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.177552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzb4g\" (UniqueName: \"kubernetes.io/projected/8c95a322-36e6-445f-8e32-4c47eba9d39d-kube-api-access-xzb4g\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.278689 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzb4g\" (UniqueName: \"kubernetes.io/projected/8c95a322-36e6-445f-8e32-4c47eba9d39d-kube-api-access-xzb4g\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.278689 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.278924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-hub\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.278924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.278924 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.279081 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtwxb\" (UniqueName: \"kubernetes.io/projected/b015c35c-e35c-43c5-a067-0fa9bd2a20f7-kube-api-access-xtwxb\") pod \"managed-serviceaccount-addon-agent-68f56479d8-ddbhw\" (UID: \"b015c35c-e35c-43c5-a067-0fa9bd2a20f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.279081 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.278992 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-ca\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.279081 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.279016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sz74\" (UniqueName: \"kubernetes.io/projected/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-kube-api-access-7sz74\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.279081 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.279066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c95a322-36e6-445f-8e32-4c47eba9d39d-tmp\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.279244 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.279148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c95a322-36e6-445f-8e32-4c47eba9d39d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.279298 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.279239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b015c35c-e35c-43c5-a067-0fa9bd2a20f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68f56479d8-ddbhw\" (UID: \"b015c35c-e35c-43c5-a067-0fa9bd2a20f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.279413 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.279395 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c95a322-36e6-445f-8e32-4c47eba9d39d-tmp\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.282042 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.282018 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8c95a322-36e6-445f-8e32-4c47eba9d39d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.282175 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.282141 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b015c35c-e35c-43c5-a067-0fa9bd2a20f7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68f56479d8-ddbhw\" (UID: \"b015c35c-e35c-43c5-a067-0fa9bd2a20f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.314273 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.314245 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtwxb\" (UniqueName: \"kubernetes.io/projected/b015c35c-e35c-43c5-a067-0fa9bd2a20f7-kube-api-access-xtwxb\") pod \"managed-serviceaccount-addon-agent-68f56479d8-ddbhw\" (UID: \"b015c35c-e35c-43c5-a067-0fa9bd2a20f7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.316645 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.316622 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzb4g\" (UniqueName: \"kubernetes.io/projected/8c95a322-36e6-445f-8e32-4c47eba9d39d-kube-api-access-xzb4g\") pod \"klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr\" (UID: \"8c95a322-36e6-445f-8e32-4c47eba9d39d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.379999 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.379968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.379999 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.380006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-hub\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.380477 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.380033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.380477 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.380086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.380477 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.380110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-ca\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.380477 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.380132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sz74\" (UniqueName: \"kubernetes.io/projected/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-kube-api-access-7sz74\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.380811 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.380784 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.383242 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.383223 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-ca\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.383373 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.383320 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-hub\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.383373 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.383342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.383494 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.383370 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.391206 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.391183 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sz74\" (UniqueName: \"kubernetes.io/projected/07bd3705-2b89-4b2e-a7ec-67dafe891c1e-kube-api-access-7sz74\") pod \"cluster-proxy-proxy-agent-5c78c7bb47-ktt7p\" (UID: \"07bd3705-2b89-4b2e-a7ec-67dafe891c1e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:30.478040 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.477958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:30.501860 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.501828 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" Jul 17 13:57:30.507201 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:30.507180 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" Jul 17 13:57:31.436700 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.436666 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kp7vp" Jul 17 13:57:31.892813 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.892790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:57:31.893061 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.892846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:57:31.893061 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.893007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:57:31.895996 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.895596 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 13:57:31.895996 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.895905 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:57:31.896218 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.896199 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:57:31.906313 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.906148 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 13:57:31.906978 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.906817 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a714ebca-dbfe-48ad-9e99-9b6233cb37bd-metrics-certs\") pod \"network-metrics-daemon-pjbcl\" (UID: \"a714ebca-dbfe-48ad-9e99-9b6233cb37bd\") " pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:57:31.907253 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.907156 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eebe6ce6-e0a9-4843-8637-50442dae55cc-original-pull-secret\") pod \"global-pull-secret-syncer-k9p82\" (UID: \"eebe6ce6-e0a9-4843-8637-50442dae55cc\") " pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:57:31.916487 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.916465 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cscpn\" (UniqueName: \"kubernetes.io/projected/4bd06048-0a13-4f9c-9059-2a4a761adc5c-kube-api-access-cscpn\") pod \"network-check-target-87p6v\" (UID: \"4bd06048-0a13-4f9c-9059-2a4a761adc5c\") " pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:57:31.928511 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.928480 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw"] Jul 17 13:57:31.932449 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:31.932423 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb015c35c_e35c_43c5_a067_0fa9bd2a20f7.slice/crio-dc61a86ef88943eb6f454ac8c10683c757182af43febe7c6704161a37bc52ec6 WatchSource:0}: Error finding container dc61a86ef88943eb6f454ac8c10683c757182af43febe7c6704161a37bc52ec6: Status 404 returned error can't find the container with id dc61a86ef88943eb6f454ac8c10683c757182af43febe7c6704161a37bc52ec6 Jul 17 13:57:31.954880 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.954861 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k9p82" Jul 17 13:57:31.963117 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.963100 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnkr8\"" Jul 17 13:57:31.969154 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.969134 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctrdf\"" Jul 17 13:57:31.970936 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.970917 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:57:31.977749 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:31.977735 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pjbcl" Jul 17 13:57:32.097090 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.096757 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k9p82"] Jul 17 13:57:32.101530 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:32.101503 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebe6ce6_e0a9_4843_8637_50442dae55cc.slice/crio-5307a439559e45692157315b11652942886d10e0c3f5e7befb35c27febc8bc41 WatchSource:0}: Error finding container 5307a439559e45692157315b11652942886d10e0c3f5e7befb35c27febc8bc41: Status 404 returned error can't find the container with id 5307a439559e45692157315b11652942886d10e0c3f5e7befb35c27febc8bc41 Jul 17 13:57:32.112055 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.112033 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87p6v"] Jul 17 13:57:32.115285 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:32.115262 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd06048_0a13_4f9c_9059_2a4a761adc5c.slice/crio-90e79c733f7f1a37eed952c2d3578c98213263c7eba85d1a0cf897b4d5ca5812 WatchSource:0}: Error finding container 90e79c733f7f1a37eed952c2d3578c98213263c7eba85d1a0cf897b4d5ca5812: Status 404 returned error can't find the container with id 90e79c733f7f1a37eed952c2d3578c98213263c7eba85d1a0cf897b4d5ca5812 Jul 17 13:57:32.129629 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.129605 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pjbcl"] Jul 17 13:57:32.132577 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:32.132550 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda714ebca_dbfe_48ad_9e99_9b6233cb37bd.slice/crio-4af5f853f580ab5487cc6762aea1218d0857042d0e32c7ff461d1cfc5db346c6 WatchSource:0}: Error finding container 4af5f853f580ab5487cc6762aea1218d0857042d0e32c7ff461d1cfc5db346c6: Status 404 returned error can't find the container with id 4af5f853f580ab5487cc6762aea1218d0857042d0e32c7ff461d1cfc5db346c6 Jul 17 13:57:32.149238 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.149218 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr"] Jul 17 13:57:32.151488 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:32.151462 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c95a322_36e6_445f_8e32_4c47eba9d39d.slice/crio-ec33a9d85b7eddfc1d8c1883a59947564b1c6e375adffcf19bf02bcdb4943997 WatchSource:0}: Error finding container ec33a9d85b7eddfc1d8c1883a59947564b1c6e375adffcf19bf02bcdb4943997: Status 404 returned error can't find the container with id ec33a9d85b7eddfc1d8c1883a59947564b1c6e375adffcf19bf02bcdb4943997 Jul 17 13:57:32.154526 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.154493 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p"] Jul 17 13:57:32.158663 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:32.158643 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07bd3705_2b89_4b2e_a7ec_67dafe891c1e.slice/crio-63be2b2921e93f08dfac6bb5255ffad9449e5dd67b220cbcb28f815139c9c2af WatchSource:0}: Error finding container 63be2b2921e93f08dfac6bb5255ffad9449e5dd67b220cbcb28f815139c9c2af: Status 404 returned error can't find the container with id 63be2b2921e93f08dfac6bb5255ffad9449e5dd67b220cbcb28f815139c9c2af Jul 17 13:57:32.474489 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.474457 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjbcl" event={"ID":"a714ebca-dbfe-48ad-9e99-9b6233cb37bd","Type":"ContainerStarted","Data":"4af5f853f580ab5487cc6762aea1218d0857042d0e32c7ff461d1cfc5db346c6"} Jul 17 13:57:32.475809 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.475779 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9p82" event={"ID":"eebe6ce6-e0a9-4843-8637-50442dae55cc","Type":"ContainerStarted","Data":"5307a439559e45692157315b11652942886d10e0c3f5e7befb35c27febc8bc41"} Jul 17 13:57:32.477226 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.477205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87p6v" event={"ID":"4bd06048-0a13-4f9c-9059-2a4a761adc5c","Type":"ContainerStarted","Data":"90e79c733f7f1a37eed952c2d3578c98213263c7eba85d1a0cf897b4d5ca5812"} Jul 17 13:57:32.478459 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.478433 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" event={"ID":"07bd3705-2b89-4b2e-a7ec-67dafe891c1e","Type":"ContainerStarted","Data":"63be2b2921e93f08dfac6bb5255ffad9449e5dd67b220cbcb28f815139c9c2af"} Jul 17 13:57:32.480531 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.480306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2trzp" event={"ID":"58f769ee-bef0-4091-85b5-e0c672ac8d5a","Type":"ContainerStarted","Data":"2518602214b6a252e3c582ffdaf53f140391883daccaef5e2a0b58f49f99ecd0"} Jul 17 13:57:32.481698 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.481643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" event={"ID":"b015c35c-e35c-43c5-a067-0fa9bd2a20f7","Type":"ContainerStarted","Data":"dc61a86ef88943eb6f454ac8c10683c757182af43febe7c6704161a37bc52ec6"} Jul 17 13:57:32.483048 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:32.483022 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" event={"ID":"8c95a322-36e6-445f-8e32-4c47eba9d39d","Type":"ContainerStarted","Data":"ec33a9d85b7eddfc1d8c1883a59947564b1c6e375adffcf19bf02bcdb4943997"} Jul 17 13:57:34.520198 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:34.519673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjbcl" event={"ID":"a714ebca-dbfe-48ad-9e99-9b6233cb37bd","Type":"ContainerStarted","Data":"321b6e52ee67c0f366273a367b1609328736a0778b7d3a9e34eb00131e477ddf"} Jul 17 13:57:35.532831 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:35.531974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pjbcl" event={"ID":"a714ebca-dbfe-48ad-9e99-9b6233cb37bd","Type":"ContainerStarted","Data":"5eab7e804f795ac7f46035a757291ffeb5e75322e04880aecb57a8454a75c498"} Jul 17 13:57:35.554211 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:35.553127 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pjbcl" podStartSLOduration=67.448275058 podStartE2EDuration="1m9.553107514s" totalImagesPullingTime="2.104832456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:35.552048615 +0000 UTC m=+69.856273111" watchObservedRunningTime="2026-07-17 13:57:35.553107514 +0000 UTC m=+69.857332009" Jul 17 13:57:44.570445 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.570409 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k9p82" event={"ID":"eebe6ce6-e0a9-4843-8637-50442dae55cc","Type":"ContainerStarted","Data":"1d75ddf81855e1b9cec075183cc0646c04b6e868955d4e4d32eacc89744040d0"} Jul 17 13:57:44.572053 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.572030 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87p6v" event={"ID":"4bd06048-0a13-4f9c-9059-2a4a761adc5c","Type":"ContainerStarted","Data":"00a92786dfacc5f3d1f26ed79c33101b903540add5357cce9240f43bc93ea93d"} Jul 17 13:57:44.572218 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.572080 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 13:57:44.573954 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.573915 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" event={"ID":"07bd3705-2b89-4b2e-a7ec-67dafe891c1e","Type":"ContainerStarted","Data":"2fcd898b9784fdfbbf054f0015b03d1c28e5bbe640d7e6654c09b2256ff8d221"} Jul 17 13:57:44.574064 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.573963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" event={"ID":"07bd3705-2b89-4b2e-a7ec-67dafe891c1e","Type":"ContainerStarted","Data":"45469f53b6095747b598b327791fef8952e4c3430cd2799961af65b2be5da542"} Jul 17 13:57:44.574064 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.573979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" event={"ID":"07bd3705-2b89-4b2e-a7ec-67dafe891c1e","Type":"ContainerStarted","Data":"613f95b95dfbd9b27c96e0392002c0239f2560208cc640f818ef4aee080aa3bf"} Jul 17 13:57:44.575964 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.575928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2trzp" event={"ID":"58f769ee-bef0-4091-85b5-e0c672ac8d5a","Type":"ContainerStarted","Data":"1f2522f000f098ea8df7e2cd70a51ef176a1b89f1a4b7fced42cc06d7c7cfa14"} Jul 17 13:57:44.577367 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.577347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" event={"ID":"b015c35c-e35c-43c5-a067-0fa9bd2a20f7","Type":"ContainerStarted","Data":"e92c86a55a560f22b365503b1479bbd3e4533496dd2e3a2a1c760feec7c1bef1"} Jul 17 13:57:44.578722 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.578704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" event={"ID":"8c95a322-36e6-445f-8e32-4c47eba9d39d","Type":"ContainerStarted","Data":"4b51ab15928a246d29a6a1484235e396e1e65b7a0b168f37c629a8d18454e1a6"} Jul 17 13:57:44.578874 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.578861 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:44.580575 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.580559 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" Jul 17 13:57:44.590027 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.589979 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k9p82" podStartSLOduration=66.181941195 podStartE2EDuration="1m17.589963417s" totalImagesPullingTime="11.408022222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.589400451 +0000 UTC m=+78.893624966" watchObservedRunningTime="2026-07-17 13:57:44.589963417 +0000 UTC m=+78.894187903" Jul 17 13:57:44.609958 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.609898 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2trzp" podStartSLOduration=17.478750226 podStartE2EDuration="37.609885713s" totalImagesPullingTime="20.131135487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:57:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.609171472 +0000 UTC m=+78.913395979" watchObservedRunningTime="2026-07-17 13:57:44.609885713 +0000 UTC m=+78.914110205" Jul 17 13:57:44.634038 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.633999 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c78c7bb47-ktt7p" podStartSLOduration=3.271788681 podStartE2EDuration="14.633985619s" totalImagesPullingTime="11.362196938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.63305734 +0000 UTC m=+78.937281836" watchObservedRunningTime="2026-07-17 13:57:44.633985619 +0000 UTC m=+78.938210113" Jul 17 13:57:44.652043 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.651998 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f56479d8-ddbhw" podStartSLOduration=3.081520093 podStartE2EDuration="14.651985297s" totalImagesPullingTime="11.570465204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.651316758 +0000 UTC m=+78.955541254" watchObservedRunningTime="2026-07-17 13:57:44.651985297 +0000 UTC m=+78.956209791" Jul 17 13:57:44.674590 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.674544 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87p6v" podStartSLOduration=67.269977156 podStartE2EDuration="1m18.674531554s" totalImagesPullingTime="11.404554398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.673784053 +0000 UTC m=+78.978008547" watchObservedRunningTime="2026-07-17 13:57:44.674531554 +0000 UTC m=+78.978756048" Jul 17 13:57:44.700312 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:44.700273 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c5d8dfb8f-gqhsr" podStartSLOduration=3.337177451 podStartE2EDuration="14.700259777s" totalImagesPullingTime="11.363082326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:44.698762313 +0000 UTC m=+79.002986820" watchObservedRunningTime="2026-07-17 13:57:44.700259777 +0000 UTC m=+79.004484307" Jul 17 13:57:55.900155 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:55.900049 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qtczx"] Jul 17 13:57:56.277043 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.276937 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.281408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281139 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 13:57:56.281408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281139 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 13:57:56.281408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281213 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 13:57:56.281408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281246 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dlxn\"" Jul 17 13:57:56.281408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281360 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 13:57:56.281408 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281407 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 13:57:56.281745 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.281463 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 13:57:56.374854 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.374825 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375022 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.374865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-tls\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375022 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.374921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-textfile\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375022 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.374940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fd95457-e8b9-4407-9060-e21ac7688ccb-metrics-client-ca\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375022 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.374979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-root\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375022 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.375002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-sys\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375192 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.375042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-wtmp\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375192 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.375075 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.375192 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.375101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhpg\" (UniqueName: \"kubernetes.io/projected/2fd95457-e8b9-4407-9060-e21ac7688ccb-kube-api-access-wzhpg\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.475987 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.475936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476086 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-tls\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476086 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-textfile\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476086 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fd95457-e8b9-4407-9060-e21ac7688ccb-metrics-client-ca\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-root\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476111 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-sys\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-wtmp\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhpg\" (UniqueName: \"kubernetes.io/projected/2fd95457-e8b9-4407-9060-e21ac7688ccb-kube-api-access-wzhpg\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476184 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-root\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476222 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476186 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-sys\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476529 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476260 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-wtmp\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476529 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476496 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-textfile\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476636 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476611 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-accelerators-collector-config\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.476703 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.476681 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fd95457-e8b9-4407-9060-e21ac7688ccb-metrics-client-ca\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.479090 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.479066 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.479187 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.479102 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2fd95457-e8b9-4407-9060-e21ac7688ccb-node-exporter-tls\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.486229 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.486210 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhpg\" (UniqueName: \"kubernetes.io/projected/2fd95457-e8b9-4407-9060-e21ac7688ccb-kube-api-access-wzhpg\") pod \"node-exporter-qtczx\" (UID: \"2fd95457-e8b9-4407-9060-e21ac7688ccb\") " pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.587515 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:56.587446 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qtczx" Jul 17 13:57:56.621430 ip-10-0-134-16 kubenswrapper[2558]: W0717 13:57:56.621402 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd95457_e8b9_4407_9060_e21ac7688ccb.slice/crio-d551d975a08ba82038cf0cc01632231781def3b03fe076fb2adc32ddda2f1804 WatchSource:0}: Error finding container d551d975a08ba82038cf0cc01632231781def3b03fe076fb2adc32ddda2f1804: Status 404 returned error can't find the container with id d551d975a08ba82038cf0cc01632231781def3b03fe076fb2adc32ddda2f1804 Jul 17 13:57:57.623097 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:57.623063 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtczx" event={"ID":"2fd95457-e8b9-4407-9060-e21ac7688ccb","Type":"ContainerStarted","Data":"d551d975a08ba82038cf0cc01632231781def3b03fe076fb2adc32ddda2f1804"} Jul 17 13:57:58.627651 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:58.627613 2558 generic.go:356] "Generic (PLEG): container finished" podID="2fd95457-e8b9-4407-9060-e21ac7688ccb" containerID="3fdf39a865c8a4ca6faab189cb8b5ca014f6d9187945fff8a718b5763aecb4f7" exitCode=0 Jul 17 13:57:58.628100 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:58.627701 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtczx" event={"ID":"2fd95457-e8b9-4407-9060-e21ac7688ccb","Type":"ContainerDied","Data":"3fdf39a865c8a4ca6faab189cb8b5ca014f6d9187945fff8a718b5763aecb4f7"} Jul 17 13:57:59.633648 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:59.633617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtczx" event={"ID":"2fd95457-e8b9-4407-9060-e21ac7688ccb","Type":"ContainerStarted","Data":"53b0468000156621d901ebb803cdf308a1854f9356aaacc558f60bb7014a6232"} Jul 17 13:57:59.634038 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:59.633670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qtczx" event={"ID":"2fd95457-e8b9-4407-9060-e21ac7688ccb","Type":"ContainerStarted","Data":"1b7dddcec09c9a97d59fea0084ba0b128c25065231420589571bd3441ab1cf00"} Jul 17 13:57:59.665538 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:57:59.665490 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qtczx" podStartSLOduration=3.10639868 podStartE2EDuration="4.665476379s" totalImagesPullingTime="1.46345423s" totalInitContainerRuntime="95.623469ms" isStatefulPod=true podCreationTimestamp="2026-07-17 13:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:59.664076844 +0000 UTC m=+93.968301361" watchObservedRunningTime="2026-07-17 13:57:59.665476379 +0000 UTC m=+93.969700872" Jul 17 13:58:15.585034 ip-10-0-134-16 kubenswrapper[2558]: I0717 13:58:15.585000 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87p6v" Jul 17 14:01:25.979935 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:01:25.979906 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 14:13:53.180155 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.180122 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl"] Jul 17 14:13:53.182956 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.182932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:13:53.185706 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.185679 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-stj5k\"" Jul 17 14:13:53.185833 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.185781 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 17 14:13:53.186811 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.186795 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 17 14:13:53.197834 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.197808 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl"] Jul 17 14:13:53.242599 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.242567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxqd\" (UniqueName: \"kubernetes.io/projected/b038f32e-387b-4ebc-abf4-ab0580bc14aa-kube-api-access-8dxqd\") pod \"feast-operator-controller-manager-7cb4c6bbd6-rwhgl\" (UID: \"b038f32e-387b-4ebc-abf4-ab0580bc14aa\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:13:53.343161 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.343135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dxqd\" (UniqueName: \"kubernetes.io/projected/b038f32e-387b-4ebc-abf4-ab0580bc14aa-kube-api-access-8dxqd\") pod \"feast-operator-controller-manager-7cb4c6bbd6-rwhgl\" (UID: \"b038f32e-387b-4ebc-abf4-ab0580bc14aa\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:13:53.354113 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.354089 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dxqd\" (UniqueName: \"kubernetes.io/projected/b038f32e-387b-4ebc-abf4-ab0580bc14aa-kube-api-access-8dxqd\") pod \"feast-operator-controller-manager-7cb4c6bbd6-rwhgl\" (UID: \"b038f32e-387b-4ebc-abf4-ab0580bc14aa\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:13:53.492594 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.492522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:13:53.636394 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.636364 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl"] Jul 17 14:13:53.639161 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:13:53.639133 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb038f32e_387b_4ebc_abf4_ab0580bc14aa.slice/crio-79a1ce7d9ba79aaf8f3bec35aa9f5a422ebece83978c6f9bc0618b79b15e782b WatchSource:0}: Error finding container 79a1ce7d9ba79aaf8f3bec35aa9f5a422ebece83978c6f9bc0618b79b15e782b: Status 404 returned error can't find the container with id 79a1ce7d9ba79aaf8f3bec35aa9f5a422ebece83978c6f9bc0618b79b15e782b Jul 17 14:13:53.641032 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:53.641015 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:13:54.621833 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:54.621778 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" event={"ID":"b038f32e-387b-4ebc-abf4-ab0580bc14aa","Type":"ContainerStarted","Data":"79a1ce7d9ba79aaf8f3bec35aa9f5a422ebece83978c6f9bc0618b79b15e782b"} Jul 17 14:13:56.629111 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:56.629082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" event={"ID":"b038f32e-387b-4ebc-abf4-ab0580bc14aa","Type":"ContainerStarted","Data":"2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a"} Jul 17 14:13:56.629487 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:56.629165 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:13:56.652344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:13:56.652301 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" podStartSLOduration=1.657322331 podStartE2EDuration="3.652286821s" totalImagesPullingTime="1.99496449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:13:56.651219037 +0000 UTC m=+1050.955443532" watchObservedRunningTime="2026-07-17 14:13:56.652286821 +0000 UTC m=+1050.956511342" Jul 17 14:14:07.634573 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:07.634543 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:14:09.836438 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.836408 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd"] Jul 17 14:14:09.840531 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.840514 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:09.843243 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 17 14:14:09.843385 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843282 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 17 14:14:09.843385 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843294 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 14:14:09.843385 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843325 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5tkd8\"" Jul 17 14:14:09.843385 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 17 14:14:09.843596 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843449 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 14:14:09.843694 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.843613 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 17 14:14:09.851900 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.851879 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd"] Jul 17 14:14:09.955464 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.955437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:09.955638 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.955471 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b7286a15-29e8-4018-87e8-b6ff5ad235b4-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:09.955638 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.955491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:09.955638 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.955570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zww62\" (UniqueName: \"kubernetes.io/projected/b7286a15-29e8-4018-87e8-b6ff5ad235b4-kube-api-access-zww62\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:09.955638 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.955611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:09.955793 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:09.955643 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056333 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zww62\" (UniqueName: \"kubernetes.io/projected/b7286a15-29e8-4018-87e8-b6ff5ad235b4-kube-api-access-zww62\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056333 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056590 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056590 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056590 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b7286a15-29e8-4018-87e8-b6ff5ad235b4-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056590 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.056902 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.056876 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b7286a15-29e8-4018-87e8-b6ff5ad235b4-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.059467 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.059444 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.059467 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.059448 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.059645 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.059467 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.059645 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.059588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.064827 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.064804 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zww62\" (UniqueName: \"kubernetes.io/projected/b7286a15-29e8-4018-87e8-b6ff5ad235b4-kube-api-access-zww62\") pod \"feast-simple-feast-setup-796bc5bb56-wzrpd\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.149501 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.149477 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:10.288027 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.287812 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd"] Jul 17 14:14:10.290681 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:14:10.290654 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7286a15_29e8_4018_87e8_b6ff5ad235b4.slice/crio-6bc4b5e33116fd42c788427a0656aa04927ccbc010447ed9d715f64909c7d462 WatchSource:0}: Error finding container 6bc4b5e33116fd42c788427a0656aa04927ccbc010447ed9d715f64909c7d462: Status 404 returned error can't find the container with id 6bc4b5e33116fd42c788427a0656aa04927ccbc010447ed9d715f64909c7d462 Jul 17 14:14:10.675236 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:10.675204 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"6bc4b5e33116fd42c788427a0656aa04927ccbc010447ed9d715f64909c7d462"} Jul 17 14:14:25.735494 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:25.735451 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7"} Jul 17 14:14:30.753576 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:30.753543 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerID="a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7" exitCode=0 Jul 17 14:14:30.754039 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:30.753623 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7"} Jul 17 14:14:31.759389 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:31.759353 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c"} Jul 17 14:14:36.779257 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:36.779223 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerID="8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c" exitCode=0 Jul 17 14:14:36.779634 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:36.779282 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c"} Jul 17 14:14:37.795962 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:37.795903 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd"} Jul 17 14:14:37.796435 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:37.795983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9"} Jul 17 14:14:37.796435 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:37.796008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c"} Jul 17 14:14:37.796435 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:37.796026 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerStarted","Data":"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283"} Jul 17 14:14:37.823679 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:37.823613 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podStartSLOduration=13.8233811 podStartE2EDuration="28.823589571s" totalImagesPullingTime="15.000208471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:14:37.821302089 +0000 UTC m=+1092.125526618" watchObservedRunningTime="2026-07-17 14:14:37.823589571 +0000 UTC m=+1092.127814068" Jul 17 14:14:40.149855 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.149820 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.149879 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.149900 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.149921 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.149938 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.149977 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150344 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.150102 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.150681 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.150487 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:40.151918 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.151870 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.14:6571: connect: connection refused" Jul 17 14:14:40.152177 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.151893 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 17 14:14:40.152290 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.151896 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.14:8816: connect: connection refused" Jul 17 14:14:40.152290 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:40.151921 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 17 14:14:43.151106 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.151070 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.151561 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.151251 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.151561 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.151437 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.152059 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.152036 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.152161 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.152103 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.152361 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.152345 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.156458 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.156442 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:14:43.826728 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:14:43.826703 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:15:45.277202 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.277171 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd"] Jul 17 14:15:45.277729 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.277502 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="registry" containerID="cri-o://3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283" gracePeriod=30 Jul 17 14:15:45.277729 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.277544 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" containerID="cri-o://ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd" gracePeriod=30 Jul 17 14:15:45.277729 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.277566 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="offline" containerID="cri-o://82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9" gracePeriod=30 Jul 17 14:15:45.277729 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.277587 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" containerID="cri-o://f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c" gracePeriod=30 Jul 17 14:15:45.572798 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.572711 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k"] Jul 17 14:15:45.576903 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.576885 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.579495 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.579464 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wqbjx\"" Jul 17 14:15:45.588041 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.588015 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k"] Jul 17 14:15:45.738365 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.738311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.738365 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.738343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.738498 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.738378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.738498 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.738402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsxn\" (UniqueName: \"kubernetes.io/projected/c4fd42b4-2958-4bba-86c8-453f11bee38e-kube-api-access-ldsxn\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.738498 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.738451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4fd42b4-2958-4bba-86c8-453f11bee38e-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.738498 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.738471 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839155 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839061 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4fd42b4-2958-4bba-86c8-453f11bee38e-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839155 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839155 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839155 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839475 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839475 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsxn\" (UniqueName: \"kubernetes.io/projected/c4fd42b4-2958-4bba-86c8-453f11bee38e-kube-api-access-ldsxn\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.839475 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:15:45.839369 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 17 14:15:45.839475 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:15:45.839445 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls podName:c4fd42b4-2958-4bba-86c8-453f11bee38e nodeName:}" failed. No retries permitted until 2026-07-17 14:15:46.339422336 +0000 UTC m=+1160.643646825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls") pod "feast-simple-feast-setup-796bc5bb56-vqp6k" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e") : secret "feast-simple-feast-setup-online-tls" not found Jul 17 14:15:45.839690 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.839534 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4fd42b4-2958-4bba-86c8-453f11bee38e-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.841805 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.841779 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.841805 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.841793 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.841937 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.841805 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:45.848280 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:45.848257 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsxn\" (UniqueName: \"kubernetes.io/projected/c4fd42b4-2958-4bba-86c8-453f11bee38e-kube-api-access-ldsxn\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:46.033647 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.033619 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerID="ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd" exitCode=0 Jul 17 14:15:46.033647 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.033643 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerID="f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c" exitCode=0 Jul 17 14:15:46.033818 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.033689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd"} Jul 17 14:15:46.033818 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.033731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c"} Jul 17 14:15:46.343075 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.343046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:46.345477 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.345458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-vqp6k\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:46.487002 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.486971 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:15:46.619315 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:46.619284 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k"] Jul 17 14:15:46.620134 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:15:46.620107 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4fd42b4_2958_4bba_86c8_453f11bee38e.slice/crio-250bf658fe9d2fccd5f6389cab902530e1983a78edb4022edccdce097043f8e9 WatchSource:0}: Error finding container 250bf658fe9d2fccd5f6389cab902530e1983a78edb4022edccdce097043f8e9: Status 404 returned error can't find the container with id 250bf658fe9d2fccd5f6389cab902530e1983a78edb4022edccdce097043f8e9 Jul 17 14:15:47.039009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:47.038884 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"54bbb0bc1e200847c96bd1083288b4327310c86e7d7bc81447bfe0f24d8fcf53"} Jul 17 14:15:47.039009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:47.038933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"250bf658fe9d2fccd5f6389cab902530e1983a78edb4022edccdce097043f8e9"} Jul 17 14:15:52.058077 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:52.058041 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerID="54bbb0bc1e200847c96bd1083288b4327310c86e7d7bc81447bfe0f24d8fcf53" exitCode=0 Jul 17 14:15:52.058431 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:52.058104 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"54bbb0bc1e200847c96bd1083288b4327310c86e7d7bc81447bfe0f24d8fcf53"} Jul 17 14:15:53.064514 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:53.064483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"26f80b92ae5c95909090e807b2a95dd334c9f27aa7c815ed451a3ab92ffd0098"} Jul 17 14:15:53.152273 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:53.152220 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 17 14:15:53.824009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:53.823964 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 17 14:15:58.084147 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:58.084112 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerID="26f80b92ae5c95909090e807b2a95dd334c9f27aa7c815ed451a3ab92ffd0098" exitCode=0 Jul 17 14:15:58.084506 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:58.084173 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"26f80b92ae5c95909090e807b2a95dd334c9f27aa7c815ed451a3ab92ffd0098"} Jul 17 14:15:59.093094 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:59.093055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"e50f8e8200aa70e28a1316103ff5405cad9a4b7a2259549d2c814cfd7e0a2a75"} Jul 17 14:15:59.093576 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:59.093115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"85d2cec248b0af72ef08a249d295c26cac8c58427843695082794f809e69b976"} Jul 17 14:15:59.093576 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:59.093137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"76091290bbfeee714cb7163e861f22c63e439334a1783e68107c95dc14063966"} Jul 17 14:15:59.093576 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:59.093156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerStarted","Data":"19ba001a5c742769c2a7d49565cee84d81e00fd58f20c89f124725e9eeadf9af"} Jul 17 14:15:59.125560 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:15:59.125492 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podStartSLOduration=14.125469797 podStartE2EDuration="14.125469797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:15:59.124665329 +0000 UTC m=+1173.428889846" watchObservedRunningTime="2026-07-17 14:15:59.125469797 +0000 UTC m=+1173.429694292" Jul 17 14:16:01.488017 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.487982 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:01.488548 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.488532 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:01.488654 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.488644 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:01.488738 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.488728 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:01.490189 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.490152 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.15:6571: connect: connection refused" Jul 17 14:16:01.490316 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.490228 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 17 14:16:01.490386 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.490315 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.15:8816: connect: connection refused" Jul 17 14:16:01.490485 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:01.490452 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 17 14:16:03.153164 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:03.152723 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 17 14:16:03.824089 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:03.824028 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 17 14:16:04.487846 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.487587 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 17 14:16:04.488598 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.488574 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:04.488852 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.488836 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:04.489298 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.489276 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:04.489385 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.489319 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:04.489443 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.489417 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:04.491135 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.491103 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:04.493739 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:04.493719 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:05.125642 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:05.125611 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:05.128767 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:05.128744 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:06.487645 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:06.487610 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:07.488383 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:07.488355 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:08.138533 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:08.138509 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:16:13.152454 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:13.152415 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 17 14:16:13.152966 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:13.152640 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:16:13.824325 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:13.824280 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 17 14:16:13.824481 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:13.824416 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:16:15.924435 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.924413 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:16:15.969624 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.969593 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b7286a15-29e8-4018-87e8-b6ff5ad235b4-feast-data\") pod \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " Jul 17 14:16:15.969624 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.969624 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-registry-tls\") pod \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " Jul 17 14:16:15.969847 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.969642 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-offline-tls\") pod \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " Jul 17 14:16:15.969847 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.969689 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zww62\" (UniqueName: \"kubernetes.io/projected/b7286a15-29e8-4018-87e8-b6ff5ad235b4-kube-api-access-zww62\") pod \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " Jul 17 14:16:15.969847 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.969731 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-online-tls\") pod \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " Jul 17 14:16:15.969847 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.969758 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-ui-tls\") pod \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\" (UID: \"b7286a15-29e8-4018-87e8-b6ff5ad235b4\") " Jul 17 14:16:15.970230 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.970203 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7286a15-29e8-4018-87e8-b6ff5ad235b4-feast-data" (OuterVolumeSpecName: "feast-data") pod "b7286a15-29e8-4018-87e8-b6ff5ad235b4" (UID: "b7286a15-29e8-4018-87e8-b6ff5ad235b4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:16:15.972282 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.972249 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7286a15-29e8-4018-87e8-b6ff5ad235b4-kube-api-access-zww62" (OuterVolumeSpecName: "kube-api-access-zww62") pod "b7286a15-29e8-4018-87e8-b6ff5ad235b4" (UID: "b7286a15-29e8-4018-87e8-b6ff5ad235b4"). InnerVolumeSpecName "kube-api-access-zww62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:16:15.972408 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.972378 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-online-tls" (OuterVolumeSpecName: "online-tls") pod "b7286a15-29e8-4018-87e8-b6ff5ad235b4" (UID: "b7286a15-29e8-4018-87e8-b6ff5ad235b4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:16:15.972472 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.972401 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b7286a15-29e8-4018-87e8-b6ff5ad235b4" (UID: "b7286a15-29e8-4018-87e8-b6ff5ad235b4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:16:15.972707 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.972690 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b7286a15-29e8-4018-87e8-b6ff5ad235b4" (UID: "b7286a15-29e8-4018-87e8-b6ff5ad235b4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:16:15.972776 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:15.972721 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b7286a15-29e8-4018-87e8-b6ff5ad235b4" (UID: "b7286a15-29e8-4018-87e8-b6ff5ad235b4"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:16:16.070345 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.070244 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-registry-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:16:16.070345 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.070288 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-offline-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:16:16.070345 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.070298 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zww62\" (UniqueName: \"kubernetes.io/projected/b7286a15-29e8-4018-87e8-b6ff5ad235b4-kube-api-access-zww62\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:16:16.070345 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.070308 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-online-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:16:16.070345 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.070315 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b7286a15-29e8-4018-87e8-b6ff5ad235b4-ui-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:16:16.070345 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.070322 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b7286a15-29e8-4018-87e8-b6ff5ad235b4-feast-data\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:16:16.168339 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168301 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerID="82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9" exitCode=137 Jul 17 14:16:16.168339 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168331 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerID="3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283" exitCode=137 Jul 17 14:16:16.168557 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168382 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" Jul 17 14:16:16.168557 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9"} Jul 17 14:16:16.168557 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168436 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283"} Jul 17 14:16:16.168557 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168457 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd" event={"ID":"b7286a15-29e8-4018-87e8-b6ff5ad235b4","Type":"ContainerDied","Data":"6bc4b5e33116fd42c788427a0656aa04927ccbc010447ed9d715f64909c7d462"} Jul 17 14:16:16.168557 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.168493 2558 scope.go:117] "RemoveContainer" containerID="ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd" Jul 17 14:16:16.177217 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.177201 2558 scope.go:117] "RemoveContainer" containerID="82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9" Jul 17 14:16:16.184302 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.184286 2558 scope.go:117] "RemoveContainer" containerID="f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c" Jul 17 14:16:16.187596 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.187578 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd"] Jul 17 14:16:16.192208 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.192189 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-wzrpd"] Jul 17 14:16:16.192540 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.192518 2558 scope.go:117] "RemoveContainer" containerID="3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283" Jul 17 14:16:16.199306 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.199292 2558 scope.go:117] "RemoveContainer" containerID="8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c" Jul 17 14:16:16.205954 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.205926 2558 scope.go:117] "RemoveContainer" containerID="a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7" Jul 17 14:16:16.212264 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.212249 2558 scope.go:117] "RemoveContainer" containerID="ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd" Jul 17 14:16:16.212529 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:16:16.212509 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd\": container with ID starting with ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd not found: ID does not exist" containerID="ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd" Jul 17 14:16:16.212597 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.212536 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd"} err="failed to get container status \"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd\": rpc error: code = NotFound desc = could not find container \"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd\": container with ID starting with ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd not found: ID does not exist" Jul 17 14:16:16.212597 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.212584 2558 scope.go:117] "RemoveContainer" containerID="82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9" Jul 17 14:16:16.212856 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:16:16.212839 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9\": container with ID starting with 82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9 not found: ID does not exist" containerID="82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9" Jul 17 14:16:16.212907 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.212863 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9"} err="failed to get container status \"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9\": rpc error: code = NotFound desc = could not find container \"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9\": container with ID starting with 82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9 not found: ID does not exist" Jul 17 14:16:16.212907 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.212880 2558 scope.go:117] "RemoveContainer" containerID="f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c" Jul 17 14:16:16.213108 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:16:16.213091 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c\": container with ID starting with f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c not found: ID does not exist" containerID="f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c" Jul 17 14:16:16.213151 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213113 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c"} err="failed to get container status \"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c\": rpc error: code = NotFound desc = could not find container \"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c\": container with ID starting with f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c not found: ID does not exist" Jul 17 14:16:16.213151 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213127 2558 scope.go:117] "RemoveContainer" containerID="3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283" Jul 17 14:16:16.213349 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:16:16.213332 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283\": container with ID starting with 3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283 not found: ID does not exist" containerID="3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283" Jul 17 14:16:16.213349 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213355 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283"} err="failed to get container status \"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283\": rpc error: code = NotFound desc = could not find container \"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283\": container with ID starting with 3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283 not found: ID does not exist" Jul 17 14:16:16.213456 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213369 2558 scope.go:117] "RemoveContainer" containerID="8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c" Jul 17 14:16:16.213584 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:16:16.213568 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c\": container with ID starting with 8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c not found: ID does not exist" containerID="8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c" Jul 17 14:16:16.213643 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213588 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c"} err="failed to get container status \"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c\": rpc error: code = NotFound desc = could not find container \"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c\": container with ID starting with 8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c not found: ID does not exist" Jul 17 14:16:16.213643 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213602 2558 scope.go:117] "RemoveContainer" containerID="a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7" Jul 17 14:16:16.213803 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:16:16.213787 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7\": container with ID starting with a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7 not found: ID does not exist" containerID="a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7" Jul 17 14:16:16.213837 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213809 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7"} err="failed to get container status \"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7\": rpc error: code = NotFound desc = could not find container \"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7\": container with ID starting with a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7 not found: ID does not exist" Jul 17 14:16:16.213837 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.213823 2558 scope.go:117] "RemoveContainer" containerID="ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd" Jul 17 14:16:16.214129 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214109 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd"} err="failed to get container status \"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd\": rpc error: code = NotFound desc = could not find container \"ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd\": container with ID starting with ac7697e787b6f4a748f54dfa06e07468f0cc2234cefaaf25361cdaebcd6e9cfd not found: ID does not exist" Jul 17 14:16:16.214129 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214129 2558 scope.go:117] "RemoveContainer" containerID="82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9" Jul 17 14:16:16.214341 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214320 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9"} err="failed to get container status \"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9\": rpc error: code = NotFound desc = could not find container \"82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9\": container with ID starting with 82d4a0177bf46cd21966b019e3144c2bca07f9fadf1c04a65f8c2e40ee97e4c9 not found: ID does not exist" Jul 17 14:16:16.214411 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214344 2558 scope.go:117] "RemoveContainer" containerID="f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c" Jul 17 14:16:16.214565 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214549 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c"} err="failed to get container status \"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c\": rpc error: code = NotFound desc = could not find container \"f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c\": container with ID starting with f0a738a2c6d7d79951e9ad646d90e2175e9207fb6826a8fe9949779d6f34296c not found: ID does not exist" Jul 17 14:16:16.214625 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214565 2558 scope.go:117] "RemoveContainer" containerID="3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283" Jul 17 14:16:16.214738 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214724 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283"} err="failed to get container status \"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283\": rpc error: code = NotFound desc = could not find container \"3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283\": container with ID starting with 3a3c59eaf6d2f01f3647062baa6ea773a929751c51ac9eb7e341788c7f8bd283 not found: ID does not exist" Jul 17 14:16:16.214787 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214737 2558 scope.go:117] "RemoveContainer" containerID="8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c" Jul 17 14:16:16.214902 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214888 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c"} err="failed to get container status \"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c\": rpc error: code = NotFound desc = could not find container \"8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c\": container with ID starting with 8b3ce1f8ae61b34be94727c035b6608a43dd7525ad0b3813e407e75d0b69579c not found: ID does not exist" Jul 17 14:16:16.214972 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.214902 2558 scope.go:117] "RemoveContainer" containerID="a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7" Jul 17 14:16:16.215096 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:16.215079 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7"} err="failed to get container status \"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7\": rpc error: code = NotFound desc = could not find container \"a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7\": container with ID starting with a86e515846a6ed3c67e35dfd8d1542e7b9021b97fac56c391938a48074e492b7 not found: ID does not exist" Jul 17 14:16:18.145820 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:16:18.145786 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" path="/var/lib/kubelet/pods/b7286a15-29e8-4018-87e8-b6ff5ad235b4/volumes" Jul 17 14:17:11.712052 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712018 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2"] Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712246 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="feast-apply" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712256 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="feast-apply" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712267 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="feast-init" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712272 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="feast-init" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712279 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="registry" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712285 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="registry" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712296 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712300 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712310 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="offline" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712315 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="offline" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712342 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712347 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712385 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="online" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712393 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="registry" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712400 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="offline" Jul 17 14:17:11.712471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.712406 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7286a15-29e8-4018-87e8-b6ff5ad235b4" containerName="ui" Jul 17 14:17:11.715584 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.715568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.718481 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.718460 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 17 14:17:11.718774 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.718759 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 17 14:17:11.718925 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.718914 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 17 14:17:11.719332 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.719316 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 17 14:17:11.719404 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.719339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-x4vtv\"" Jul 17 14:17:11.719404 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.719347 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 17 14:17:11.719404 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.719383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 17 14:17:11.730834 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.730813 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2"] Jul 17 14:17:11.749467 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.749439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.749613 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.749507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8fdf7f60-0189-4547-9071-539a5d25666f-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.749613 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.749583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.749613 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.749609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghbsq\" (UniqueName: \"kubernetes.io/projected/8fdf7f60-0189-4547-9071-539a5d25666f-kube-api-access-ghbsq\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.749766 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.749650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.749766 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.749714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdf7f60-0189-4547-9071-539a5d25666f-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850212 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850178 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8fdf7f60-0189-4547-9071-539a5d25666f-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850392 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850392 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghbsq\" (UniqueName: \"kubernetes.io/projected/8fdf7f60-0189-4547-9071-539a5d25666f-kube-api-access-ghbsq\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850392 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850392 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850281 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdf7f60-0189-4547-9071-539a5d25666f-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850392 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850392 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:17:11.850341 2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 17 14:17:11.850702 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:17:11.850410 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls podName:8fdf7f60-0189-4547-9071-539a5d25666f nodeName:}" failed. No retries permitted until 2026-07-17 14:17:12.350393554 +0000 UTC m=+1246.654618025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 17 14:17:11.850702 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:17:11.850344 2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 17 14:17:11.850702 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:17:11.850472 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls podName:8fdf7f60-0189-4547-9071-539a5d25666f nodeName:}" failed. No retries permitted until 2026-07-17 14:17:12.350460189 +0000 UTC m=+1246.654684662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 17 14:17:11.850702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850697 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdf7f60-0189-4547-9071-539a5d25666f-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.850909 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.850889 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8fdf7f60-0189-4547-9071-539a5d25666f-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.852804 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.852781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:11.860867 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:11.860842 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghbsq\" (UniqueName: \"kubernetes.io/projected/8fdf7f60-0189-4547-9071-539a5d25666f-kube-api-access-ghbsq\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:12.354439 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:12.354408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:12.354615 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:12.354447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:12.357023 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:12.357000 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:12.357147 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:12.357060 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:12.624563 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:12.624460 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:12.758034 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:12.758010 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2"] Jul 17 14:17:12.759669 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:17:12.759646 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fdf7f60_0189_4547_9071_539a5d25666f.slice/crio-f4be608bb15532170d5f8f7defbee28b68fc6c62006fd8f4f45155e8114830ff WatchSource:0}: Error finding container f4be608bb15532170d5f8f7defbee28b68fc6c62006fd8f4f45155e8114830ff: Status 404 returned error can't find the container with id f4be608bb15532170d5f8f7defbee28b68fc6c62006fd8f4f45155e8114830ff Jul 17 14:17:13.358530 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:13.358499 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerStarted","Data":"af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468"} Jul 17 14:17:13.358710 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:13.358543 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerStarted","Data":"f4be608bb15532170d5f8f7defbee28b68fc6c62006fd8f4f45155e8114830ff"} Jul 17 14:17:18.377567 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:18.377529 2558 generic.go:356] "Generic (PLEG): container finished" podID="8fdf7f60-0189-4547-9071-539a5d25666f" containerID="af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468" exitCode=0 Jul 17 14:17:18.378071 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:18.377579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerDied","Data":"af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468"} Jul 17 14:17:19.383060 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:19.383016 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerStarted","Data":"6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc"} Jul 17 14:17:24.402302 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:24.402223 2558 generic.go:356] "Generic (PLEG): container finished" podID="8fdf7f60-0189-4547-9071-539a5d25666f" containerID="6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc" exitCode=0 Jul 17 14:17:24.402302 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:24.402277 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerDied","Data":"6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc"} Jul 17 14:17:25.410575 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:25.410537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerStarted","Data":"a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457"} Jul 17 14:17:25.410964 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:25.410600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerStarted","Data":"82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7"} Jul 17 14:17:25.410964 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:25.410621 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerStarted","Data":"68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa"} Jul 17 14:17:25.442595 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:25.442534 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podStartSLOduration=14.442509752 podStartE2EDuration="14.442509752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:17:25.440959863 +0000 UTC m=+1259.745184386" watchObservedRunningTime="2026-07-17 14:17:25.442509752 +0000 UTC m=+1259.746734247" Jul 17 14:17:27.625316 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:27.625270 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:27.625796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:27.625343 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:27.625796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:27.625360 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:27.627143 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:27.627114 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 17 14:17:27.627274 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:27.627159 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 17 14:17:27.627274 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:27.627164 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.16:8816: connect: connection refused" Jul 17 14:17:30.625546 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:30.625515 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:30.628069 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:30.626078 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:30.628069 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:30.626112 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:30.628069 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:30.626319 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:30.631904 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:30.631884 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:31.437239 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:31.437214 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:31.437442 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:31.437260 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:31.437772 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:31.437751 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:17:31.441566 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:17:31.441539 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:18:33.260860 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.260819 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2"] Jul 17 14:18:33.261373 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.261115 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" containerID="cri-o://68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa" gracePeriod=30 Jul 17 14:18:33.261373 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.261204 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" containerID="cri-o://a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457" gracePeriod=30 Jul 17 14:18:33.261373 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.261226 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="offline" containerID="cri-o://82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7" gracePeriod=30 Jul 17 14:18:33.409562 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.409525 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k"] Jul 17 14:18:33.409876 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.409843 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="registry" containerID="cri-o://19ba001a5c742769c2a7d49565cee84d81e00fd58f20c89f124725e9eeadf9af" gracePeriod=30 Jul 17 14:18:33.410130 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.409918 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="offline" containerID="cri-o://85d2cec248b0af72ef08a249d295c26cac8c58427843695082794f809e69b976" gracePeriod=30 Jul 17 14:18:33.410244 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.409903 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" containerID="cri-o://e50f8e8200aa70e28a1316103ff5405cad9a4b7a2259549d2c814cfd7e0a2a75" gracePeriod=30 Jul 17 14:18:33.410314 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:33.409967 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" containerID="cri-o://76091290bbfeee714cb7163e861f22c63e439334a1783e68107c95dc14063966" gracePeriod=30 Jul 17 14:18:34.649911 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.649877 2558 generic.go:356] "Generic (PLEG): container finished" podID="8fdf7f60-0189-4547-9071-539a5d25666f" containerID="a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457" exitCode=0 Jul 17 14:18:34.649911 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.649900 2558 generic.go:356] "Generic (PLEG): container finished" podID="8fdf7f60-0189-4547-9071-539a5d25666f" containerID="68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa" exitCode=0 Jul 17 14:18:34.650378 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.649966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerDied","Data":"a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457"} Jul 17 14:18:34.650378 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.650006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerDied","Data":"68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa"} Jul 17 14:18:34.652388 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.652368 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerID="e50f8e8200aa70e28a1316103ff5405cad9a4b7a2259549d2c814cfd7e0a2a75" exitCode=0 Jul 17 14:18:34.652388 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.652384 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerID="76091290bbfeee714cb7163e861f22c63e439334a1783e68107c95dc14063966" exitCode=0 Jul 17 14:18:34.652517 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.652416 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"e50f8e8200aa70e28a1316103ff5405cad9a4b7a2259549d2c814cfd7e0a2a75"} Jul 17 14:18:34.652517 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:34.652445 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"76091290bbfeee714cb7163e861f22c63e439334a1783e68107c95dc14063966"} Jul 17 14:18:35.126039 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:35.126006 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 17 14:18:38.138511 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:38.138470 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 17 14:18:41.437791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:41.437743 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 17 14:18:41.437791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:41.437773 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 17 14:18:45.126403 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:45.126360 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 17 14:18:48.138100 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:48.138013 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 17 14:18:51.437670 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:51.437626 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 17 14:18:51.438056 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:51.437633 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 17 14:18:55.126286 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:55.126248 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 17 14:18:55.126717 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:55.126381 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:18:58.138208 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:58.138161 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 17 14:18:58.138579 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:18:58.138303 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:19:01.437292 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:01.437255 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 17 14:19:01.437669 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:01.437261 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 17 14:19:01.437669 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:01.437356 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:19:01.437669 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:01.437474 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:19:03.499258 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.499234 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:19:03.537751 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.537694 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghbsq\" (UniqueName: \"kubernetes.io/projected/8fdf7f60-0189-4547-9071-539a5d25666f-kube-api-access-ghbsq\") pod \"8fdf7f60-0189-4547-9071-539a5d25666f\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " Jul 17 14:19:03.537751 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.537734 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-online-tls\") pod \"8fdf7f60-0189-4547-9071-539a5d25666f\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " Jul 17 14:19:03.537904 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.537757 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8fdf7f60-0189-4547-9071-539a5d25666f-registry-tls\") pod \"8fdf7f60-0189-4547-9071-539a5d25666f\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " Jul 17 14:19:03.537904 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.537801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls\") pod \"8fdf7f60-0189-4547-9071-539a5d25666f\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " Jul 17 14:19:03.537904 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.537823 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdf7f60-0189-4547-9071-539a5d25666f-feast-data\") pod \"8fdf7f60-0189-4547-9071-539a5d25666f\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " Jul 17 14:19:03.537904 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.537856 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls\") pod \"8fdf7f60-0189-4547-9071-539a5d25666f\" (UID: \"8fdf7f60-0189-4547-9071-539a5d25666f\") " Jul 17 14:19:03.538216 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.538187 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fdf7f60-0189-4547-9071-539a5d25666f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8fdf7f60-0189-4547-9071-539a5d25666f" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:19:03.538376 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.538317 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fdf7f60-0189-4547-9071-539a5d25666f-feast-data" (OuterVolumeSpecName: "feast-data") pod "8fdf7f60-0189-4547-9071-539a5d25666f" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:19:03.540143 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.540110 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8fdf7f60-0189-4547-9071-539a5d25666f" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:03.540226 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.540130 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8fdf7f60-0189-4547-9071-539a5d25666f" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:03.540226 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.540141 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-online-tls" (OuterVolumeSpecName: "online-tls") pod "8fdf7f60-0189-4547-9071-539a5d25666f" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:03.540226 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.540170 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fdf7f60-0189-4547-9071-539a5d25666f-kube-api-access-ghbsq" (OuterVolumeSpecName: "kube-api-access-ghbsq") pod "8fdf7f60-0189-4547-9071-539a5d25666f" (UID: "8fdf7f60-0189-4547-9071-539a5d25666f"). InnerVolumeSpecName "kube-api-access-ghbsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:19:03.638682 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.638646 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-online-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:03.638682 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.638679 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8fdf7f60-0189-4547-9071-539a5d25666f-registry-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:03.638682 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.638688 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-offline-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:03.638682 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.638695 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8fdf7f60-0189-4547-9071-539a5d25666f-feast-data\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:03.638881 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.638703 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8fdf7f60-0189-4547-9071-539a5d25666f-ui-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:03.638881 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.638711 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghbsq\" (UniqueName: \"kubernetes.io/projected/8fdf7f60-0189-4547-9071-539a5d25666f-kube-api-access-ghbsq\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:03.753157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.753127 2558 generic.go:356] "Generic (PLEG): container finished" podID="8fdf7f60-0189-4547-9071-539a5d25666f" containerID="82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7" exitCode=137 Jul 17 14:19:03.753284 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.753194 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" Jul 17 14:19:03.753284 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.753208 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerDied","Data":"82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7"} Jul 17 14:19:03.753284 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.753257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2" event={"ID":"8fdf7f60-0189-4547-9071-539a5d25666f","Type":"ContainerDied","Data":"f4be608bb15532170d5f8f7defbee28b68fc6c62006fd8f4f45155e8114830ff"} Jul 17 14:19:03.753284 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.753282 2558 scope.go:117] "RemoveContainer" containerID="a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457" Jul 17 14:19:03.756467 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.756437 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerID="85d2cec248b0af72ef08a249d295c26cac8c58427843695082794f809e69b976" exitCode=137 Jul 17 14:19:03.756467 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.756454 2558 generic.go:356] "Generic (PLEG): container finished" podID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerID="19ba001a5c742769c2a7d49565cee84d81e00fd58f20c89f124725e9eeadf9af" exitCode=137 Jul 17 14:19:03.756626 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.756483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"85d2cec248b0af72ef08a249d295c26cac8c58427843695082794f809e69b976"} Jul 17 14:19:03.756626 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.756513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"19ba001a5c742769c2a7d49565cee84d81e00fd58f20c89f124725e9eeadf9af"} Jul 17 14:19:03.762284 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.762269 2558 scope.go:117] "RemoveContainer" containerID="82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7" Jul 17 14:19:03.769729 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.769711 2558 scope.go:117] "RemoveContainer" containerID="68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa" Jul 17 14:19:03.775285 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.775265 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2"] Jul 17 14:19:03.777640 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.777623 2558 scope.go:117] "RemoveContainer" containerID="6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc" Jul 17 14:19:03.779073 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.779054 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-wzdv2"] Jul 17 14:19:03.784522 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.784507 2558 scope.go:117] "RemoveContainer" containerID="af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468" Jul 17 14:19:03.791157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791143 2558 scope.go:117] "RemoveContainer" containerID="a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457" Jul 17 14:19:03.791401 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:03.791380 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457\": container with ID starting with a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457 not found: ID does not exist" containerID="a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457" Jul 17 14:19:03.791444 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791409 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457"} err="failed to get container status \"a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457\": rpc error: code = NotFound desc = could not find container \"a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457\": container with ID starting with a132e70933b5850b7f679d9e813c07f2f24f9f447b68aaa93774e5b55854b457 not found: ID does not exist" Jul 17 14:19:03.791444 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791427 2558 scope.go:117] "RemoveContainer" containerID="82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7" Jul 17 14:19:03.791661 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:03.791645 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7\": container with ID starting with 82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7 not found: ID does not exist" containerID="82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7" Jul 17 14:19:03.791706 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791667 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7"} err="failed to get container status \"82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7\": rpc error: code = NotFound desc = could not find container \"82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7\": container with ID starting with 82b7159fb1aec7d154b724e28117345d8784768c989ce131e1e6cda1a5d1d9a7 not found: ID does not exist" Jul 17 14:19:03.791706 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791682 2558 scope.go:117] "RemoveContainer" containerID="68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa" Jul 17 14:19:03.791885 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:03.791866 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa\": container with ID starting with 68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa not found: ID does not exist" containerID="68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa" Jul 17 14:19:03.791926 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791890 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa"} err="failed to get container status \"68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa\": rpc error: code = NotFound desc = could not find container \"68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa\": container with ID starting with 68e2f1e24bde45598596a2b34c7903e734001f01d5bd42042df0ec311c6495fa not found: ID does not exist" Jul 17 14:19:03.791926 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.791903 2558 scope.go:117] "RemoveContainer" containerID="6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc" Jul 17 14:19:03.792148 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:03.792121 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc\": container with ID starting with 6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc not found: ID does not exist" containerID="6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc" Jul 17 14:19:03.792148 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.792145 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc"} err="failed to get container status \"6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc\": rpc error: code = NotFound desc = could not find container \"6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc\": container with ID starting with 6b7446c175f6c968b57f869e67b7722b487b73a452a135daa1d7651dc46f5cfc not found: ID does not exist" Jul 17 14:19:03.792291 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.792158 2558 scope.go:117] "RemoveContainer" containerID="af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468" Jul 17 14:19:03.792353 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:03.792338 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468\": container with ID starting with af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468 not found: ID does not exist" containerID="af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468" Jul 17 14:19:03.792390 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:03.792355 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468"} err="failed to get container status \"af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468\": rpc error: code = NotFound desc = could not find container \"af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468\": container with ID starting with af123050a684c4c499261255e593845b80ac2c9d6ea951d341eb0f4008630468 not found: ID does not exist" Jul 17 14:19:04.062388 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.062368 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:19:04.143428 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.143402 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-ui-tls\") pod \"c4fd42b4-2958-4bba-86c8-453f11bee38e\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " Jul 17 14:19:04.143585 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.143433 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls\") pod \"c4fd42b4-2958-4bba-86c8-453f11bee38e\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " Jul 17 14:19:04.143585 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.143451 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4fd42b4-2958-4bba-86c8-453f11bee38e-feast-data\") pod \"c4fd42b4-2958-4bba-86c8-453f11bee38e\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " Jul 17 14:19:04.143585 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.143477 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-offline-tls\") pod \"c4fd42b4-2958-4bba-86c8-453f11bee38e\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " Jul 17 14:19:04.143585 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.143493 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldsxn\" (UniqueName: \"kubernetes.io/projected/c4fd42b4-2958-4bba-86c8-453f11bee38e-kube-api-access-ldsxn\") pod \"c4fd42b4-2958-4bba-86c8-453f11bee38e\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " Jul 17 14:19:04.143585 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.143528 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-registry-tls\") pod \"c4fd42b4-2958-4bba-86c8-453f11bee38e\" (UID: \"c4fd42b4-2958-4bba-86c8-453f11bee38e\") " Jul 17 14:19:04.144076 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.144047 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4fd42b4-2958-4bba-86c8-453f11bee38e-feast-data" (OuterVolumeSpecName: "feast-data") pod "c4fd42b4-2958-4bba-86c8-453f11bee38e" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:19:04.146000 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.145971 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c4fd42b4-2958-4bba-86c8-453f11bee38e" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:04.146087 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.146064 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c4fd42b4-2958-4bba-86c8-453f11bee38e" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:04.146142 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.146121 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls" (OuterVolumeSpecName: "online-tls") pod "c4fd42b4-2958-4bba-86c8-453f11bee38e" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:04.146279 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.146242 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4fd42b4-2958-4bba-86c8-453f11bee38e-kube-api-access-ldsxn" (OuterVolumeSpecName: "kube-api-access-ldsxn") pod "c4fd42b4-2958-4bba-86c8-453f11bee38e" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e"). InnerVolumeSpecName "kube-api-access-ldsxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:19:04.146279 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.146267 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c4fd42b4-2958-4bba-86c8-453f11bee38e" (UID: "c4fd42b4-2958-4bba-86c8-453f11bee38e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:19:04.148154 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.148132 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" path="/var/lib/kubelet/pods/8fdf7f60-0189-4547-9071-539a5d25666f/volumes" Jul 17 14:19:04.244966 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.244921 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-offline-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:04.244966 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.244960 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldsxn\" (UniqueName: \"kubernetes.io/projected/c4fd42b4-2958-4bba-86c8-453f11bee38e-kube-api-access-ldsxn\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:04.244966 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.244971 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-registry-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:04.245210 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.244979 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-ui-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:04.245210 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.244987 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4fd42b4-2958-4bba-86c8-453f11bee38e-online-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:04.245210 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.244994 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4fd42b4-2958-4bba-86c8-453f11bee38e-feast-data\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:04.763264 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.763232 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" event={"ID":"c4fd42b4-2958-4bba-86c8-453f11bee38e","Type":"ContainerDied","Data":"250bf658fe9d2fccd5f6389cab902530e1983a78edb4022edccdce097043f8e9"} Jul 17 14:19:04.763683 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.763277 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k" Jul 17 14:19:04.763683 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.763293 2558 scope.go:117] "RemoveContainer" containerID="e50f8e8200aa70e28a1316103ff5405cad9a4b7a2259549d2c814cfd7e0a2a75" Jul 17 14:19:04.771652 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.771636 2558 scope.go:117] "RemoveContainer" containerID="85d2cec248b0af72ef08a249d295c26cac8c58427843695082794f809e69b976" Jul 17 14:19:04.778784 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.778763 2558 scope.go:117] "RemoveContainer" containerID="76091290bbfeee714cb7163e861f22c63e439334a1783e68107c95dc14063966" Jul 17 14:19:04.783080 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.783060 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k"] Jul 17 14:19:04.786298 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.786278 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-vqp6k"] Jul 17 14:19:04.787156 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.787142 2558 scope.go:117] "RemoveContainer" containerID="19ba001a5c742769c2a7d49565cee84d81e00fd58f20c89f124725e9eeadf9af" Jul 17 14:19:04.794018 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.793998 2558 scope.go:117] "RemoveContainer" containerID="26f80b92ae5c95909090e807b2a95dd334c9f27aa7c815ed451a3ab92ffd0098" Jul 17 14:19:04.800602 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:04.800584 2558 scope.go:117] "RemoveContainer" containerID="54bbb0bc1e200847c96bd1083288b4327310c86e7d7bc81447bfe0f24d8fcf53" Jul 17 14:19:06.145618 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:06.145589 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" path="/var/lib/kubelet/pods/c4fd42b4-2958-4bba-86c8-453f11bee38e/volumes" Jul 17 14:19:21.998840 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:21.998800 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl"] Jul 17 14:19:21.999364 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:21.999032 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" podUID="b038f32e-387b-4ebc-abf4-ab0580bc14aa" containerName="manager" containerID="cri-o://2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a" gracePeriod=10 Jul 17 14:19:22.246622 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.246600 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:19:22.371867 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.371839 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dxqd\" (UniqueName: \"kubernetes.io/projected/b038f32e-387b-4ebc-abf4-ab0580bc14aa-kube-api-access-8dxqd\") pod \"b038f32e-387b-4ebc-abf4-ab0580bc14aa\" (UID: \"b038f32e-387b-4ebc-abf4-ab0580bc14aa\") " Jul 17 14:19:22.374044 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.374020 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b038f32e-387b-4ebc-abf4-ab0580bc14aa-kube-api-access-8dxqd" (OuterVolumeSpecName: "kube-api-access-8dxqd") pod "b038f32e-387b-4ebc-abf4-ab0580bc14aa" (UID: "b038f32e-387b-4ebc-abf4-ab0580bc14aa"). InnerVolumeSpecName "kube-api-access-8dxqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:19:22.472636 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.472607 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dxqd\" (UniqueName: \"kubernetes.io/projected/b038f32e-387b-4ebc-abf4-ab0580bc14aa-kube-api-access-8dxqd\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:19:22.825219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.825133 2558 generic.go:356] "Generic (PLEG): container finished" podID="b038f32e-387b-4ebc-abf4-ab0580bc14aa" containerID="2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a" exitCode=0 Jul 17 14:19:22.825219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.825182 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" Jul 17 14:19:22.825219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.825195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" event={"ID":"b038f32e-387b-4ebc-abf4-ab0580bc14aa","Type":"ContainerDied","Data":"2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a"} Jul 17 14:19:22.825488 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.825234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl" event={"ID":"b038f32e-387b-4ebc-abf4-ab0580bc14aa","Type":"ContainerDied","Data":"79a1ce7d9ba79aaf8f3bec35aa9f5a422ebece83978c6f9bc0618b79b15e782b"} Jul 17 14:19:22.825488 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.825255 2558 scope.go:117] "RemoveContainer" containerID="2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a" Jul 17 14:19:22.833696 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.833681 2558 scope.go:117] "RemoveContainer" containerID="2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a" Jul 17 14:19:22.833972 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:22.833927 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a\": container with ID starting with 2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a not found: ID does not exist" containerID="2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a" Jul 17 14:19:22.834087 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.833977 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a"} err="failed to get container status \"2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a\": rpc error: code = NotFound desc = could not find container \"2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a\": container with ID starting with 2d89fef01b81e2a9c9875734303686424f714a11ec4bfeb5462a7068856b016a not found: ID does not exist" Jul 17 14:19:22.845681 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.845660 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl"] Jul 17 14:19:22.851422 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:22.851401 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-rwhgl"] Jul 17 14:19:24.145757 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:24.145716 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b038f32e-387b-4ebc-abf4-ab0580bc14aa" path="/var/lib/kubelet/pods/b038f32e-387b-4ebc-abf4-ab0580bc14aa/volumes" Jul 17 14:19:26.952685 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952653 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp"] Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952868 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="registry" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952878 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="registry" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952887 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="feast-apply" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952892 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="feast-apply" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952901 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b038f32e-387b-4ebc-abf4-ab0580bc14aa" containerName="manager" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952907 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b038f32e-387b-4ebc-abf4-ab0580bc14aa" containerName="manager" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952914 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="offline" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952919 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="offline" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952926 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952932 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952937 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952955 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952961 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="offline" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952967 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="offline" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952972 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="feast-init" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952977 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="feast-init" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952982 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952986 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.952995 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953000 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953008 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="feast-init" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953013 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="feast-init" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953019 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="feast-apply" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953024 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="feast-apply" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953054 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="online" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953061 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b038f32e-387b-4ebc-abf4-ab0580bc14aa" containerName="manager" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953066 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="online" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953071 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="ui" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953076 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="offline" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953081 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="ui" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953086 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4fd42b4-2958-4bba-86c8-453f11bee38e" containerName="registry" Jul 17 14:19:26.953085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.953091 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fdf7f60-0189-4547-9071-539a5d25666f" containerName="offline" Jul 17 14:19:26.957000 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.956984 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:26.959633 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.959614 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-stj5k\"" Jul 17 14:19:26.959844 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.959829 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 17 14:19:26.960696 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.960682 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 17 14:19:26.964424 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:26.964401 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp"] Jul 17 14:19:27.004553 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.004515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4222z\" (UniqueName: \"kubernetes.io/projected/735e2da0-063a-4906-98db-e3911b37d31a-kube-api-access-4222z\") pod \"feast-operator-controller-manager-7cb4c6bbd6-xtwpp\" (UID: \"735e2da0-063a-4906-98db-e3911b37d31a\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:27.105862 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.105827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4222z\" (UniqueName: \"kubernetes.io/projected/735e2da0-063a-4906-98db-e3911b37d31a-kube-api-access-4222z\") pod \"feast-operator-controller-manager-7cb4c6bbd6-xtwpp\" (UID: \"735e2da0-063a-4906-98db-e3911b37d31a\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:27.124412 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.124384 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4222z\" (UniqueName: \"kubernetes.io/projected/735e2da0-063a-4906-98db-e3911b37d31a-kube-api-access-4222z\") pod \"feast-operator-controller-manager-7cb4c6bbd6-xtwpp\" (UID: \"735e2da0-063a-4906-98db-e3911b37d31a\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:27.267393 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.267317 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:27.398267 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.398242 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp"] Jul 17 14:19:27.400534 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:19:27.400506 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735e2da0_063a_4906_98db_e3911b37d31a.slice/crio-4d6ccdbcb7135bd75ceac4edaf9ab0d3dbcd7ae18666bc2e501da2eeab50e5f7 WatchSource:0}: Error finding container 4d6ccdbcb7135bd75ceac4edaf9ab0d3dbcd7ae18666bc2e501da2eeab50e5f7: Status 404 returned error can't find the container with id 4d6ccdbcb7135bd75ceac4edaf9ab0d3dbcd7ae18666bc2e501da2eeab50e5f7 Jul 17 14:19:27.843484 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.843454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" event={"ID":"735e2da0-063a-4906-98db-e3911b37d31a","Type":"ContainerStarted","Data":"64a6696de3673b73873fd3cacacc186b7ab6c776483625587fedfd7037725740"} Jul 17 14:19:27.843484 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.843500 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" event={"ID":"735e2da0-063a-4906-98db-e3911b37d31a","Type":"ContainerStarted","Data":"4d6ccdbcb7135bd75ceac4edaf9ab0d3dbcd7ae18666bc2e501da2eeab50e5f7"} Jul 17 14:19:27.843737 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.843602 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:27.860332 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:27.860278 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" podStartSLOduration=1.860260694 podStartE2EDuration="1.860260694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:19:27.859061498 +0000 UTC m=+1382.163286011" watchObservedRunningTime="2026-07-17 14:19:27.860260694 +0000 UTC m=+1382.164485189" Jul 17 14:19:38.848506 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:38.848478 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-xtwpp" Jul 17 14:19:43.989033 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:43.989000 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch"] Jul 17 14:19:43.993036 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:43.993004 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.014108 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.012516 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 17 14:19:44.014108 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.012728 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 17 14:19:44.014108 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.013007 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 17 14:19:44.014108 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.013542 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-m6pcv\"" Jul 17 14:19:44.014108 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.013829 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 14:19:44.014108 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.013912 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 14:19:44.014437 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.014137 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 17 14:19:44.014437 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.014186 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch"] Jul 17 14:19:44.121403 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.121376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.121572 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.121411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.121572 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.121442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.121572 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.121531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.121721 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.121586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e5454-e61e-4292-83d3-336f28e70779-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.121721 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.121617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdzb6\" (UniqueName: \"kubernetes.io/projected/cb4e5454-e61e-4292-83d3-336f28e70779-kube-api-access-zdzb6\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222056 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222024 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222056 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222273 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222273 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e5454-e61e-4292-83d3-336f28e70779-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222273 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdzb6\" (UniqueName: \"kubernetes.io/projected/cb4e5454-e61e-4292-83d3-336f28e70779-kube-api-access-zdzb6\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222273 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.222273 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:44.222246 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 17 14:19:44.222516 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:19:44.222307 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls podName:cb4e5454-e61e-4292-83d3-336f28e70779 nodeName:}" failed. No retries permitted until 2026-07-17 14:19:44.722287599 +0000 UTC m=+1399.026512076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls") pod "feast-simple-feast-setup-796bc5bb56-twwch" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779") : secret "feast-simple-feast-setup-ui-tls" not found Jul 17 14:19:44.222590 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.222570 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e5454-e61e-4292-83d3-336f28e70779-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.224680 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.224655 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.224783 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.224695 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.224783 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.224776 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.231359 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.231336 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdzb6\" (UniqueName: \"kubernetes.io/projected/cb4e5454-e61e-4292-83d3-336f28e70779-kube-api-access-zdzb6\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.726540 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.726511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.729103 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.729077 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-twwch\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:44.921671 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:44.921638 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:45.054116 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:45.054086 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch"] Jul 17 14:19:45.055372 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:19:45.055346 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb4e5454_e61e_4292_83d3_336f28e70779.slice/crio-f0b574993f48fb8c1c044e666fece656882bbb6f1d2f140fb7548179bbc5142e WatchSource:0}: Error finding container f0b574993f48fb8c1c044e666fece656882bbb6f1d2f140fb7548179bbc5142e: Status 404 returned error can't find the container with id f0b574993f48fb8c1c044e666fece656882bbb6f1d2f140fb7548179bbc5142e Jul 17 14:19:45.905279 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:45.905242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"252e96adbb3e092957101109ec92a130a50772da4365edbfbb65e3d28cefad04"} Jul 17 14:19:45.905279 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:45.905284 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"f0b574993f48fb8c1c044e666fece656882bbb6f1d2f140fb7548179bbc5142e"} Jul 17 14:19:49.920549 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:49.920518 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb4e5454-e61e-4292-83d3-336f28e70779" containerID="252e96adbb3e092957101109ec92a130a50772da4365edbfbb65e3d28cefad04" exitCode=0 Jul 17 14:19:49.920901 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:49.920596 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"252e96adbb3e092957101109ec92a130a50772da4365edbfbb65e3d28cefad04"} Jul 17 14:19:50.926714 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:50.926676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"ac97ac531e3ab37a4250079dd0f5bcc6a367d47f96e9a79db528dba13eba30fa"} Jul 17 14:19:55.949857 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:55.949819 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb4e5454-e61e-4292-83d3-336f28e70779" containerID="ac97ac531e3ab37a4250079dd0f5bcc6a367d47f96e9a79db528dba13eba30fa" exitCode=0 Jul 17 14:19:55.950356 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:55.949896 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"ac97ac531e3ab37a4250079dd0f5bcc6a367d47f96e9a79db528dba13eba30fa"} Jul 17 14:19:56.959151 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:56.959101 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"be0be09a1f812ae06f56eeee45f614f6e5965a9155497648cc067f21f28f385a"} Jul 17 14:19:56.959629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:56.959176 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"a587a216d74405ca0908e525ded4cae61b7968b2da372c58d8ab592e010ea9bd"} Jul 17 14:19:56.959629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:56.959198 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"4dcdafdd5501039ba48d69b274de2e9a3e0d7024bf1b9da97e071fe5e063d6e0"} Jul 17 14:19:56.959629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:56.959214 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerStarted","Data":"6d5921eb266778cbfe2f4fb570fd793880e98f426c7485f4201d0e498795f183"} Jul 17 14:19:56.989542 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:56.989477 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podStartSLOduration=13.989454298 podStartE2EDuration="13.989454298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:19:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:19:56.987054218 +0000 UTC m=+1411.291278713" watchObservedRunningTime="2026-07-17 14:19:56.989454298 +0000 UTC m=+1411.293678794" Jul 17 14:19:59.922643 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.922602 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:59.923237 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.923218 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:59.923359 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.923348 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:59.923762 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.923744 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:19:59.925040 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.924889 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 17 14:19:59.925040 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.924911 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.18:8816: connect: connection refused" Jul 17 14:19:59.925040 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.924932 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 17 14:19:59.925040 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:19:59.924974 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.18:6571: connect: connection refused" Jul 17 14:20:02.923827 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.923798 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924301 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.923985 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924301 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.924267 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924429 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.924314 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924429 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.924332 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924429 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.924349 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924794 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.924775 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.924885 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.924837 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.926069 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.926054 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.928692 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.928675 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.985109 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.985083 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:20:02.988292 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:20:02.988268 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:21:05.201620 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.201589 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch"] Jul 17 14:21:05.202157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.201809 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="registry" containerID="cri-o://6d5921eb266778cbfe2f4fb570fd793880e98f426c7485f4201d0e498795f183" gracePeriod=30 Jul 17 14:21:05.202157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.201876 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" containerID="cri-o://4dcdafdd5501039ba48d69b274de2e9a3e0d7024bf1b9da97e071fe5e063d6e0" gracePeriod=30 Jul 17 14:21:05.202157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.201907 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" containerID="cri-o://be0be09a1f812ae06f56eeee45f614f6e5965a9155497648cc067f21f28f385a" gracePeriod=30 Jul 17 14:21:05.202157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.201892 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="offline" containerID="cri-o://a587a216d74405ca0908e525ded4cae61b7968b2da372c58d8ab592e010ea9bd" gracePeriod=30 Jul 17 14:21:05.614382 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.614336 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w"] Jul 17 14:21:05.618613 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.618593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.621518 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.621494 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-skqmf\"" Jul 17 14:21:05.637273 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.637246 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w"] Jul 17 14:21:05.698466 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.698431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.698466 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.698469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57pj9\" (UniqueName: \"kubernetes.io/projected/f33e4883-3673-42b2-917c-3d138fb7543f-kube-api-access-57pj9\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.698722 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.698492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.698722 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.698540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.698722 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.698598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f33e4883-3673-42b2-917c-3d138fb7543f-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.698722 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.698631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799235 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799235 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799238 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57pj9\" (UniqueName: \"kubernetes.io/projected/f33e4883-3673-42b2-917c-3d138fb7543f-kube-api-access-57pj9\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799489 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799489 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799489 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f33e4883-3673-42b2-917c-3d138fb7543f-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799489 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.799489 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:21:05.799424 2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 17 14:21:05.799721 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:21:05.799496 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls podName:f33e4883-3673-42b2-917c-3d138fb7543f nodeName:}" failed. No retries permitted until 2026-07-17 14:21:06.299475909 +0000 UTC m=+1480.603700381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls") pod "feast-simple-feast-setup-796bc5bb56-jz28w" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f") : secret "feast-simple-feast-setup-offline-tls" not found Jul 17 14:21:05.799803 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.799775 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f33e4883-3673-42b2-917c-3d138fb7543f-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.802039 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.802015 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.802039 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.802025 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.802196 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.802065 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:05.807753 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:05.807726 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57pj9\" (UniqueName: \"kubernetes.io/projected/f33e4883-3673-42b2-917c-3d138fb7543f-kube-api-access-57pj9\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:06.198180 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.198097 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb4e5454-e61e-4292-83d3-336f28e70779" containerID="be0be09a1f812ae06f56eeee45f614f6e5965a9155497648cc067f21f28f385a" exitCode=0 Jul 17 14:21:06.198180 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.198120 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb4e5454-e61e-4292-83d3-336f28e70779" containerID="4dcdafdd5501039ba48d69b274de2e9a3e0d7024bf1b9da97e071fe5e063d6e0" exitCode=0 Jul 17 14:21:06.198180 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.198166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"be0be09a1f812ae06f56eeee45f614f6e5965a9155497648cc067f21f28f385a"} Jul 17 14:21:06.198372 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.198205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"4dcdafdd5501039ba48d69b274de2e9a3e0d7024bf1b9da97e071fe5e063d6e0"} Jul 17 14:21:06.304746 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.304719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:06.307289 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.307267 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-jz28w\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:06.528745 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.528656 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:06.687349 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:06.685190 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w"] Jul 17 14:21:07.202858 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:07.202819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c"} Jul 17 14:21:07.202858 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:07.202867 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"50e4ae774cb47c45218e830a98a713db08bad5cf95023e53e274496b8736ddb9"} Jul 17 14:21:12.221070 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:12.221033 2558 generic.go:356] "Generic (PLEG): container finished" podID="f33e4883-3673-42b2-917c-3d138fb7543f" containerID="fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c" exitCode=0 Jul 17 14:21:12.221574 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:12.221089 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c"} Jul 17 14:21:12.924720 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:12.924672 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 17 14:21:12.985837 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:12.985796 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 17 14:21:13.226612 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:13.226531 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838"} Jul 17 14:21:18.243218 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:18.243190 2558 generic.go:356] "Generic (PLEG): container finished" podID="f33e4883-3673-42b2-917c-3d138fb7543f" containerID="e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838" exitCode=0 Jul 17 14:21:18.243584 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:18.243234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838"} Jul 17 14:21:19.252658 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:19.252611 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e"} Jul 17 14:21:19.253147 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:19.252672 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38"} Jul 17 14:21:19.253147 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:19.252694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37"} Jul 17 14:21:19.253147 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:19.252712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerStarted","Data":"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61"} Jul 17 14:21:19.278262 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:19.278202 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podStartSLOduration=14.278178449 podStartE2EDuration="14.278178449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:21:19.277363864 +0000 UTC m=+1493.581588388" watchObservedRunningTime="2026-07-17 14:21:19.278178449 +0000 UTC m=+1493.582402944" Jul 17 14:21:21.529916 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.529880 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:21.530561 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.530485 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:21.530561 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.530516 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:21.530561 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.530537 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:21.532099 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.532068 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 17 14:21:21.532311 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.532101 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.19:6571: connect: connection refused" Jul 17 14:21:21.532395 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.532112 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 17 14:21:21.532395 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:21.532140 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.19:8816: connect: connection refused" Jul 17 14:21:22.924840 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:22.924796 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 17 14:21:22.985911 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:22.985853 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 17 14:21:24.529341 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.529300 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 17 14:21:24.530280 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.530257 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:24.530414 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.530348 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:24.530802 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.530778 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:24.530919 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.530819 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:24.531104 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.531084 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:24.531260 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.531246 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:24.535073 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:24.535056 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:25.287190 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:25.287150 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:25.290379 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:25.290357 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:26.528774 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:26.528741 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:27.530464 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:27.530436 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:28.297917 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:28.297888 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:21:32.925419 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:32.925372 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 17 14:21:32.925833 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:32.925518 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:21:32.986029 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:32.985987 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 17 14:21:32.986174 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:32.986088 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:21:35.323657 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.323630 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb4e5454-e61e-4292-83d3-336f28e70779" containerID="a587a216d74405ca0908e525ded4cae61b7968b2da372c58d8ab592e010ea9bd" exitCode=137 Jul 17 14:21:35.323657 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.323651 2558 generic.go:356] "Generic (PLEG): container finished" podID="cb4e5454-e61e-4292-83d3-336f28e70779" containerID="6d5921eb266778cbfe2f4fb570fd793880e98f426c7485f4201d0e498795f183" exitCode=137 Jul 17 14:21:35.324074 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.323710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"a587a216d74405ca0908e525ded4cae61b7968b2da372c58d8ab592e010ea9bd"} Jul 17 14:21:35.324074 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.323751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"6d5921eb266778cbfe2f4fb570fd793880e98f426c7485f4201d0e498795f183"} Jul 17 14:21:35.848673 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.848651 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:21:35.941644 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.941615 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-offline-tls\") pod \"cb4e5454-e61e-4292-83d3-336f28e70779\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " Jul 17 14:21:35.941796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.941652 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdzb6\" (UniqueName: \"kubernetes.io/projected/cb4e5454-e61e-4292-83d3-336f28e70779-kube-api-access-zdzb6\") pod \"cb4e5454-e61e-4292-83d3-336f28e70779\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " Jul 17 14:21:35.941796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.941671 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-online-tls\") pod \"cb4e5454-e61e-4292-83d3-336f28e70779\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " Jul 17 14:21:35.941796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.941706 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-registry-tls\") pod \"cb4e5454-e61e-4292-83d3-336f28e70779\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " Jul 17 14:21:35.941796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.941722 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e5454-e61e-4292-83d3-336f28e70779-feast-data\") pod \"cb4e5454-e61e-4292-83d3-336f28e70779\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " Jul 17 14:21:35.941796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.941753 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls\") pod \"cb4e5454-e61e-4292-83d3-336f28e70779\" (UID: \"cb4e5454-e61e-4292-83d3-336f28e70779\") " Jul 17 14:21:35.942372 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.942334 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4e5454-e61e-4292-83d3-336f28e70779-feast-data" (OuterVolumeSpecName: "feast-data") pod "cb4e5454-e61e-4292-83d3-336f28e70779" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:21:35.944019 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.943991 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4e5454-e61e-4292-83d3-336f28e70779-kube-api-access-zdzb6" (OuterVolumeSpecName: "kube-api-access-zdzb6") pod "cb4e5454-e61e-4292-83d3-336f28e70779" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779"). InnerVolumeSpecName "kube-api-access-zdzb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:21:35.944382 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.944357 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cb4e5454-e61e-4292-83d3-336f28e70779" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:21:35.944531 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.944376 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-online-tls" (OuterVolumeSpecName: "online-tls") pod "cb4e5454-e61e-4292-83d3-336f28e70779" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:21:35.944531 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.944424 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "cb4e5454-e61e-4292-83d3-336f28e70779" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:21:35.944531 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:35.944511 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "cb4e5454-e61e-4292-83d3-336f28e70779" (UID: "cb4e5454-e61e-4292-83d3-336f28e70779"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:21:36.042219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.042165 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-registry-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:21:36.042219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.042186 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cb4e5454-e61e-4292-83d3-336f28e70779-feast-data\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:21:36.042219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.042194 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-ui-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:21:36.042219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.042202 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-offline-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:21:36.042219 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.042210 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdzb6\" (UniqueName: \"kubernetes.io/projected/cb4e5454-e61e-4292-83d3-336f28e70779-kube-api-access-zdzb6\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:21:36.042419 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.042238 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cb4e5454-e61e-4292-83d3-336f28e70779-online-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:21:36.329499 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.329426 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" event={"ID":"cb4e5454-e61e-4292-83d3-336f28e70779","Type":"ContainerDied","Data":"f0b574993f48fb8c1c044e666fece656882bbb6f1d2f140fb7548179bbc5142e"} Jul 17 14:21:36.329499 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.329457 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch" Jul 17 14:21:36.329499 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.329478 2558 scope.go:117] "RemoveContainer" containerID="be0be09a1f812ae06f56eeee45f614f6e5965a9155497648cc067f21f28f385a" Jul 17 14:21:36.338341 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.338320 2558 scope.go:117] "RemoveContainer" containerID="a587a216d74405ca0908e525ded4cae61b7968b2da372c58d8ab592e010ea9bd" Jul 17 14:21:36.346131 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.346109 2558 scope.go:117] "RemoveContainer" containerID="4dcdafdd5501039ba48d69b274de2e9a3e0d7024bf1b9da97e071fe5e063d6e0" Jul 17 14:21:36.350802 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.350780 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch"] Jul 17 14:21:36.355422 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.355352 2558 scope.go:117] "RemoveContainer" containerID="6d5921eb266778cbfe2f4fb570fd793880e98f426c7485f4201d0e498795f183" Jul 17 14:21:36.357245 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.357227 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-twwch"] Jul 17 14:21:36.363085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.363066 2558 scope.go:117] "RemoveContainer" containerID="ac97ac531e3ab37a4250079dd0f5bcc6a367d47f96e9a79db528dba13eba30fa" Jul 17 14:21:36.369570 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:36.369555 2558 scope.go:117] "RemoveContainer" containerID="252e96adbb3e092957101109ec92a130a50772da4365edbfbb65e3d28cefad04" Jul 17 14:21:38.146461 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:21:38.146429 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" path="/var/lib/kubelet/pods/cb4e5454-e61e-4292-83d3-336f28e70779/volumes" Jul 17 14:22:31.016413 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016379 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm"] Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016633 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016644 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016656 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="feast-init" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016660 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="feast-init" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016667 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016673 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016683 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="offline" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016688 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="offline" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016694 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="registry" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016699 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="registry" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016705 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="feast-apply" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016710 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="feast-apply" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016747 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="offline" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016754 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="online" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016761 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="registry" Jul 17 14:22:31.018702 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.016766 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4e5454-e61e-4292-83d3-336f28e70779" containerName="ui" Jul 17 14:22:31.019577 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.019562 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.022224 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.022194 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 17 14:22:31.022401 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.022226 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 17 14:22:31.022401 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.022277 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9cppf\"" Jul 17 14:22:31.023381 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.023256 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 17 14:22:31.023381 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.023281 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 17 14:22:31.023381 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.023307 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 17 14:22:31.023381 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.023320 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 17 14:22:31.031398 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.031377 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm"] Jul 17 14:22:31.123759 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.123729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.123759 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.123761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1176e08f-56b2-48aa-bf31-9601c21e3b4e-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.124009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.123780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.124009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.123795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.124009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.123896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkdrb\" (UniqueName: \"kubernetes.io/projected/1176e08f-56b2-48aa-bf31-9601c21e3b4e-kube-api-access-hkdrb\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.124009 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.123935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1176e08f-56b2-48aa-bf31-9601c21e3b4e-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225162 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkdrb\" (UniqueName: \"kubernetes.io/projected/1176e08f-56b2-48aa-bf31-9601c21e3b4e-kube-api-access-hkdrb\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225350 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1176e08f-56b2-48aa-bf31-9601c21e3b4e-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225350 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225350 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1176e08f-56b2-48aa-bf31-9601c21e3b4e-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225510 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225510 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225666 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225649 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1176e08f-56b2-48aa-bf31-9601c21e3b4e-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.225906 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.225881 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1176e08f-56b2-48aa-bf31-9601c21e3b4e-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.227762 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.227734 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.227845 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.227773 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.227921 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.227900 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.233146 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.233123 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkdrb\" (UniqueName: \"kubernetes.io/projected/1176e08f-56b2-48aa-bf31-9601c21e3b4e-kube-api-access-hkdrb\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.328871 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.328792 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:31.460714 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.460538 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm"] Jul 17 14:22:31.463325 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:22:31.463300 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1176e08f_56b2_48aa_bf31_9601c21e3b4e.slice/crio-e42bf4429166b2dab27892dfbe64774a4a837254b498f3dc43d6c4fc15862d34 WatchSource:0}: Error finding container e42bf4429166b2dab27892dfbe64774a4a837254b498f3dc43d6c4fc15862d34: Status 404 returned error can't find the container with id e42bf4429166b2dab27892dfbe64774a4a837254b498f3dc43d6c4fc15862d34 Jul 17 14:22:31.516969 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:31.516927 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerStarted","Data":"e42bf4429166b2dab27892dfbe64774a4a837254b498f3dc43d6c4fc15862d34"} Jul 17 14:22:32.522410 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:32.522365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerStarted","Data":"389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572"} Jul 17 14:22:36.538910 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:36.538830 2558 generic.go:356] "Generic (PLEG): container finished" podID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerID="389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572" exitCode=0 Jul 17 14:22:36.539296 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:36.538905 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerDied","Data":"389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572"} Jul 17 14:22:37.544328 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:37.544294 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerStarted","Data":"5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842"} Jul 17 14:22:42.563379 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:42.563293 2558 generic.go:356] "Generic (PLEG): container finished" podID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerID="5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842" exitCode=0 Jul 17 14:22:42.563379 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:42.563347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerDied","Data":"5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842"} Jul 17 14:22:43.571231 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:43.571190 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerStarted","Data":"dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a"} Jul 17 14:22:43.571599 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:43.571255 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerStarted","Data":"ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f"} Jul 17 14:22:43.571599 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:43.571275 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerStarted","Data":"284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51"} Jul 17 14:22:43.598843 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:43.598787 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podStartSLOduration=13.598766884 podStartE2EDuration="13.598766884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:22:43.59655124 +0000 UTC m=+1577.900775758" watchObservedRunningTime="2026-07-17 14:22:43.598766884 +0000 UTC m=+1577.902991378" Jul 17 14:22:46.329868 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:46.329792 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:46.329868 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:46.329852 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:46.329868 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:46.329869 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:46.331583 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:46.331548 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Jul 17 14:22:46.331583 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:46.331568 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 17 14:22:46.331778 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:46.331574 2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 17 14:22:49.330195 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.330159 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.330757 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.330729 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.330881 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.330771 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.331018 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.331002 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.336564 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.336544 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.596100 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.596071 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.596285 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.596113 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.596655 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.596638 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:22:49.600488 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:22:49.600453 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:23:52.077120 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.077081 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm"] Jul 17 14:23:52.077681 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.077387 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" containerID="cri-o://284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51" gracePeriod=30 Jul 17 14:23:52.077681 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.077422 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="offline" containerID="cri-o://ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f" gracePeriod=30 Jul 17 14:23:52.077681 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.077426 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" containerID="cri-o://dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a" gracePeriod=30 Jul 17 14:23:52.231383 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.231349 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w"] Jul 17 14:23:52.231671 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.231623 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="registry" containerID="cri-o://d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61" gracePeriod=30 Jul 17 14:23:52.231821 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.231731 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" containerID="cri-o://cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e" gracePeriod=30 Jul 17 14:23:52.231821 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.231753 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" containerID="cri-o://ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37" gracePeriod=30 Jul 17 14:23:52.231821 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.231743 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="offline" containerID="cri-o://fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38" gracePeriod=30 Jul 17 14:23:52.814346 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.814316 2558 generic.go:356] "Generic (PLEG): container finished" podID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerID="dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a" exitCode=0 Jul 17 14:23:52.814346 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.814343 2558 generic.go:356] "Generic (PLEG): container finished" podID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerID="284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51" exitCode=0 Jul 17 14:23:52.814517 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.814392 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerDied","Data":"dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a"} Jul 17 14:23:52.814517 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:52.814448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerDied","Data":"284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51"} Jul 17 14:23:53.820598 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:53.820566 2558 generic.go:356] "Generic (PLEG): container finished" podID="f33e4883-3673-42b2-917c-3d138fb7543f" containerID="cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e" exitCode=0 Jul 17 14:23:53.820598 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:53.820589 2558 generic.go:356] "Generic (PLEG): container finished" podID="f33e4883-3673-42b2-917c-3d138fb7543f" containerID="ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37" exitCode=0 Jul 17 14:23:53.821010 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:53.820635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e"} Jul 17 14:23:53.821010 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:53.820676 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37"} Jul 17 14:23:55.288178 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:55.288137 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 17 14:23:58.298002 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:58.297933 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 17 14:23:59.596515 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:59.596475 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 17 14:23:59.596877 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:23:59.596477 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 17 14:24:05.287556 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:05.287518 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 17 14:24:08.297469 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:08.297431 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 17 14:24:09.596796 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:09.596750 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 17 14:24:09.597175 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:09.596762 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 17 14:24:15.287627 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:15.287587 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 17 14:24:15.288034 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:15.287710 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:24:18.298203 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:18.298163 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 17 14:24:18.298653 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:18.298294 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:24:19.597012 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:19.596978 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 17 14:24:19.597012 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:19.597000 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 17 14:24:19.597430 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:19.597083 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:24:19.597430 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:19.597139 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:24:22.725617 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.725581 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:24:22.821425 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.821400 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-ui-tls\") pod \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " Jul 17 14:24:22.821546 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.821475 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-online-tls\") pod \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " Jul 17 14:24:22.821546 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.821495 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1176e08f-56b2-48aa-bf31-9601c21e3b4e-registry-tls\") pod \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " Jul 17 14:24:22.821546 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.821515 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkdrb\" (UniqueName: \"kubernetes.io/projected/1176e08f-56b2-48aa-bf31-9601c21e3b4e-kube-api-access-hkdrb\") pod \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " Jul 17 14:24:22.821546 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.821542 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-offline-tls\") pod \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " Jul 17 14:24:22.821819 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.821566 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1176e08f-56b2-48aa-bf31-9601c21e3b4e-feast-data\") pod \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\" (UID: \"1176e08f-56b2-48aa-bf31-9601c21e3b4e\") " Jul 17 14:24:22.822149 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.822119 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1176e08f-56b2-48aa-bf31-9601c21e3b4e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1176e08f-56b2-48aa-bf31-9601c21e3b4e" (UID: "1176e08f-56b2-48aa-bf31-9601c21e3b4e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:24:22.822283 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.822197 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1176e08f-56b2-48aa-bf31-9601c21e3b4e-feast-data" (OuterVolumeSpecName: "feast-data") pod "1176e08f-56b2-48aa-bf31-9601c21e3b4e" (UID: "1176e08f-56b2-48aa-bf31-9601c21e3b4e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:24:22.823856 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.823835 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1176e08f-56b2-48aa-bf31-9601c21e3b4e" (UID: "1176e08f-56b2-48aa-bf31-9601c21e3b4e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.823999 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.823854 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1176e08f-56b2-48aa-bf31-9601c21e3b4e" (UID: "1176e08f-56b2-48aa-bf31-9601c21e3b4e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.824279 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.824256 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-online-tls" (OuterVolumeSpecName: "online-tls") pod "1176e08f-56b2-48aa-bf31-9601c21e3b4e" (UID: "1176e08f-56b2-48aa-bf31-9601c21e3b4e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.824279 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.824265 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1176e08f-56b2-48aa-bf31-9601c21e3b4e-kube-api-access-hkdrb" (OuterVolumeSpecName: "kube-api-access-hkdrb") pod "1176e08f-56b2-48aa-bf31-9601c21e3b4e" (UID: "1176e08f-56b2-48aa-bf31-9601c21e3b4e"). InnerVolumeSpecName "kube-api-access-hkdrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:24:22.874350 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.874330 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:24:22.922851 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.922824 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57pj9\" (UniqueName: \"kubernetes.io/projected/f33e4883-3673-42b2-917c-3d138fb7543f-kube-api-access-57pj9\") pod \"f33e4883-3673-42b2-917c-3d138fb7543f\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " Jul 17 14:24:22.923012 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.922891 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-registry-tls\") pod \"f33e4883-3673-42b2-917c-3d138fb7543f\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " Jul 17 14:24:22.923012 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.922916 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f33e4883-3673-42b2-917c-3d138fb7543f-feast-data\") pod \"f33e4883-3673-42b2-917c-3d138fb7543f\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " Jul 17 14:24:22.923012 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.922963 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-ui-tls\") pod \"f33e4883-3673-42b2-917c-3d138fb7543f\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " Jul 17 14:24:22.923012 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.922992 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-online-tls\") pod \"f33e4883-3673-42b2-917c-3d138fb7543f\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " Jul 17 14:24:22.923221 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923019 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls\") pod \"f33e4883-3673-42b2-917c-3d138fb7543f\" (UID: \"f33e4883-3673-42b2-917c-3d138fb7543f\") " Jul 17 14:24:22.923271 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923240 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-online-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:22.923271 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923257 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1176e08f-56b2-48aa-bf31-9601c21e3b4e-registry-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:22.923369 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923271 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkdrb\" (UniqueName: \"kubernetes.io/projected/1176e08f-56b2-48aa-bf31-9601c21e3b4e-kube-api-access-hkdrb\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:22.923369 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923285 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-offline-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:22.923369 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923301 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1176e08f-56b2-48aa-bf31-9601c21e3b4e-feast-data\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:22.923369 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923312 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1176e08f-56b2-48aa-bf31-9601c21e3b4e-ui-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:22.923536 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.923509 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f33e4883-3673-42b2-917c-3d138fb7543f-feast-data" (OuterVolumeSpecName: "feast-data") pod "f33e4883-3673-42b2-917c-3d138fb7543f" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:24:22.925089 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.925067 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f33e4883-3673-42b2-917c-3d138fb7543f" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.925492 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.925472 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f33e4883-3673-42b2-917c-3d138fb7543f" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.925550 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.925488 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-online-tls" (OuterVolumeSpecName: "online-tls") pod "f33e4883-3673-42b2-917c-3d138fb7543f" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.925603 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.925593 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f33e4883-3673-42b2-917c-3d138fb7543f-kube-api-access-57pj9" (OuterVolumeSpecName: "kube-api-access-57pj9") pod "f33e4883-3673-42b2-917c-3d138fb7543f" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f"). InnerVolumeSpecName "kube-api-access-57pj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:24:22.925647 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.925599 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f33e4883-3673-42b2-917c-3d138fb7543f" (UID: "f33e4883-3673-42b2-917c-3d138fb7543f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:24:22.933555 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.933531 2558 generic.go:356] "Generic (PLEG): container finished" podID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerID="ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f" exitCode=137 Jul 17 14:24:22.933668 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.933572 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerDied","Data":"ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f"} Jul 17 14:24:22.933668 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.933600 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" Jul 17 14:24:22.933668 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.933616 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm" event={"ID":"1176e08f-56b2-48aa-bf31-9601c21e3b4e","Type":"ContainerDied","Data":"e42bf4429166b2dab27892dfbe64774a4a837254b498f3dc43d6c4fc15862d34"} Jul 17 14:24:22.933668 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.933635 2558 scope.go:117] "RemoveContainer" containerID="dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a" Jul 17 14:24:22.936675 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.936655 2558 generic.go:356] "Generic (PLEG): container finished" podID="f33e4883-3673-42b2-917c-3d138fb7543f" containerID="fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38" exitCode=137 Jul 17 14:24:22.936675 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.936674 2558 generic.go:356] "Generic (PLEG): container finished" podID="f33e4883-3673-42b2-917c-3d138fb7543f" containerID="d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61" exitCode=137 Jul 17 14:24:22.936839 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.936685 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38"} Jul 17 14:24:22.936839 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.936715 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" Jul 17 14:24:22.936839 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.936725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61"} Jul 17 14:24:22.936839 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.936749 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w" event={"ID":"f33e4883-3673-42b2-917c-3d138fb7543f","Type":"ContainerDied","Data":"50e4ae774cb47c45218e830a98a713db08bad5cf95023e53e274496b8736ddb9"} Jul 17 14:24:22.942234 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.942214 2558 scope.go:117] "RemoveContainer" containerID="ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f" Jul 17 14:24:22.949976 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.949928 2558 scope.go:117] "RemoveContainer" containerID="284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51" Jul 17 14:24:22.956975 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.956937 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm"] Jul 17 14:24:22.957489 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.957469 2558 scope.go:117] "RemoveContainer" containerID="5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842" Jul 17 14:24:22.961048 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.961027 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-vs4tm"] Jul 17 14:24:22.965209 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.965192 2558 scope.go:117] "RemoveContainer" containerID="389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572" Jul 17 14:24:22.971370 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.971349 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w"] Jul 17 14:24:22.972347 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.972335 2558 scope.go:117] "RemoveContainer" containerID="dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a" Jul 17 14:24:22.972579 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:22.972563 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a\": container with ID starting with dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a not found: ID does not exist" containerID="dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a" Jul 17 14:24:22.972628 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.972585 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a"} err="failed to get container status \"dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a\": rpc error: code = NotFound desc = could not find container \"dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a\": container with ID starting with dbdd9fed7c180f9083f99859659b582f29650e904ea72f796a866eec72d0f88a not found: ID does not exist" Jul 17 14:24:22.972628 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.972602 2558 scope.go:117] "RemoveContainer" containerID="ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f" Jul 17 14:24:22.972827 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:22.972813 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f\": container with ID starting with ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f not found: ID does not exist" containerID="ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f" Jul 17 14:24:22.972867 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.972830 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f"} err="failed to get container status \"ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f\": rpc error: code = NotFound desc = could not find container \"ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f\": container with ID starting with ab7b77904a12532d1a63bdb7836dede43b40fa7772b13c42a920b8256d89613f not found: ID does not exist" Jul 17 14:24:22.972867 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.972842 2558 scope.go:117] "RemoveContainer" containerID="284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51" Jul 17 14:24:22.973099 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:22.973082 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51\": container with ID starting with 284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51 not found: ID does not exist" containerID="284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51" Jul 17 14:24:22.973148 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.973106 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51"} err="failed to get container status \"284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51\": rpc error: code = NotFound desc = could not find container \"284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51\": container with ID starting with 284f03061fb8bc653c09f7e2a7747cedd3c7d1d5817ca8195e4fcc9e39c46f51 not found: ID does not exist" Jul 17 14:24:22.973148 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.973121 2558 scope.go:117] "RemoveContainer" containerID="5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842" Jul 17 14:24:22.973337 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:22.973321 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842\": container with ID starting with 5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842 not found: ID does not exist" containerID="5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842" Jul 17 14:24:22.973376 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.973342 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842"} err="failed to get container status \"5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842\": rpc error: code = NotFound desc = could not find container \"5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842\": container with ID starting with 5970c439e24f218ae4f41b131d03ab4c47576f771f4097a7b1e52a2b4b815842 not found: ID does not exist" Jul 17 14:24:22.973376 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.973356 2558 scope.go:117] "RemoveContainer" containerID="389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572" Jul 17 14:24:22.973563 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:22.973543 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572\": container with ID starting with 389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572 not found: ID does not exist" containerID="389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572" Jul 17 14:24:22.973600 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.973567 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572"} err="failed to get container status \"389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572\": rpc error: code = NotFound desc = could not find container \"389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572\": container with ID starting with 389471b0f30f4052ff94a686bdeaa5af09c3f2c50d6ab58b3b4a9132233dd572 not found: ID does not exist" Jul 17 14:24:22.973600 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.973584 2558 scope.go:117] "RemoveContainer" containerID="cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e" Jul 17 14:24:22.975146 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.975130 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-jz28w"] Jul 17 14:24:22.980867 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.980850 2558 scope.go:117] "RemoveContainer" containerID="fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38" Jul 17 14:24:22.987521 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.987506 2558 scope.go:117] "RemoveContainer" containerID="ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37" Jul 17 14:24:22.995711 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:22.995049 2558 scope.go:117] "RemoveContainer" containerID="d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61" Jul 17 14:24:23.002711 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.002694 2558 scope.go:117] "RemoveContainer" containerID="e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838" Jul 17 14:24:23.009138 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.009122 2558 scope.go:117] "RemoveContainer" containerID="fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c" Jul 17 14:24:23.015660 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.015646 2558 scope.go:117] "RemoveContainer" containerID="cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e" Jul 17 14:24:23.015904 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:23.015885 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e\": container with ID starting with cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e not found: ID does not exist" containerID="cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e" Jul 17 14:24:23.015973 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.015911 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e"} err="failed to get container status \"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e\": rpc error: code = NotFound desc = could not find container \"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e\": container with ID starting with cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e not found: ID does not exist" Jul 17 14:24:23.015973 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.015929 2558 scope.go:117] "RemoveContainer" containerID="fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38" Jul 17 14:24:23.016185 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:23.016170 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38\": container with ID starting with fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38 not found: ID does not exist" containerID="fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38" Jul 17 14:24:23.016228 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016192 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38"} err="failed to get container status \"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38\": rpc error: code = NotFound desc = could not find container \"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38\": container with ID starting with fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38 not found: ID does not exist" Jul 17 14:24:23.016228 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016210 2558 scope.go:117] "RemoveContainer" containerID="ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37" Jul 17 14:24:23.016424 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:23.016407 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37\": container with ID starting with ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37 not found: ID does not exist" containerID="ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37" Jul 17 14:24:23.016459 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016429 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37"} err="failed to get container status \"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37\": rpc error: code = NotFound desc = could not find container \"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37\": container with ID starting with ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37 not found: ID does not exist" Jul 17 14:24:23.016459 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016444 2558 scope.go:117] "RemoveContainer" containerID="d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61" Jul 17 14:24:23.016635 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:23.016621 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61\": container with ID starting with d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61 not found: ID does not exist" containerID="d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61" Jul 17 14:24:23.016671 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016641 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61"} err="failed to get container status \"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61\": rpc error: code = NotFound desc = could not find container \"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61\": container with ID starting with d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61 not found: ID does not exist" Jul 17 14:24:23.016671 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016655 2558 scope.go:117] "RemoveContainer" containerID="e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838" Jul 17 14:24:23.016837 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:23.016819 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838\": container with ID starting with e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838 not found: ID does not exist" containerID="e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838" Jul 17 14:24:23.016874 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016840 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838"} err="failed to get container status \"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838\": rpc error: code = NotFound desc = could not find container \"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838\": container with ID starting with e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838 not found: ID does not exist" Jul 17 14:24:23.016874 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.016851 2558 scope.go:117] "RemoveContainer" containerID="fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c" Jul 17 14:24:23.017127 ip-10-0-134-16 kubenswrapper[2558]: E0717 14:24:23.017111 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c\": container with ID starting with fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c not found: ID does not exist" containerID="fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c" Jul 17 14:24:23.017187 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017129 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c"} err="failed to get container status \"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c\": rpc error: code = NotFound desc = could not find container \"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c\": container with ID starting with fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c not found: ID does not exist" Jul 17 14:24:23.017187 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017140 2558 scope.go:117] "RemoveContainer" containerID="cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e" Jul 17 14:24:23.017365 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017346 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e"} err="failed to get container status \"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e\": rpc error: code = NotFound desc = could not find container \"cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e\": container with ID starting with cde02935f32cc44c1a928996372fb8cf9817723445d90ea312e988bf11f44b8e not found: ID does not exist" Jul 17 14:24:23.017402 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017367 2558 scope.go:117] "RemoveContainer" containerID="fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38" Jul 17 14:24:23.017587 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017565 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38"} err="failed to get container status \"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38\": rpc error: code = NotFound desc = could not find container \"fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38\": container with ID starting with fa4bdc1dffe88696312c8e6bdb3b82280daa5ba6c4833c0fc986f6a734819d38 not found: ID does not exist" Jul 17 14:24:23.017587 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017588 2558 scope.go:117] "RemoveContainer" containerID="ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37" Jul 17 14:24:23.017790 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017775 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37"} err="failed to get container status \"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37\": rpc error: code = NotFound desc = could not find container \"ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37\": container with ID starting with ccbcb32dcca7b7aa3d25e11bdd42a12c8bf818d103952d92debfe835e4708b37 not found: ID does not exist" Jul 17 14:24:23.017837 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.017791 2558 scope.go:117] "RemoveContainer" containerID="d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61" Jul 17 14:24:23.018048 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.018032 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61"} err="failed to get container status \"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61\": rpc error: code = NotFound desc = could not find container \"d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61\": container with ID starting with d614db081313af59d681606f73b9f32d980cd323536eb7df6b35271b8df29b61 not found: ID does not exist" Jul 17 14:24:23.018090 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.018048 2558 scope.go:117] "RemoveContainer" containerID="e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838" Jul 17 14:24:23.018240 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.018225 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838"} err="failed to get container status \"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838\": rpc error: code = NotFound desc = could not find container \"e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838\": container with ID starting with e6061121b5777a538ff270da1c850faa206f4cfb480ef62bc58feff6b9d67838 not found: ID does not exist" Jul 17 14:24:23.018240 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.018238 2558 scope.go:117] "RemoveContainer" containerID="fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c" Jul 17 14:24:23.018408 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.018394 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c"} err="failed to get container status \"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c\": rpc error: code = NotFound desc = could not find container \"fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c\": container with ID starting with fecac0115490b723adde96cc16d430c940b8d437495a7a6ce7e0a908560ab72c not found: ID does not exist" Jul 17 14:24:23.023739 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.023724 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57pj9\" (UniqueName: \"kubernetes.io/projected/f33e4883-3673-42b2-917c-3d138fb7543f-kube-api-access-57pj9\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:23.023791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.023741 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-registry-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:23.023791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.023760 2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f33e4883-3673-42b2-917c-3d138fb7543f-feast-data\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:23.023791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.023768 2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-ui-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:23.023791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.023775 2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-online-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:23.023791 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:23.023784 2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f33e4883-3673-42b2-917c-3d138fb7543f-offline-tls\") on node \"ip-10-0-134-16.ec2.internal\" DevicePath \"\"" Jul 17 14:24:24.146327 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:24.146296 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" path="/var/lib/kubelet/pods/1176e08f-56b2-48aa-bf31-9601c21e3b4e/volumes" Jul 17 14:24:24.146799 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:24:24.146784 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" path="/var/lib/kubelet/pods/f33e4883-3673-42b2-917c-3d138fb7543f/volumes" Jul 17 14:25:00.038698 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.038605 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lzz5v/must-gather-6x4zw"] Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.038979 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.038999 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039010 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039019 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039033 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039041 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039051 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="feast-apply" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039059 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="feast-apply" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039072 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="feast-init" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039080 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="feast-init" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039089 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039096 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039111 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="feast-init" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039118 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="feast-init" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039133 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="feast-apply" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039140 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="feast-apply" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039148 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="registry" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039154 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="registry" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039180 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="offline" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039188 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="offline" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039200 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="offline" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039207 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="offline" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039277 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="offline" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039287 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="online" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039296 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="offline" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039304 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="registry" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039313 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="ui" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039322 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1176e08f-56b2-48aa-bf31-9601c21e3b4e" containerName="online" Jul 17 14:25:00.039348 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.039331 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f33e4883-3673-42b2-917c-3d138fb7543f" containerName="ui" Jul 17 14:25:00.042210 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.042191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.044815 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.044796 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lzz5v\"/\"openshift-service-ca.crt\"" Jul 17 14:25:00.045102 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.045088 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lzz5v\"/\"kube-root-ca.crt\"" Jul 17 14:25:00.046248 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.046231 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lzz5v\"/\"default-dockercfg-st7cx\"" Jul 17 14:25:00.050557 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.050535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/must-gather-6x4zw"] Jul 17 14:25:00.170213 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.170181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6d7471f-3ecd-48a5-afd2-9d18b85b0171-must-gather-output\") pod \"must-gather-6x4zw\" (UID: \"b6d7471f-3ecd-48a5-afd2-9d18b85b0171\") " pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.170377 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.170217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmkxw\" (UniqueName: \"kubernetes.io/projected/b6d7471f-3ecd-48a5-afd2-9d18b85b0171-kube-api-access-wmkxw\") pod \"must-gather-6x4zw\" (UID: \"b6d7471f-3ecd-48a5-afd2-9d18b85b0171\") " pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.271492 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.271451 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6d7471f-3ecd-48a5-afd2-9d18b85b0171-must-gather-output\") pod \"must-gather-6x4zw\" (UID: \"b6d7471f-3ecd-48a5-afd2-9d18b85b0171\") " pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.271492 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.271495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkxw\" (UniqueName: \"kubernetes.io/projected/b6d7471f-3ecd-48a5-afd2-9d18b85b0171-kube-api-access-wmkxw\") pod \"must-gather-6x4zw\" (UID: \"b6d7471f-3ecd-48a5-afd2-9d18b85b0171\") " pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.271803 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.271781 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6d7471f-3ecd-48a5-afd2-9d18b85b0171-must-gather-output\") pod \"must-gather-6x4zw\" (UID: \"b6d7471f-3ecd-48a5-afd2-9d18b85b0171\") " pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.281171 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.281147 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmkxw\" (UniqueName: \"kubernetes.io/projected/b6d7471f-3ecd-48a5-afd2-9d18b85b0171-kube-api-access-wmkxw\") pod \"must-gather-6x4zw\" (UID: \"b6d7471f-3ecd-48a5-afd2-9d18b85b0171\") " pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.351810 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.351774 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/must-gather-6x4zw" Jul 17 14:25:00.478885 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.478778 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/must-gather-6x4zw"] Jul 17 14:25:00.481555 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:25:00.481517 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6d7471f_3ecd_48a5_afd2_9d18b85b0171.slice/crio-dacad6345f066a515498e5417fc7b72dd344fd3fc36ad858daa036ff0cac9263 WatchSource:0}: Error finding container dacad6345f066a515498e5417fc7b72dd344fd3fc36ad858daa036ff0cac9263: Status 404 returned error can't find the container with id dacad6345f066a515498e5417fc7b72dd344fd3fc36ad858daa036ff0cac9263 Jul 17 14:25:00.483608 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:00.483592 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:25:01.058816 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:01.058782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/must-gather-6x4zw" event={"ID":"b6d7471f-3ecd-48a5-afd2-9d18b85b0171","Type":"ContainerStarted","Data":"dacad6345f066a515498e5417fc7b72dd344fd3fc36ad858daa036ff0cac9263"} Jul 17 14:25:02.064850 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:02.064816 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/must-gather-6x4zw" event={"ID":"b6d7471f-3ecd-48a5-afd2-9d18b85b0171","Type":"ContainerStarted","Data":"4ee4862a9b57994b670d2687be9acb4e8bbffaf768aa4fdc4360806548c65d5a"} Jul 17 14:25:02.065329 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:02.064864 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/must-gather-6x4zw" event={"ID":"b6d7471f-3ecd-48a5-afd2-9d18b85b0171","Type":"ContainerStarted","Data":"583c7cd558424c105e1babdf630b0f2238ab3bf40a23efe0ba2988c1d280cd28"} Jul 17 14:25:02.095624 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:02.095573 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lzz5v/must-gather-6x4zw" podStartSLOduration=0.984126767 podStartE2EDuration="2.095556839s" totalImagesPullingTime="1.111430072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:25:02.094611344 +0000 UTC m=+1716.398835835" watchObservedRunningTime="2026-07-17 14:25:02.095556839 +0000 UTC m=+1716.399781334" Jul 17 14:25:03.012660 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:03.012627 2558 ???:1] "http2: server: error reading preface from client 10.0.139.104:45412: read tcp 10.0.134.16:10250->10.0.139.104:45412: read: connection reset by peer" Jul 17 14:25:03.017173 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:03.017151 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k9p82_eebe6ce6-e0a9-4843-8637-50442dae55cc/global-pull-secret-syncer/0.log" Jul 17 14:25:03.147532 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:03.147506 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-px25f_5a7db551-5085-4639-951b-cfb8e086fbea/konnectivity-agent/0.log" Jul 17 14:25:03.206374 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:03.206349 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-16.ec2.internal_e3e9fe71abb26609a391ecb4a06dc6f1/haproxy/0.log" Jul 17 14:25:06.847548 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:06.847504 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtczx_2fd95457-e8b9-4407-9060-e21ac7688ccb/node-exporter/0.log" Jul 17 14:25:06.877289 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:06.877250 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtczx_2fd95457-e8b9-4407-9060-e21ac7688ccb/kube-rbac-proxy/0.log" Jul 17 14:25:06.911018 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:06.910991 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qtczx_2fd95457-e8b9-4407-9060-e21ac7688ccb/init-textfile/0.log" Jul 17 14:25:10.518193 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.518160 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk"] Jul 17 14:25:10.524343 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.524316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.550515 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.550481 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk"] Jul 17 14:25:10.658882 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.658854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-lib-modules\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.658882 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.658886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-sys\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.659094 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.658911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-podres\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.659094 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.658963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-proc\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.659094 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.659005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mbs\" (UniqueName: \"kubernetes.io/projected/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-kube-api-access-b7mbs\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.759888 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.759848 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-sys\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760280 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-podres\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760484 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-proc\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760484 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760472 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-podres\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760168 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-sys\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760523 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-proc\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mbs\" (UniqueName: \"kubernetes.io/projected/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-kube-api-access-b7mbs\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760629 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-lib-modules\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.760763 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.760686 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-lib-modules\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.772927 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.772864 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mbs\" (UniqueName: \"kubernetes.io/projected/887e3e5d-f65e-4c0d-bd77-b19cc82fb633-kube-api-access-b7mbs\") pod \"perf-node-gather-daemonset-qp6fk\" (UID: \"887e3e5d-f65e-4c0d-bd77-b19cc82fb633\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.836469 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.836444 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:10.994355 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:10.994328 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk"] Jul 17 14:25:10.997385 ip-10-0-134-16 kubenswrapper[2558]: W0717 14:25:10.997357 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod887e3e5d_f65e_4c0d_bd77_b19cc82fb633.slice/crio-d718470a597159529b94bc9dd3e081393c79c6795fc795aa2f98105237535dfc WatchSource:0}: Error finding container d718470a597159529b94bc9dd3e081393c79c6795fc795aa2f98105237535dfc: Status 404 returned error can't find the container with id d718470a597159529b94bc9dd3e081393c79c6795fc795aa2f98105237535dfc Jul 17 14:25:11.100926 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:11.100891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" event={"ID":"887e3e5d-f65e-4c0d-bd77-b19cc82fb633","Type":"ContainerStarted","Data":"0ec3ee733ff946a0f8383d9267af0956a51661de6dca6342694505f8b7c532d2"} Jul 17 14:25:11.101086 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:11.100967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" event={"ID":"887e3e5d-f65e-4c0d-bd77-b19cc82fb633","Type":"ContainerStarted","Data":"d718470a597159529b94bc9dd3e081393c79c6795fc795aa2f98105237535dfc"} Jul 17 14:25:11.101086 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:11.100994 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:11.668598 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:11.668573 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kp7vp_bdf205cc-9b0c-4922-887c-f4c649997a45/dns/0.log" Jul 17 14:25:11.694614 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:11.694594 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kp7vp_bdf205cc-9b0c-4922-887c-f4c649997a45/kube-rbac-proxy/0.log" Jul 17 14:25:11.886036 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:11.886002 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xp828_60ab99af-b28e-46ef-89b4-f9764467afd5/dns-node-resolver/0.log" Jul 17 14:25:12.301062 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:12.301039 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cnv6g_57d54756-8102-4290-9421-76f8e6cf35ba/node-ca/0.log" Jul 17 14:25:13.415525 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:13.415495 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktvbb_ae1bee57-cec3-45a0-8528-778b1f82a7fe/serve-healthcheck-canary/0.log" Jul 17 14:25:13.792479 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:13.792417 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2trzp_58f769ee-bef0-4091-85b5-e0c672ac8d5a/kube-rbac-proxy/0.log" Jul 17 14:25:13.818735 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:13.818707 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2trzp_58f769ee-bef0-4091-85b5-e0c672ac8d5a/exporter/0.log" Jul 17 14:25:13.845772 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:13.845742 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2trzp_58f769ee-bef0-4091-85b5-e0c672ac8d5a/extractor/0.log" Jul 17 14:25:17.114144 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:17.114115 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" Jul 17 14:25:17.140133 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:17.140080 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-qp6fk" podStartSLOduration=7.140061801 podStartE2EDuration="7.140061801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:25:11.119269393 +0000 UTC m=+1725.423493887" watchObservedRunningTime="2026-07-17 14:25:17.140061801 +0000 UTC m=+1731.444286298" Jul 17 14:25:18.197676 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:18.197642 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dvmw4_008685d0-d9e2-4fb2-bc34-0a3565b526bd/migrator/0.log" Jul 17 14:25:18.221271 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:18.221243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-dvmw4_008685d0-d9e2-4fb2-bc34-0a3565b526bd/graceful-termination/0.log" Jul 17 14:25:19.947695 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:19.947673 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/kube-multus-additional-cni-plugins/0.log" Jul 17 14:25:19.985322 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:19.985294 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/egress-router-binary-copy/0.log" Jul 17 14:25:20.022052 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.022025 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/cni-plugins/0.log" Jul 17 14:25:20.059999 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.059976 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/bond-cni-plugin/0.log" Jul 17 14:25:20.094471 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.094437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/routeoverride-cni/0.log" Jul 17 14:25:20.125394 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.125369 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/whereabouts-cni-bincopy/0.log" Jul 17 14:25:20.166620 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.166571 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lkxgv_80fd97b5-28ff-41f5-a5c3-165adb0a9658/whereabouts-cni/0.log" Jul 17 14:25:20.470157 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.470052 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j7bgz_103dfdec-f2be-4ef0-96cd-c79da288d4ea/kube-multus/0.log" Jul 17 14:25:20.658258 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.658231 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pjbcl_a714ebca-dbfe-48ad-9e99-9b6233cb37bd/network-metrics-daemon/0.log" Jul 17 14:25:20.692085 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:20.692064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pjbcl_a714ebca-dbfe-48ad-9e99-9b6233cb37bd/kube-rbac-proxy/0.log" Jul 17 14:25:22.135083 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.135048 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/ovn-controller/0.log" Jul 17 14:25:22.161902 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.161875 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/ovn-acl-logging/0.log" Jul 17 14:25:22.192165 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.192143 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/kube-rbac-proxy-node/0.log" Jul 17 14:25:22.222054 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.222032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:25:22.248187 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.248167 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/northd/0.log" Jul 17 14:25:22.274856 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.274831 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/nbdb/0.log" Jul 17 14:25:22.301276 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.301256 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/sbdb/0.log" Jul 17 14:25:22.346293 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:22.346270 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sf8nn_da2a5494-1918-4868-908b-d8da3b8e555a/ovnkube-controller/0.log" Jul 17 14:25:23.514461 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:23.514433 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-87p6v_4bd06048-0a13-4f9c-9059-2a4a761adc5c/network-check-target-container/0.log" Jul 17 14:25:24.532277 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:24.532234 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hh659_84926149-0ab6-4860-b50f-953947c3662d/iptables-alerter/0.log" Jul 17 14:25:25.376874 ip-10-0-134-16 kubenswrapper[2558]: I0717 14:25:25.376837 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nj9rr_95cbed5b-456c-4238-809c-84ad9160bc6c/tuned/0.log"