Jul 28 13:40:42.812690 ip-10-0-136-179 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 13:40:42.812701 ip-10-0-136-179 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 13:40:42.812708 ip-10-0-136-179 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 13:40:42.812924 ip-10-0-136-179 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 13:40:52.890694 ip-10-0-136-179 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 13:40:52.890712 ip-10-0-136-179 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d7de04075d514b4abb7a6fc328837940 -- Jul 28 13:42:24.596648 ip-10-0-136-179 systemd[1]: Starting Kubernetes Kubelet... Jul 28 13:42:25.046012 ip-10-0-136-179 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:42:25.046012 ip-10-0-136-179 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 13:42:25.046012 ip-10-0-136-179 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:42:25.046012 ip-10-0-136-179 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 13:42:25.046012 ip-10-0-136-179 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 13:42:25.047049 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.046964 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 13:42:25.053793 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053769 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:42:25.053793 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053788 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:42:25.053793 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053792 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:42:25.053793 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053795 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:42:25.053793 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053799 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:42:25.053793 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053801 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053805 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053809 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053812 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053815 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053818 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053821 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053823 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053826 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053828 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053831 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053834 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053836 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053839 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053842 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053844 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053847 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053850 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053852 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053855 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:42:25.054084 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053858 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053860 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053865 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053868 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053871 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053873 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053876 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053880 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053885 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053888 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053891 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053894 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053897 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053900 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053903 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053906 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053909 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053911 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053914 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:42:25.054860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053917 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053919 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053922 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053924 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053927 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053930 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053934 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053936 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053939 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053941 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053944 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053946 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053949 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053951 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053955 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053958 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053961 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053964 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053966 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053969 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:42:25.055581 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053972 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053974 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053976 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053979 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053982 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053985 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053988 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053991 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053994 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.053997 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054001 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054004 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054006 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054009 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054011 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054014 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054017 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054019 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054022 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054025 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:42:25.056297 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054027 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054031 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054034 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054037 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054041 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054043 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054046 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054048 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054051 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054053 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054056 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054059 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054061 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054064 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054066 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054801 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054808 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054812 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054815 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:42:25.057015 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054820 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054825 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054830 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054834 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054837 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054840 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054843 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054846 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054849 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054851 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054854 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054857 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054860 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054865 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054869 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054872 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054875 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054878 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054881 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:42:25.057715 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054884 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054887 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054889 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054892 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054894 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054897 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054899 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054902 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054904 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054908 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054911 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054914 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054916 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054919 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054922 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054925 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054927 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054930 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054932 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054946 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:42:25.058480 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054949 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054951 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054954 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054956 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054959 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054961 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054964 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054967 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054970 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054973 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054975 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054978 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054980 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054983 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054986 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054988 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054991 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054994 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.054997 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055001 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:42:25.059222 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055004 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055006 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055009 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055011 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055014 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055017 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055019 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055022 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055024 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055027 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055030 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055032 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055035 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055037 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055040 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055042 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055045 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055047 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055050 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055052 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:42:25.060090 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055055 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055058 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055061 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055063 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055066 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055068 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055071 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055074 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055077 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055079 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055082 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055084 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055087 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055089 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055092 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055095 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055485 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055491 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055494 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055497 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:42:25.060844 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055500 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055503 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055506 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055508 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055511 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055514 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055516 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055519 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055521 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055524 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055526 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055529 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055532 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055535 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055537 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055540 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055542 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055545 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055550 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:42:25.061589 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055554 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055557 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055559 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055562 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055565 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055568 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055571 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055574 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055576 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055579 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055582 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055585 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055588 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055591 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055593 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055597 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055600 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055603 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055606 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:42:25.062270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055608 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055611 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055613 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055616 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055618 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055621 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055624 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055627 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055629 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055632 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055634 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055637 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055643 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055646 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055648 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055651 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055654 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055657 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055660 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055662 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:42:25.062983 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055665 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055667 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055670 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055673 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055675 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055678 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055680 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055683 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055685 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055689 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055692 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055694 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055697 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055701 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055704 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055707 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055709 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055712 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055715 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:42:25.063728 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055717 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055721 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055723 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055726 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055728 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055732 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055735 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055737 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055740 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055742 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055745 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055747 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055750 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055753 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055755 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055758 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055761 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.055763 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055831 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055838 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055847 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 13:42:25.064428 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055851 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055855 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055858 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055863 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055867 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055870 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055873 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055876 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055879 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055882 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055885 2572 flags.go:64] FLAG: --cgroup-root="" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055888 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055891 2572 flags.go:64] FLAG: --client-ca-file="" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055895 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055898 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055903 2572 flags.go:64] FLAG: --cluster-domain="" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055907 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055910 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055913 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055916 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055924 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055927 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055930 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 13:42:25.065188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055934 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055937 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055940 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055942 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055946 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055949 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055953 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055956 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055958 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055961 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055964 2572 flags.go:64] FLAG: --enable-server="true" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055967 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055971 2572 flags.go:64] FLAG: --event-burst="100" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055974 2572 flags.go:64] FLAG: --event-qps="50" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055977 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055981 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055984 2572 flags.go:64] FLAG: --eviction-hard="" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055987 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055990 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055993 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055996 2572 flags.go:64] FLAG: --eviction-soft="" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.055999 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056002 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056005 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056008 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 13:42:25.066031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056012 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056015 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056018 2572 flags.go:64] FLAG: --feature-gates="" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056022 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056025 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056028 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056031 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056034 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056037 2572 flags.go:64] FLAG: --help="false" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056040 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056045 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056048 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056051 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056054 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056058 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056061 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056063 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056066 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056069 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056072 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056075 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056078 2572 flags.go:64] FLAG: --kube-reserved="" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056081 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056083 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 13:42:25.067059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056086 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056089 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056092 2572 flags.go:64] FLAG: --lock-file="" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056095 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056098 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056101 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056106 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056109 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056113 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056116 2572 flags.go:64] FLAG: --logging-format="text" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056119 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056122 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056125 2572 flags.go:64] FLAG: --manifest-url="" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056128 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056132 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056135 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056139 2572 flags.go:64] FLAG: --max-pods="110" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056142 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056146 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056149 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056152 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056155 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056158 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056161 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056167 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 13:42:25.067962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056170 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056173 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056176 2572 flags.go:64] FLAG: --pod-cidr="" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056179 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056184 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056187 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056190 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056193 2572 flags.go:64] FLAG: --port="10250" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056196 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056199 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0910a9c6800e1b2c2" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056202 2572 flags.go:64] FLAG: --qos-reserved="" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056205 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056208 2572 flags.go:64] FLAG: --register-node="true" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056210 2572 flags.go:64] FLAG: --register-with-taints="" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056214 2572 flags.go:64] FLAG: --registry-burst="10" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056217 2572 flags.go:64] FLAG: --registry-qps="5" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056222 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056224 2572 flags.go:64] FLAG: --reserved-memory="" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056228 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056231 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056234 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056237 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056240 2572 flags.go:64] FLAG: --runonce="false" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056243 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056246 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 13:42:25.068889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056250 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056253 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056256 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056259 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056262 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056265 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056268 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056271 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056273 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056276 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056279 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056282 2572 flags.go:64] FLAG: --system-cgroups="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056285 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056290 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056293 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056295 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056317 2572 flags.go:64] FLAG: --tls-min-version="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056321 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056324 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056327 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056330 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056333 2572 flags.go:64] FLAG: --v="2" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056351 2572 flags.go:64] FLAG: --version="false" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056358 2572 flags.go:64] FLAG: --vmodule="" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056361 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 13:42:25.069837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.056365 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056475 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056479 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056482 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056485 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056488 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056491 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056496 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056498 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056501 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056504 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056506 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056509 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056512 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056514 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056517 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056519 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056522 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056525 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056527 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:42:25.070865 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056530 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056533 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056535 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056538 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056540 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056543 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056546 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056549 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056551 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056554 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056557 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056560 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056564 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056568 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056571 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056574 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056576 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056579 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056581 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:42:25.071619 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056585 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056588 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056590 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056593 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056596 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056598 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056601 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056603 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056606 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056609 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056611 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056614 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056617 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056619 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056622 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056624 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056627 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056629 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056632 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:42:25.072375 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056634 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056637 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056639 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056642 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056646 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056649 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056655 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056658 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056660 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056663 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056665 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056668 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056671 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056674 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056677 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056679 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056682 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056684 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056686 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056689 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:42:25.073070 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056691 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056694 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056696 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056699 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056702 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056704 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056708 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056711 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056715 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056718 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056721 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056723 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056726 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056729 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056731 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056734 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056739 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056742 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056745 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:42:25.073822 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056748 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056751 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.056754 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.057486 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.064556 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.064570 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.064590 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.064595 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064654 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064659 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064663 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064666 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064668 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064671 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064674 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:42:25.074531 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064677 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064679 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064682 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064684 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064687 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064690 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064692 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064695 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064697 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064700 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064702 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064705 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064707 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064710 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064715 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064719 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064722 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064726 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064729 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:42:25.075108 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064732 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064736 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064739 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064742 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064744 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064747 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064750 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064752 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064755 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064757 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064760 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064762 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064765 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064767 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064770 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064772 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064775 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064777 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064780 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:42:25.075869 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064782 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064785 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064789 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064792 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064795 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064798 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064801 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064804 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064806 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064809 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064812 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064815 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064818 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064820 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064823 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064826 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064828 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064831 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064834 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:42:25.076584 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064836 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064839 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064841 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064844 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064846 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064849 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064851 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064853 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064856 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064858 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064861 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064863 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064866 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064868 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064870 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064873 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064875 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064878 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064880 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064883 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:42:25.077315 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064885 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064888 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064890 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064893 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064895 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064898 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064901 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064903 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064906 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064908 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064911 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064914 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064916 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064919 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.064921 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:42:25.078076 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.064926 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065052 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065056 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065059 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065064 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065067 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065071 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065074 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065077 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065080 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065082 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065085 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065088 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065092 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065095 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065099 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065102 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065104 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065107 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065109 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 13:42:25.078692 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065112 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065115 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065117 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065120 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065123 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065125 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065128 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065131 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065134 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065136 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065139 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065141 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065143 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065146 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065148 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065151 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065153 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065156 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065158 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 13:42:25.079436 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065161 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065163 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065166 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065170 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065174 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065177 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065180 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065183 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065186 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065189 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065192 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065195 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065198 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065201 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065204 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065206 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065209 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065212 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065214 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 13:42:25.080141 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065217 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065220 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065222 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065225 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065227 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065230 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065232 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065235 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065237 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065239 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065242 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065244 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065246 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065249 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065252 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065254 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065257 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065259 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065262 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 13:42:25.080860 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065264 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065267 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065269 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065271 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065274 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065277 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065279 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065282 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065284 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065286 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065289 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065291 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065294 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065299 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065301 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065304 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065306 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065309 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065311 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065314 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 13:42:25.081567 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065316 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065319 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:25.065321 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.065326 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.065439 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.068655 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.070359 2572 server.go:1019] "Starting client certificate rotation" Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.070459 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.070488 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.073052 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:42:25.082286 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.076479 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 13:42:25.087297 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.087275 2572 log.go:25] "Validated CRI v1 runtime API" Jul 28 13:42:25.089820 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.089801 2572 log.go:25] "Validated CRI v1 image API" Jul 28 13:42:25.091440 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.091425 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 13:42:25.096942 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.096918 2572 fs.go:135] Filesystem UUIDs: map[312e9db9-9c3d-4e6d-9c95-05cb18ec2253:/dev/nvme0n1p4 55ce9dfc-ae44-4205-acb7-de2b9fce6c5a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 28 13:42:25.097031 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.096940 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 13:42:25.102604 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.102482 2572 manager.go:216] Machine: {Timestamp:2026-07-28 13:42:25.101085524 +0000 UTC m=+0.375671595 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100170 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2931ae99686cd88f7870b5966ef6d1 SystemUUID:ec2931ae-9968-6cd8-8f78-70b5966ef6d1 BootID:d7de0407-5d51-4b4a-bb7a-6fc328837940 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:d7:92:0a:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:d7:92:0a:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:8a:9c:4e:e2:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 13:42:25.102604 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.102592 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 13:42:25.102779 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.102704 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 13:42:25.105153 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.105135 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:42:25.106135 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.106110 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 13:42:25.106268 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.106137 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-179.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 13:42:25.106959 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.106946 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 13:42:25.107015 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.106961 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 13:42:25.107015 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.106968 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:42:25.107015 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.106984 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 13:42:25.108243 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.108232 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 13:42:25.111312 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111300 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:42:25.111448 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111438 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 13:42:25.111496 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111468 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 28 13:42:25.111496 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111477 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 13:42:25.111496 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111492 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 13:42:25.111611 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111502 2572 kubelet.go:398] "Adding apiserver pod source" Jul 28 13:42:25.111611 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111511 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 13:42:25.111936 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111923 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:42:25.111983 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.111946 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 13:42:25.115670 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.115655 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 13:42:25.118332 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.118317 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 13:42:25.118418 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.118361 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 13:42:25.120384 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120368 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 13:42:25.120384 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120387 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120393 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120399 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120408 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120413 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120421 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120426 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120434 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120442 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120474 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 13:42:25.120525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.120481 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 13:42:25.121323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.121312 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 13:42:25.121323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.121324 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 13:42:25.123568 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.123529 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 13:42:25.123774 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.123749 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-179.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 13:42:25.123849 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.123531 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 13:42:25.125024 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.125003 2572 server.go:1268] "Started kubelet" Jul 28 13:42:25.125407 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.125380 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 13:42:25.125490 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.125374 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 13:42:25.125490 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.125446 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 13:42:25.126021 ip-10-0-136-179 systemd[1]: Started Kubernetes Kubelet. Jul 28 13:42:25.127544 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.127530 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 28 13:42:25.128375 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.128328 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 13:42:25.133000 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.132978 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 13:42:25.139017 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.138997 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 13:42:25.139115 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.139019 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 13:42:25.139169 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.139121 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:25.139902 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.139879 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 13:42:25.139986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.139909 2572 factory.go:55] Registering systemd factory Jul 28 13:42:25.139986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.139925 2572 factory.go:223] Registration of the systemd container factory successfully Jul 28 13:42:25.140100 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140003 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 13:42:25.140100 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140018 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 13:42:25.140197 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140138 2572 factory.go:153] Registering CRI-O factory Jul 28 13:42:25.140197 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140153 2572 factory.go:223] Registration of the crio container factory successfully Jul 28 13:42:25.140283 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140196 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 28 13:42:25.140283 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140202 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 13:42:25.140283 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140228 2572 factory.go:103] Registering Raw factory Jul 28 13:42:25.140283 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140205 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 28 13:42:25.140283 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140245 2572 manager.go:1196] Started watching for new ooms in manager Jul 28 13:42:25.140702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.140688 2572 manager.go:349] Starting recovery of all containers Jul 28 13:42:25.143817 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.143797 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 13:42:25.143890 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.143826 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 13:42:25.145081 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.143890 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-179.ec2.internal.18c677e90ccede79 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-179.ec2.internal,UID:ip-10-0-136-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-179.ec2.internal,},FirstTimestamp:2026-07-28 13:42:25.124949625 +0000 UTC m=+0.399535700,LastTimestamp:2026-07-28 13:42:25.124949625 +0000 UTC m=+0.399535700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-179.ec2.internal,}" Jul 28 13:42:25.150795 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.150778 2572 manager.go:354] Recovery completed Jul 28 13:42:25.155171 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.155158 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.155560 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.155542 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rvnbg" Jul 28 13:42:25.156859 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.156845 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.156904 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.156877 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.156904 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.156889 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.157577 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.157559 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 13:42:25.157577 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.157572 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.157577 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.157576 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 13:42:25.157763 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.157594 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 28 13:42:25.158235 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.158220 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.158278 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.158245 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.158278 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.158257 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.159176 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.159094 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-179.ec2.internal.18c677e90eb5c910 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-179.ec2.internal,UID:ip-10-0-136-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-179.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-179.ec2.internal,},FirstTimestamp:2026-07-28 13:42:25.156860176 +0000 UTC m=+0.431446247,LastTimestamp:2026-07-28 13:42:25.156860176 +0000 UTC m=+0.431446247,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-179.ec2.internal,}" Jul 28 13:42:25.160434 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.160422 2572 policy_none.go:49] "None policy: Start" Jul 28 13:42:25.160493 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.160439 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 13:42:25.160493 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.160449 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 13:42:25.162347 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.162328 2572 policy_none.go:47] "Start" Jul 28 13:42:25.163557 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.163541 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rvnbg" Jul 28 13:42:25.168427 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.168326 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-179.ec2.internal.18c677e90eb62413 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-179.ec2.internal,UID:ip-10-0-136-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-179.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-179.ec2.internal,},FirstTimestamp:2026-07-28 13:42:25.156883475 +0000 UTC m=+0.431469546,LastTimestamp:2026-07-28 13:42:25.156883475 +0000 UTC m=+0.431469546,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-179.ec2.internal,}" Jul 28 13:42:25.211878 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.211861 2572 manager.go:337] "Starting Device Plugin manager" Jul 28 13:42:25.211972 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.211949 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 13:42:25.211972 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.211963 2572 server.go:87] "Starting device plugin registration server" Jul 28 13:42:25.212257 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.212241 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 13:42:25.212311 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.212260 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 13:42:25.212459 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.212437 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 13:42:25.212552 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.212538 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 13:42:25.212552 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.212552 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 13:42:25.213155 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.212967 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 13:42:25.213217 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.213195 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:25.229785 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.229757 2572 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2604 into the system container \"/system.slice\": " Jul 28 13:42:25.291717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.291677 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 13:42:25.293888 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.292923 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 13:42:25.293888 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.292958 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 13:42:25.293888 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.292983 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 13:42:25.293888 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.293017 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 13:42:25.295518 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.295499 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:25.313460 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.313389 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.314414 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.314394 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.314512 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.314427 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.314512 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.314440 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.314512 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.314465 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.323927 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.323907 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.324005 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.323934 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-179.ec2.internal\": node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:25.347694 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.347666 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:25.393629 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.393598 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal"] Jul 28 13:42:25.393711 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.393697 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.395270 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.395248 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.395423 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.395293 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.395423 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.395307 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.397692 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.397677 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.397804 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.397790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.397850 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.397823 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.398412 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.398397 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.398498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.398420 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.398498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.398432 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.398498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.398443 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.398498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.398446 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.398498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.398459 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.400958 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.400940 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.401013 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.400976 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 13:42:25.401686 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.401672 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientMemory" Jul 28 13:42:25.401770 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.401695 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 13:42:25.401770 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.401705 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeHasSufficientPID" Jul 28 13:42:25.434237 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.434211 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-179.ec2.internal\" not found" node="ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.438766 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.438748 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-179.ec2.internal\" not found" node="ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.441921 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.441902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc35a73c3bd937735bd26ee52ef00159-config\") pod \"kube-apiserver-proxy-ip-10-0-136-179.ec2.internal\" (UID: \"dc35a73c3bd937735bd26ee52ef00159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.442022 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.441926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99222ee40d6d09f739a4ced20d83ab6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal\" (UID: \"99222ee40d6d09f739a4ced20d83ab6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.442022 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.441946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99222ee40d6d09f739a4ced20d83ab6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal\" (UID: \"99222ee40d6d09f739a4ced20d83ab6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.447994 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.447977 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:25.542435 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.542400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc35a73c3bd937735bd26ee52ef00159-config\") pod \"kube-apiserver-proxy-ip-10-0-136-179.ec2.internal\" (UID: \"dc35a73c3bd937735bd26ee52ef00159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.542435 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.542430 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99222ee40d6d09f739a4ced20d83ab6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal\" (UID: \"99222ee40d6d09f739a4ced20d83ab6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.542654 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.542448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99222ee40d6d09f739a4ced20d83ab6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal\" (UID: \"99222ee40d6d09f739a4ced20d83ab6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.542654 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.542492 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99222ee40d6d09f739a4ced20d83ab6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal\" (UID: \"99222ee40d6d09f739a4ced20d83ab6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.542654 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.542505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc35a73c3bd937735bd26ee52ef00159-config\") pod \"kube-apiserver-proxy-ip-10-0-136-179.ec2.internal\" (UID: \"dc35a73c3bd937735bd26ee52ef00159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.542654 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:25.542512 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99222ee40d6d09f739a4ced20d83ab6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal\" (UID: \"99222ee40d6d09f739a4ced20d83ab6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:25.548526 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:25.548506 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:27.471489 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:27.471460 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:27.559722 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.559680 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" Jul 28 13:42:27.564925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.564556 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:27.571864 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:27.571841 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:27.672449 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:27.672407 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-179.ec2.internal\" not found" Jul 28 13:42:27.761571 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.761499 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:27.761680 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.761612 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:27.862388 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.862356 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" Jul 28 13:42:27.870201 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.870178 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:42:27.871019 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.871004 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" Jul 28 13:42:27.884506 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.884482 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 13:42:27.891650 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.891633 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 13:42:27.891763 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.891744 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:42:27.891805 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.891785 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:42:27.891805 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.891785 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 13:42:27.933981 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.933951 2572 apiserver.go:52] "Watching apiserver" Jul 28 13:42:27.950010 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.949980 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 13:42:27.950314 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.950293 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8p8xl","kube-system/konnectivity-agent-ftq6j","openshift-dns/node-resolver-x5kf5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal","openshift-multus/multus-srwmv","openshift-multus/network-metrics-daemon-s2q2t","openshift-network-diagnostics/network-check-target-4b59g","openshift-network-operator/iptables-alerter-7smr4","kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr","openshift-cluster-node-tuning-operator/tuned-qhcfz","openshift-image-registry/node-ca-nb6lz","openshift-multus/multus-additional-cni-plugins-vzjsz","openshift-ovn-kubernetes/ovnkube-node-nqtlw"] Jul 28 13:42:27.952815 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.952797 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:27.952924 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:27.952879 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:27.954782 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.954768 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:27.956785 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.956769 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:27.958820 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.958803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.959107 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.959087 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 13:42:27.959467 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.959454 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 13:42:27.959506 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.959488 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.960098 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.960085 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.960306 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.960293 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n9nbd\"" Jul 28 13:42:27.960365 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.960347 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-svjpr\"" Jul 28 13:42:27.960879 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.960867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:27.960940 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:27.960925 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:27.960981 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.960964 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xxnkj\"" Jul 28 13:42:27.961486 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.961468 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 13:42:27.961622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.961606 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 13:42:27.961668 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.961636 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 13:42:27.961884 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.961865 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.962918 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.962880 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:27.962996 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:27.962957 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:27.963843 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.963829 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.964971 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.964954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:27.967067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967051 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:27.967663 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967646 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.967744 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-hostroot\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.967744 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52a03453-1eb2-40f8-a987-c45321d52aa5-dbus\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:27.967744 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e247c04-2030-4ce6-8821-f546e39b87c2-hosts-file\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:27.967744 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlqv8\" (UniqueName: \"kubernetes.io/projected/7b3f5fb3-2999-47cd-829c-b57d500ffa21-kube-api-access-mlqv8\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2p8h\" (UniqueName: \"kubernetes.io/projected/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-kube-api-access-m2p8h\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967762 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967777 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2059b595-60f4-45e0-bc85-b974a54e70c7-konnectivity-ca\") pod \"konnectivity-agent-ftq6j\" (UID: \"2059b595-60f4-45e0-bc85-b974a54e70c7\") " pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e247c04-2030-4ce6-8821-f546e39b87c2-tmp-dir\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95p4s\" (UniqueName: \"kubernetes.io/projected/5e247c04-2030-4ce6-8821-f546e39b87c2-kube-api-access-95p4s\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-cni-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.967911 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-os-release\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-netns\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-cni-bin\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-conf-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967974 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52a03453-1eb2-40f8-a987-c45321d52aa5-kubelet-config\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.967990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-k8s-cni-cncf-io\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-kubelet\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-system-cni-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-multus-certs\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-socket-dir-parent\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2059b595-60f4-45e0-bc85-b974a54e70c7-agent-certs\") pod \"konnectivity-agent-ftq6j\" (UID: \"2059b595-60f4-45e0-bc85-b974a54e70c7\") " pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-cnibin\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b3f5fb3-2999-47cd-829c-b57d500ffa21-cni-binary-copy\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-cni-multus\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968303 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nf77m\"" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-daemon-config\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.968519 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.968335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-etc-kubernetes\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:27.969111 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.969099 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.969210 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.969197 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:27.969802 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.969788 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 13:42:27.969875 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.969862 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.970144 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.970130 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nqwwv\"" Jul 28 13:42:27.971357 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.971344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:27.973714 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.973612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:27.976394 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.976379 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:27.977024 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977005 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.977113 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977070 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.977113 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977102 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.977227 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977107 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 13:42:27.977227 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977155 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.977335 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977321 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-krmhf\"" Jul 28 13:42:27.979513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977347 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 13:42:27.979513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977676 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 13:42:27.979513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977712 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-86vks\"" Jul 28 13:42:27.979513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.977908 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cwhzq\"" Jul 28 13:42:27.982029 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982013 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 13:42:27.982073 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982011 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 13:42:27.982238 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982224 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 13:42:27.982334 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982322 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 13:42:27.982771 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982755 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 13:42:27.982809 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982798 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 13:42:27.982842 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.982755 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9xmlw\"" Jul 28 13:42:27.990569 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.990548 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 13:42:27.991913 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.991878 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 13:37:26 +0000 UTC" deadline="2028-01-27 08:38:23.643930438 +0000 UTC" Jul 28 13:42:27.991964 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:27.991913 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13146h55m55.652019778s" Jul 28 13:42:28.021716 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.021653 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pd26j" Jul 28 13:42:28.028439 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.028421 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pd26j" Jul 28 13:42:28.063000 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.062803 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 13:42:28.068646 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.068767 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-log-socket\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.068767 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-cni-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.068767 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-os-release\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.068767 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-netns\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068772 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-os-release\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52a03453-1eb2-40f8-a987-c45321d52aa5-kubelet-config\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3fced16-1c1f-4775-af4b-e8be973fb1fb-iptables-alerter-script\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068854 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52a03453-1eb2-40f8-a987-c45321d52aa5-kubelet-config\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-sys-fs\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068874 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-netns\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-kubelet\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3fced16-1c1f-4775-af4b-e8be973fb1fb-host-slash\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8splz\" (UniqueName: \"kubernetes.io/projected/eec5eee5-67d2-4570-86e7-70c0b5c000de-kube-api-access-8splz\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-cni-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.068980 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysctl-d\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.069006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069007 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-systemd\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-env-overrides\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgcx\" (UniqueName: \"kubernetes.io/projected/d3fced16-1c1f-4775-af4b-e8be973fb1fb-kube-api-access-2sgcx\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-device-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-kubernetes\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-os-release\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-etc-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-socket-dir-parent\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2059b595-60f4-45e0-bc85-b974a54e70c7-agent-certs\") pod \"konnectivity-agent-ftq6j\" (UID: \"2059b595-60f4-45e0-bc85-b974a54e70c7\") " pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-host\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069306 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-socket-dir-parent\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl9ll\" (UniqueName: \"kubernetes.io/projected/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-kube-api-access-kl9ll\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-run-netns\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.069422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovnkube-config\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069413 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-modprobe-d\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-cnibin\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-cni-multus\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-daemon-config\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069525 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-cnibin\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069530 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-cni-multus\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-etc-kubernetes\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069587 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-registration-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-var-lib-kubelet\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52a03453-1eb2-40f8-a987-c45321d52aa5-dbus\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069653 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2059b595-60f4-45e0-bc85-b974a54e70c7-konnectivity-ca\") pod \"konnectivity-agent-ftq6j\" (UID: \"2059b595-60f4-45e0-bc85-b974a54e70c7\") " pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069681 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e247c04-2030-4ce6-8821-f546e39b87c2-tmp-dir\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069684 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-etc-kubernetes\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069701 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069712 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52a03453-1eb2-40f8-a987-c45321d52aa5-dbus\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-sys\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-tuned\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.070121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-node-log\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-cni-bin\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-conf-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069912 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-cni-bin\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069922 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069964 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-run\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e247c04-2030-4ce6-8821-f546e39b87c2-tmp-dir\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-conf-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.069987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-lib-modules\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.070014 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58ac3485-70e7-45f3-9e71-124e3633defd-host\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070045 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b3f5fb3-2999-47cd-829c-b57d500ffa21-multus-daemon-config\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.070107 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:28.570059775 +0000 UTC m=+2.022450314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-systemd-units\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-systemd\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-k8s-cni-cncf-io\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:28.070938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070229 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58ac3485-70e7-45f3-9e71-124e3633defd-serviceca\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070246 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-k8s-cni-cncf-io\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-ovn\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-cni-bin\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovnkube-script-lib\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwcs\" (UniqueName: \"kubernetes.io/projected/2ddff9fd-0ea8-43de-baf9-2e29f724e637-kube-api-access-qxwcs\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-kubelet\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-system-cni-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070418 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-multus-certs\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-socket-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070449 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-var-lib-kubelet\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-system-cni-dir\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cnibin\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-host-run-multus-certs\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070493 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-run-ovn-kubernetes\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6ndv\" (UniqueName: \"kubernetes.io/projected/58ac3485-70e7-45f3-9e71-124e3633defd-kube-api-access-g6ndv\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.071622 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.070620 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070644 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovn-node-metrics-cert\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.070668 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:28.57065299 +0000 UTC m=+2.023043512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysconfig\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-cni-netd\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2059b595-60f4-45e0-bc85-b974a54e70c7-konnectivity-ca\") pod \"konnectivity-agent-ftq6j\" (UID: \"2059b595-60f4-45e0-bc85-b974a54e70c7\") " pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b3f5fb3-2999-47cd-829c-b57d500ffa21-cni-binary-copy\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysctl-conf\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m948t\" (UniqueName: \"kubernetes.io/projected/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-kube-api-access-m948t\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-hostroot\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e247c04-2030-4ce6-8821-f546e39b87c2-hosts-file\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-etc-selinux\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-tmp\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070896 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-system-cni-dir\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070932 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b3f5fb3-2999-47cd-829c-b57d500ffa21-hostroot\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.072231 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e247c04-2030-4ce6-8821-f546e39b87c2-hosts-file\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.070993 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-slash\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-var-lib-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlqv8\" (UniqueName: \"kubernetes.io/projected/7b3f5fb3-2999-47cd-829c-b57d500ffa21-kube-api-access-mlqv8\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2p8h\" (UniqueName: \"kubernetes.io/projected/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-kube-api-access-m2p8h\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071105 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b3f5fb3-2999-47cd-829c-b57d500ffa21-cni-binary-copy\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95p4s\" (UniqueName: \"kubernetes.io/projected/5e247c04-2030-4ce6-8821-f546e39b87c2-kube-api-access-95p4s\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.072702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.071165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.073450 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.073433 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2059b595-60f4-45e0-bc85-b974a54e70c7-agent-certs\") pod \"konnectivity-agent-ftq6j\" (UID: \"2059b595-60f4-45e0-bc85-b974a54e70c7\") " pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:28.081694 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.081675 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:28.081694 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.081696 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:28.081891 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.081709 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:28.081891 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.081771 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:28.581756809 +0000 UTC m=+2.034147343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:28.084513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.084494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95p4s\" (UniqueName: \"kubernetes.io/projected/5e247c04-2030-4ce6-8821-f546e39b87c2-kube-api-access-95p4s\") pod \"node-resolver-x5kf5\" (UID: \"5e247c04-2030-4ce6-8821-f546e39b87c2\") " pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.085043 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.085020 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlqv8\" (UniqueName: \"kubernetes.io/projected/7b3f5fb3-2999-47cd-829c-b57d500ffa21-kube-api-access-mlqv8\") pod \"multus-srwmv\" (UID: \"7b3f5fb3-2999-47cd-829c-b57d500ffa21\") " pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.085617 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.085600 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2p8h\" (UniqueName: \"kubernetes.io/projected/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-kube-api-access-m2p8h\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:28.171461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171426 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysctl-conf\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.171461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m948t\" (UniqueName: \"kubernetes.io/projected/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-kube-api-access-m948t\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-etc-selinux\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-tmp\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-system-cni-dir\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-slash\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171646 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-system-cni-dir\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-etc-selinux\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysctl-conf\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171685 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-slash\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.171724 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-var-lib-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171771 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-var-lib-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171809 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-log-socket\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171847 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-log-socket\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171852 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3fced16-1c1f-4775-af4b-e8be973fb1fb-iptables-alerter-script\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171878 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-sys-fs\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171891 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-kubelet\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3fced16-1c1f-4775-af4b-e8be973fb1fb-host-slash\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171946 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-sys-fs\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8splz\" (UniqueName: \"kubernetes.io/projected/eec5eee5-67d2-4570-86e7-70c0b5c000de-kube-api-access-8splz\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171977 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-kubelet\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.171988 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3fced16-1c1f-4775-af4b-e8be973fb1fb-host-slash\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.172195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysctl-d\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172035 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-systemd\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-env-overrides\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgcx\" (UniqueName: \"kubernetes.io/projected/d3fced16-1c1f-4775-af4b-e8be973fb1fb-kube-api-access-2sgcx\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-device-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-kubernetes\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172166 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-os-release\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172174 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysctl-d\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172215 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-device-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172228 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-etc-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172230 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172270 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-systemd\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-host\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172308 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-etc-openvswitch\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172310 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-os-release\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl9ll\" (UniqueName: \"kubernetes.io/projected/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-kube-api-access-kl9ll\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-kubernetes\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172375 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172434 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-host\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172454 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3fced16-1c1f-4775-af4b-e8be973fb1fb-iptables-alerter-script\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-run-netns\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172503 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172509 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovnkube-config\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172502 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-run-netns\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-modprobe-d\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-env-overrides\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-registration-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-var-lib-kubelet\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172642 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-registration-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172644 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-sys\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.173848 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-tuned\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172685 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-modprobe-d\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172689 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-sys\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172704 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-node-log\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-var-lib-kubelet\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172737 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-node-log\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-run\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-lib-modules\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172780 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-run\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58ac3485-70e7-45f3-9e71-124e3633defd-host\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-systemd-units\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-systemd\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172844 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cni-binary-copy\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172875 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-lib-modules\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58ac3485-70e7-45f3-9e71-124e3633defd-serviceca\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172899 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58ac3485-70e7-45f3-9e71-124e3633defd-host\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-ovn\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-systemd-units\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172949 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-systemd\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172948 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-run-ovn\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172973 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovnkube-config\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.172991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-cni-bin\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovnkube-script-lib\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173034 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-cni-bin\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwcs\" (UniqueName: \"kubernetes.io/projected/2ddff9fd-0ea8-43de-baf9-2e29f724e637-kube-api-access-qxwcs\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-socket-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cnibin\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-run-ovn-kubernetes\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6ndv\" (UniqueName: \"kubernetes.io/projected/58ac3485-70e7-45f3-9e71-124e3633defd-kube-api-access-g6ndv\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovn-node-metrics-cert\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysconfig\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-cni-netd\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173313 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58ac3485-70e7-45f3-9e71-124e3633defd-serviceca\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173335 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-run-ovn-kubernetes\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173399 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-cnibin\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.174926 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173443 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ddff9fd-0ea8-43de-baf9-2e29f724e637-host-cni-netd\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.175430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173501 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-sysconfig\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.175430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173583 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eec5eee5-67d2-4570-86e7-70c0b5c000de-socket-dir\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.175430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.173582 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovnkube-script-lib\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.175430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.174052 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-tmp\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.175430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.174750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-etc-tuned\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.175430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.175257 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ddff9fd-0ea8-43de-baf9-2e29f724e637-ovn-node-metrics-cert\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.184359 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.184337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl9ll\" (UniqueName: \"kubernetes.io/projected/3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf-kube-api-access-kl9ll\") pod \"multus-additional-cni-plugins-vzjsz\" (UID: \"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf\") " pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.184509 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.184490 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6ndv\" (UniqueName: \"kubernetes.io/projected/58ac3485-70e7-45f3-9e71-124e3633defd-kube-api-access-g6ndv\") pod \"node-ca-nb6lz\" (UID: \"58ac3485-70e7-45f3-9e71-124e3633defd\") " pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.184635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.184617 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8splz\" (UniqueName: \"kubernetes.io/projected/eec5eee5-67d2-4570-86e7-70c0b5c000de-kube-api-access-8splz\") pod \"aws-ebs-csi-driver-node-wnjrr\" (UID: \"eec5eee5-67d2-4570-86e7-70c0b5c000de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.184830 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.184810 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgcx\" (UniqueName: \"kubernetes.io/projected/d3fced16-1c1f-4775-af4b-e8be973fb1fb-kube-api-access-2sgcx\") pod \"iptables-alerter-7smr4\" (UID: \"d3fced16-1c1f-4775-af4b-e8be973fb1fb\") " pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.185916 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.185895 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m948t\" (UniqueName: \"kubernetes.io/projected/e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5-kube-api-access-m948t\") pod \"tuned-qhcfz\" (UID: \"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5\") " pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.185991 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.185962 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwcs\" (UniqueName: \"kubernetes.io/projected/2ddff9fd-0ea8-43de-baf9-2e29f724e637-kube-api-access-qxwcs\") pod \"ovnkube-node-nqtlw\" (UID: \"2ddff9fd-0ea8-43de-baf9-2e29f724e637\") " pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.209350 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.209315 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99222ee40d6d09f739a4ced20d83ab6e.slice/crio-0920fb8e654430dba2b946d09d7bb750533b70ad5d377cbef5f9313b8c53658a WatchSource:0}: Error finding container 0920fb8e654430dba2b946d09d7bb750533b70ad5d377cbef5f9313b8c53658a: Status 404 returned error can't find the container with id 0920fb8e654430dba2b946d09d7bb750533b70ad5d377cbef5f9313b8c53658a Jul 28 13:42:28.209758 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.209740 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc35a73c3bd937735bd26ee52ef00159.slice/crio-c4b18b85c82f79dc29caf91d5a60d47b22e1ce0c993f98749292b8875dc0591e WatchSource:0}: Error finding container c4b18b85c82f79dc29caf91d5a60d47b22e1ce0c993f98749292b8875dc0591e: Status 404 returned error can't find the container with id c4b18b85c82f79dc29caf91d5a60d47b22e1ce0c993f98749292b8875dc0591e Jul 28 13:42:28.213802 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.213786 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:42:28.288736 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.288660 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:28.297961 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.297934 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2059b595_60f4_45e0_bc85_b974a54e70c7.slice/crio-8508362768de4ef517ed1fe083a5ba0d57b1a70b3226835dc84de6b9cae496e1 WatchSource:0}: Error finding container 8508362768de4ef517ed1fe083a5ba0d57b1a70b3226835dc84de6b9cae496e1: Status 404 returned error can't find the container with id 8508362768de4ef517ed1fe083a5ba0d57b1a70b3226835dc84de6b9cae496e1 Jul 28 13:42:28.306120 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.306103 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5kf5" Jul 28 13:42:28.314684 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.314662 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e247c04_2030_4ce6_8821_f546e39b87c2.slice/crio-153e2abe9a5944763e507d5644780f2d3ef9bc8f4fbe928a1b6e5f8e29a37817 WatchSource:0}: Error finding container 153e2abe9a5944763e507d5644780f2d3ef9bc8f4fbe928a1b6e5f8e29a37817: Status 404 returned error can't find the container with id 153e2abe9a5944763e507d5644780f2d3ef9bc8f4fbe928a1b6e5f8e29a37817 Jul 28 13:42:28.334979 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.334952 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srwmv" Jul 28 13:42:28.342781 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.342761 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3f5fb3_2999_47cd_829c_b57d500ffa21.slice/crio-87dced4f938350276581c8d47898efdb3c9f2f76a57514b0cf836d36391901bf WatchSource:0}: Error finding container 87dced4f938350276581c8d47898efdb3c9f2f76a57514b0cf836d36391901bf: Status 404 returned error can't find the container with id 87dced4f938350276581c8d47898efdb3c9f2f76a57514b0cf836d36391901bf Jul 28 13:42:28.345611 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.345589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7smr4" Jul 28 13:42:28.352900 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.352877 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fced16_1c1f_4775_af4b_e8be973fb1fb.slice/crio-c6c0335c89fd6c5d96fdf25de4f2b38d4197f36be3d59e6bd42628a6614cd15d WatchSource:0}: Error finding container c6c0335c89fd6c5d96fdf25de4f2b38d4197f36be3d59e6bd42628a6614cd15d: Status 404 returned error can't find the container with id c6c0335c89fd6c5d96fdf25de4f2b38d4197f36be3d59e6bd42628a6614cd15d Jul 28 13:42:28.360193 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.360172 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" Jul 28 13:42:28.368293 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.368266 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec5eee5_67d2_4570_86e7_70c0b5c000de.slice/crio-f4290a37e2e79f2dbdb22c98b884030b03e19e24a116f94d111e3fb30fe98d8e WatchSource:0}: Error finding container f4290a37e2e79f2dbdb22c98b884030b03e19e24a116f94d111e3fb30fe98d8e: Status 404 returned error can't find the container with id f4290a37e2e79f2dbdb22c98b884030b03e19e24a116f94d111e3fb30fe98d8e Jul 28 13:42:28.382296 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.382278 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" Jul 28 13:42:28.389811 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.389787 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46c7d99_8b7d_4c32_aaf8_e9a3eac755d5.slice/crio-56ae2db5cf39ad5d6569fdaea8645c2ea92dd83a9a3140149eb39b049a65d743 WatchSource:0}: Error finding container 56ae2db5cf39ad5d6569fdaea8645c2ea92dd83a9a3140149eb39b049a65d743: Status 404 returned error can't find the container with id 56ae2db5cf39ad5d6569fdaea8645c2ea92dd83a9a3140149eb39b049a65d743 Jul 28 13:42:28.395551 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.395520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nb6lz" Jul 28 13:42:28.403663 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.403640 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ac3485_70e7_45f3_9e71_124e3633defd.slice/crio-d26537f0070e1ba77ad1dfa979cc6f176423482fb53be07d93fb012c6a3ab956 WatchSource:0}: Error finding container d26537f0070e1ba77ad1dfa979cc6f176423482fb53be07d93fb012c6a3ab956: Status 404 returned error can't find the container with id d26537f0070e1ba77ad1dfa979cc6f176423482fb53be07d93fb012c6a3ab956 Jul 28 13:42:28.420450 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.420425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" Jul 28 13:42:28.425505 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.425477 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:28.431386 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.431363 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2c6d91_7b90_46ec_87b8_54f63a2ffcbf.slice/crio-b0abe4c1810fc932ebe5c4a2f041c57a557f63076aa44983846a0e9569ed50ab WatchSource:0}: Error finding container b0abe4c1810fc932ebe5c4a2f041c57a557f63076aa44983846a0e9569ed50ab: Status 404 returned error can't find the container with id b0abe4c1810fc932ebe5c4a2f041c57a557f63076aa44983846a0e9569ed50ab Jul 28 13:42:28.434145 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:42:28.434125 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddff9fd_0ea8_43de_baf9_2e29f724e637.slice/crio-1b143415cb1ad75a55042a06cf6f0205a09348e132369631d2201df1f2223a42 WatchSource:0}: Error finding container 1b143415cb1ad75a55042a06cf6f0205a09348e132369631d2201df1f2223a42: Status 404 returned error can't find the container with id 1b143415cb1ad75a55042a06cf6f0205a09348e132369631d2201df1f2223a42 Jul 28 13:42:28.524219 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.524188 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:28.575224 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.575131 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:28.575224 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.575199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:28.575409 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.575316 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:28.575409 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.575317 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:28.575409 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.575396 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:29.575376579 +0000 UTC m=+3.027767110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:28.575558 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.575418 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:29.575406399 +0000 UTC m=+3.027796925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:28.676344 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:28.676309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:28.676550 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.676489 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:28.676550 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.676519 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:28.676550 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.676547 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:28.676681 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:28.676610 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:29.676594504 +0000 UTC m=+3.128985026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:29.031557 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.031425 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:37:28 +0000 UTC" deadline="2028-03-28 15:22:30.486009229 +0000 UTC" Jul 28 13:42:29.031557 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.031488 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14617h40m1.454525725s" Jul 28 13:42:29.133246 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.133194 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5kf5" event={"ID":"5e247c04-2030-4ce6-8821-f546e39b87c2","Type":"ContainerStarted","Data":"153e2abe9a5944763e507d5644780f2d3ef9bc8f4fbe928a1b6e5f8e29a37817"} Jul 28 13:42:29.143331 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.143262 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nb6lz" event={"ID":"58ac3485-70e7-45f3-9e71-124e3633defd","Type":"ContainerStarted","Data":"d26537f0070e1ba77ad1dfa979cc6f176423482fb53be07d93fb012c6a3ab956"} Jul 28 13:42:29.151300 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.151248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" event={"ID":"eec5eee5-67d2-4570-86e7-70c0b5c000de","Type":"ContainerStarted","Data":"f4290a37e2e79f2dbdb22c98b884030b03e19e24a116f94d111e3fb30fe98d8e"} Jul 28 13:42:29.163764 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.163732 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7smr4" event={"ID":"d3fced16-1c1f-4775-af4b-e8be973fb1fb","Type":"ContainerStarted","Data":"c6c0335c89fd6c5d96fdf25de4f2b38d4197f36be3d59e6bd42628a6614cd15d"} Jul 28 13:42:29.188858 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.188812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srwmv" event={"ID":"7b3f5fb3-2999-47cd-829c-b57d500ffa21","Type":"ContainerStarted","Data":"87dced4f938350276581c8d47898efdb3c9f2f76a57514b0cf836d36391901bf"} Jul 28 13:42:29.199461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.199429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ftq6j" event={"ID":"2059b595-60f4-45e0-bc85-b974a54e70c7","Type":"ContainerStarted","Data":"8508362768de4ef517ed1fe083a5ba0d57b1a70b3226835dc84de6b9cae496e1"} Jul 28 13:42:29.216215 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.216171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" event={"ID":"99222ee40d6d09f739a4ced20d83ab6e","Type":"ContainerStarted","Data":"0920fb8e654430dba2b946d09d7bb750533b70ad5d377cbef5f9313b8c53658a"} Jul 28 13:42:29.232839 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.232808 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" event={"ID":"dc35a73c3bd937735bd26ee52ef00159","Type":"ContainerStarted","Data":"c4b18b85c82f79dc29caf91d5a60d47b22e1ce0c993f98749292b8875dc0591e"} Jul 28 13:42:29.240239 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.240217 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:29.258285 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.258252 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"1b143415cb1ad75a55042a06cf6f0205a09348e132369631d2201df1f2223a42"} Jul 28 13:42:29.272312 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.272281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerStarted","Data":"b0abe4c1810fc932ebe5c4a2f041c57a557f63076aa44983846a0e9569ed50ab"} Jul 28 13:42:29.279103 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.279070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" event={"ID":"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5","Type":"ContainerStarted","Data":"56ae2db5cf39ad5d6569fdaea8645c2ea92dd83a9a3140149eb39b049a65d743"} Jul 28 13:42:29.584918 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.584111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:29.584918 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.584183 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:29.584918 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.584307 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:29.584918 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.584367 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:31.584348965 +0000 UTC m=+5.036739497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:29.584918 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.584831 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:29.584918 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.584883 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:31.584868551 +0000 UTC m=+5.037259072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:29.684995 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:29.684949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:29.685194 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.685157 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:29.685194 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.685180 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:29.685194 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.685193 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:29.685356 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:29.685252 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:31.685233544 +0000 UTC m=+5.137624083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:30.010630 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.010527 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:30.032050 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.032012 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:37:28 +0000 UTC" deadline="2028-03-25 16:56:55.425833619 +0000 UTC" Jul 28 13:42:30.032050 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.032049 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14547h14m25.393789292s" Jul 28 13:42:30.115914 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.115877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:30.116098 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:30.116016 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:30.116438 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.116415 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:30.116553 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:30.116516 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:30.116615 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.116598 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:30.116925 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:30.116682 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:30.812076 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:30.812043 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 13:42:31.601388 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:31.601345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:31.601877 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:31.601424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:31.601877 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.601575 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:31.601877 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.601640 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:35.601621407 +0000 UTC m=+9.054011933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:31.602076 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.602056 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:31.602142 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.602115 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:35.60209983 +0000 UTC m=+9.054490352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:31.702720 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:31.702681 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:31.702889 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.702837 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:31.702889 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.702858 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:31.702889 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.702867 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:31.703056 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:31.702917 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:35.702901022 +0000 UTC m=+9.155291545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:32.116406 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:32.116373 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:32.116595 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:32.116498 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:32.116925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:32.116899 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:32.117018 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:32.116993 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:32.117081 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:32.117062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:32.117182 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:32.117162 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:34.116471 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:34.116398 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:34.116471 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:34.116435 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:34.116471 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:34.116442 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:34.117094 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:34.116516 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:34.117094 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:34.116650 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:34.117094 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:34.116744 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:35.636296 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:35.636252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:35.636784 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:35.636324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:35.636784 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.636492 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:35.636784 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.636581 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:43.636558451 +0000 UTC m=+17.088949253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:35.636784 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.636492 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:35.636784 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.636661 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:43.636646918 +0000 UTC m=+17.089037443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:35.737655 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:35.736997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:35.737655 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.737203 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:35.737655 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.737223 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:35.737655 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.737235 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:35.737655 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:35.737292 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:43.73727428 +0000 UTC m=+17.189664802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:36.115904 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:36.115864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:36.116089 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:36.116005 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:36.116089 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:36.116058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:36.116089 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:36.116073 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:36.116255 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:36.116151 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:36.116322 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:36.116294 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:38.116201 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:38.116160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:38.116201 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:38.116202 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:38.116742 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:38.116277 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:38.116742 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:38.116295 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:38.116742 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:38.116395 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:38.116742 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:38.116489 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:40.115666 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:40.115569 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:40.115666 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:40.115601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:40.115666 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:40.115609 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:40.116165 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:40.115696 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:40.116165 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:40.115786 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:40.116165 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:40.115864 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:42.116322 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:42.116285 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:42.116322 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:42.116315 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:42.116824 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:42.116285 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:42.116824 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:42.116427 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:42.116824 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:42.116550 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:42.116824 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:42.116637 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:43.696737 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:43.696696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:43.697170 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:43.696783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:43.697170 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.696917 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:43.697170 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.696975 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:43.697170 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.696997 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:59.696975107 +0000 UTC m=+33.149365632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:43.697170 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.697025 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:59.697013644 +0000 UTC m=+33.149404163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:43.797779 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:43.797750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:43.797973 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.797951 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:43.798045 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.797980 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:43.798045 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.797992 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:43.798138 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:43.798060 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:42:59.798035713 +0000 UTC m=+33.250426245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:44.116398 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:44.116361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:44.116671 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:44.116567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:44.116671 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:44.116565 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:44.116811 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:44.116677 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:44.118871 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:44.117226 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:44.118871 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:44.117435 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:46.116301 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:46.116264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:46.116301 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:46.116297 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:46.116820 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:46.116272 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:46.116820 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:46.116375 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:46.116820 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:46.116453 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:46.116820 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:46.116551 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:48.115966 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.115801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:48.115966 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:48.115934 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:48.116475 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.116017 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:48.116475 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.116099 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:48.116475 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:48.116213 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:48.116475 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:48.116316 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:48.347023 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.346857 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ftq6j" event={"ID":"2059b595-60f4-45e0-bc85-b974a54e70c7","Type":"ContainerStarted","Data":"6c19c92644c4ab219a0623d7b37246b4c7a2912a7ea2e68273a95fe6762518a1"} Jul 28 13:42:48.348192 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.348168 2572 generic.go:356] "Generic (PLEG): container finished" podID="99222ee40d6d09f739a4ced20d83ab6e" containerID="96824076f67eca3e36dbd70d83268a8cecce15646e188184538bfe4c9d9bfdd2" exitCode=0 Jul 28 13:42:48.348280 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.348244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" event={"ID":"99222ee40d6d09f739a4ced20d83ab6e","Type":"ContainerDied","Data":"96824076f67eca3e36dbd70d83268a8cecce15646e188184538bfe4c9d9bfdd2"} Jul 28 13:42:48.351002 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.350116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" event={"ID":"dc35a73c3bd937735bd26ee52ef00159","Type":"ContainerStarted","Data":"af08ff624fd45d1c7e90d35a744148cf935c78d8081ffb0e3ac8e5ae66b4619a"} Jul 28 13:42:48.353813 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.353790 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"19097800b56da3fa46328ecee02e68f6e55af948e450277d69f16f687e923799"} Jul 28 13:42:48.353897 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.353861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"754f4bcfd1f8e523df4cf15ed2d30ce23d315d18ab898702ad6cb121f1dd1034"} Jul 28 13:42:48.353959 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.353909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"75f4ea096340c3e96f3f42012d123bdb15e6ea4eee622d869d6da25adad4ca70"} Jul 28 13:42:48.355458 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.355439 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerStarted","Data":"65aa04876dc73fff9a18a9f2f3ce7c9ea0c178fd68f96286a9c45778362064c5"} Jul 28 13:42:48.356844 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.356820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" event={"ID":"e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5","Type":"ContainerStarted","Data":"dd2a6e499afd6fd06d1f05831818f66cd86fb5867411d26d8f9201c9d56cb87d"} Jul 28 13:42:48.358176 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.358156 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5kf5" event={"ID":"5e247c04-2030-4ce6-8821-f546e39b87c2","Type":"ContainerStarted","Data":"aff0bc77d3883d2818e641320c19d2da54dd07d6e1ba50baf34818e5ec5a167b"} Jul 28 13:42:48.359623 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.359603 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nb6lz" event={"ID":"58ac3485-70e7-45f3-9e71-124e3633defd","Type":"ContainerStarted","Data":"185d16014d1006db547715ad741e0a4369cd5e3a919f9c42c4d2e0d2948d3303"} Jul 28 13:42:48.361022 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.361005 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" event={"ID":"eec5eee5-67d2-4570-86e7-70c0b5c000de","Type":"ContainerStarted","Data":"33e4984d1bca693dcff0ddd80218556cfa6ab0456e64836c07277c7a21eb2d52"} Jul 28 13:42:48.362298 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.362278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srwmv" event={"ID":"7b3f5fb3-2999-47cd-829c-b57d500ffa21","Type":"ContainerStarted","Data":"bf544fdaa4d28a1a0dac6e082961bafd158b7a12b293a1af5dab9c697c745c24"} Jul 28 13:42:48.392136 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.392092 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-179.ec2.internal" podStartSLOduration=21.392079885 podStartE2EDuration="21.392079885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:48.391608481 +0000 UTC m=+21.843999022" watchObservedRunningTime="2026-07-28 13:42:48.392079885 +0000 UTC m=+21.844470426" Jul 28 13:42:48.416076 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.415961 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ftq6j" podStartSLOduration=1.881457704 podStartE2EDuration="21.415941093s" totalImagesPullingTime="19.534483389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:48.415284599 +0000 UTC m=+21.867675141" watchObservedRunningTime="2026-07-28 13:42:48.415941093 +0000 UTC m=+21.868331635" Jul 28 13:42:48.435067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.434926 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x5kf5" podStartSLOduration=1.872625213 podStartE2EDuration="21.434912861s" totalImagesPullingTime="19.562287648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:48.434526002 +0000 UTC m=+21.886916546" watchObservedRunningTime="2026-07-28 13:42:48.434912861 +0000 UTC m=+21.887303401" Jul 28 13:42:48.483356 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.483315 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-srwmv" podStartSLOduration=1.933491976 podStartE2EDuration="21.483300002s" totalImagesPullingTime="19.549808026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:48.460711507 +0000 UTC m=+21.913102048" watchObservedRunningTime="2026-07-28 13:42:48.483300002 +0000 UTC m=+21.935690543" Jul 28 13:42:48.483721 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.483693 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nb6lz" podStartSLOduration=2.008090095 podStartE2EDuration="21.483686943s" totalImagesPullingTime="19.475596848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:48.483380139 +0000 UTC m=+21.935770678" watchObservedRunningTime="2026-07-28 13:42:48.483686943 +0000 UTC m=+21.936077484" Jul 28 13:42:48.504054 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.504010 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qhcfz" podStartSLOduration=2.014398612 podStartE2EDuration="21.503994738s" totalImagesPullingTime="19.489596126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:48.503382838 +0000 UTC m=+21.955773378" watchObservedRunningTime="2026-07-28 13:42:48.503994738 +0000 UTC m=+21.956385276" Jul 28 13:42:48.889837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.889808 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:48.890606 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:48.890588 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:49.366158 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.366083 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7smr4" event={"ID":"d3fced16-1c1f-4775-af4b-e8be973fb1fb","Type":"ContainerStarted","Data":"f3d00dd79c22545437f66a4677bba0002aac529a4900ec17f3c49cd17735fb5f"} Jul 28 13:42:49.367815 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.367791 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" event={"ID":"99222ee40d6d09f739a4ced20d83ab6e","Type":"ContainerStarted","Data":"6f735d20fc9db34c493124fc0219054d2d13a7745fc208b941950a6dcbeee7dd"} Jul 28 13:42:49.370593 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.370574 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"ee83edd5289d3ae2a14504c935f5ea89b90e2eb942b7b9f373f8f3102d7fda11"} Jul 28 13:42:49.370682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.370627 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"de7dc4fbd8a08f2bb41b17dd05ac48b374bd5394c24b4002e5434b4b7300b60e"} Jul 28 13:42:49.370682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.370675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"6d53180a60b18d13972442728fcfe4c81985d97389cbc7088700129be7e7e0e6"} Jul 28 13:42:49.371849 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.371829 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf" containerID="65aa04876dc73fff9a18a9f2f3ce7c9ea0c178fd68f96286a9c45778362064c5" exitCode=0 Jul 28 13:42:49.371939 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.371919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerDied","Data":"65aa04876dc73fff9a18a9f2f3ce7c9ea0c178fd68f96286a9c45778362064c5"} Jul 28 13:42:49.372888 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.372868 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:49.373403 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.373390 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ftq6j" Jul 28 13:42:49.383194 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.382601 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7smr4" podStartSLOduration=2.860881902 podStartE2EDuration="22.38257918s" totalImagesPullingTime="19.521697278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:49.382015805 +0000 UTC m=+22.834406344" watchObservedRunningTime="2026-07-28 13:42:49.38257918 +0000 UTC m=+22.834969722" Jul 28 13:42:49.398497 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.398452 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-179.ec2.internal" podStartSLOduration=22.398436188 podStartE2EDuration="22.398436188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:49.398393444 +0000 UTC m=+22.850783986" watchObservedRunningTime="2026-07-28 13:42:49.398436188 +0000 UTC m=+22.850826730" Jul 28 13:42:49.792428 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:49.792407 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 13:42:50.046833 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.046664 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T13:42:49.792424258Z","UUID":"8833c402-b90c-4a8a-a4cc-395ba51a210c","Handler":null,"Name":"","Endpoint":""} Jul 28 13:42:50.048368 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.048345 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 13:42:50.048486 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.048388 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 13:42:50.115921 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.115891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:50.116077 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.115891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:50.116077 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:50.116026 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:50.116077 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.115891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:50.116242 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:50.116111 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:50.116242 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:50.116182 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:50.377571 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:50.377289 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" event={"ID":"eec5eee5-67d2-4570-86e7-70c0b5c000de","Type":"ContainerStarted","Data":"5aeb678f747a02b42e4252130d1e09068d014526d172eb0f57447f0a9b003c20"} Jul 28 13:42:51.383666 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:51.383577 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"384ac27898b3c7bdcae4a4dd481dcfda1559f118da32eeacadcb25a006fcc77b"} Jul 28 13:42:51.385981 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:51.385946 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" event={"ID":"eec5eee5-67d2-4570-86e7-70c0b5c000de","Type":"ContainerStarted","Data":"25e5c4ccfbc99a1750d38ca027b66fad52eb6eecbd3ea95f4ef5a234160e77ef"} Jul 28 13:42:52.115869 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:52.115826 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:52.115869 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:52.115857 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:52.116131 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:52.115827 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:52.116131 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:52.115959 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:52.116131 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:52.116039 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:52.116131 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:52.116115 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:54.115576 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.115342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:54.115576 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.115340 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:54.116228 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:54.115610 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:54.116228 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.115340 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:54.116228 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:54.115680 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:54.116228 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:54.115747 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:54.396106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.396018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" event={"ID":"2ddff9fd-0ea8-43de-baf9-2e29f724e637","Type":"ContainerStarted","Data":"da1e0f49b4436f6e1ccba867a812fed6136b3cd35528ff0ccd00ac1f65787e1c"} Jul 28 13:42:54.396397 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.396359 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:54.397892 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.397866 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf" containerID="a91dc0fa32fc8dd7664cffb2691e3ac373f36b4104c075f7016ed35ac544144a" exitCode=0 Jul 28 13:42:54.398014 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.397923 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerDied","Data":"a91dc0fa32fc8dd7664cffb2691e3ac373f36b4104c075f7016ed35ac544144a"} Jul 28 13:42:54.411924 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.411907 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:54.423693 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.423649 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" podStartSLOduration=7.893886372 podStartE2EDuration="27.423635394s" totalImagesPullingTime="19.529749022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:54.423395869 +0000 UTC m=+27.875786402" watchObservedRunningTime="2026-07-28 13:42:54.423635394 +0000 UTC m=+27.876025934" Jul 28 13:42:54.424153 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:54.424124 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnjrr" podStartSLOduration=5.403415495 podStartE2EDuration="27.424114944s" totalImagesPullingTime="22.020699449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:42:51.429123333 +0000 UTC m=+24.881513875" watchObservedRunningTime="2026-07-28 13:42:54.424114944 +0000 UTC m=+27.876505480" Jul 28 13:42:55.399914 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.399891 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 28 13:42:55.400465 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.400448 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:55.415117 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.415099 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:55.608127 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.607904 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4b59g"] Jul 28 13:42:55.608283 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.608179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:55.608350 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:55.608286 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:55.611636 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.611611 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s2q2t"] Jul 28 13:42:55.611736 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.611709 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:55.611808 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:55.611791 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:55.624137 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.624108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p8xl"] Jul 28 13:42:55.624227 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:55.624201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:55.624333 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:55.624315 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:56.013096 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:56.013059 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:42:56.404032 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:56.403950 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf" containerID="68855da8e793ce317223740cab49cfd9e1a5b7bf4b7c24436c2c8a3c7c5c89bb" exitCode=0 Jul 28 13:42:56.404390 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:56.404034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerDied","Data":"68855da8e793ce317223740cab49cfd9e1a5b7bf4b7c24436c2c8a3c7c5c89bb"} Jul 28 13:42:57.118682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:57.118653 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:57.118872 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:57.118741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:57.118872 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:57.118749 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:57.118872 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:57.118765 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:57.118872 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:57.118838 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:57.119095 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:57.118913 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:58.410746 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:58.410711 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf" containerID="eab4c10d6b4b5aee625425f2e3d41933dbf636705021e7fb0b73af8b01329d48" exitCode=0 Jul 28 13:42:58.411106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:58.410756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerDied","Data":"eab4c10d6b4b5aee625425f2e3d41933dbf636705021e7fb0b73af8b01329d48"} Jul 28 13:42:59.119137 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:59.119104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:59.119310 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:59.119145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:59.119310 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:59.119145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:59.119310 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.119226 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4b59g" podUID="cc32c33f-234b-4b8a-af04-eaecb45a1ba5" Jul 28 13:42:59.119466 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.119312 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2q2t" podUID="d3dea567-3dc4-4cc1-94dd-e4ca443b61e9" Jul 28 13:42:59.119466 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.119425 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8p8xl" podUID="52a03453-1eb2-40f8-a987-c45321d52aa5" Jul 28 13:42:59.726515 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:59.726483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:42:59.726957 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:59.726552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:42:59.726957 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.726652 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:59.726957 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.726731 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret podName:52a03453-1eb2-40f8-a987-c45321d52aa5 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:31.726712265 +0000 UTC m=+65.179102799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret") pod "global-pull-secret-syncer-8p8xl" (UID: "52a03453-1eb2-40f8-a987-c45321d52aa5") : object "kube-system"/"original-pull-secret" not registered Jul 28 13:42:59.726957 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.726658 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:59.726957 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.726786 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:31.726770695 +0000 UTC m=+65.179161214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 13:42:59.827647 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:42:59.827609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:42:59.827816 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.827788 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 13:42:59.827816 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.827814 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 13:42:59.827912 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.827830 2572 projected.go:196] Error preparing data for projected volume kube-api-access-6zqb8 for pod openshift-network-diagnostics/network-check-target-4b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:42:59.827912 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:42:59.827880 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8 podName:cc32c33f-234b-4b8a-af04-eaecb45a1ba5 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:31.827866859 +0000 UTC m=+65.280257378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zqb8" (UniqueName: "kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8") pod "network-check-target-4b59g" (UID: "cc32c33f-234b-4b8a-af04-eaecb45a1ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 13:43:00.868570 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.868543 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-179.ec2.internal" event="NodeReady" Jul 28 13:43:00.869045 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.868692 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 13:43:00.917074 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.917036 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54b7f7cb9c-z42h6"] Jul 28 13:43:00.921894 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.921868 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:00.924762 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.924734 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j9bk9\"" Jul 28 13:43:00.924890 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.924777 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 13:43:00.925136 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.925115 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 13:43:00.925136 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.925125 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 13:43:00.930138 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.930115 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l5hp6"] Jul 28 13:43:00.931658 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.930787 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 13:43:00.932802 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.932782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:00.936679 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.936615 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b7f7cb9c-z42h6"] Jul 28 13:43:00.940159 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.939083 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8spsv\"" Jul 28 13:43:00.940313 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.940293 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hzc5l"] Jul 28 13:43:00.940430 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.940415 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 13:43:00.940584 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.940566 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 13:43:00.943940 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.943921 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:00.946773 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.946751 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 13:43:00.946773 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.946767 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 13:43:00.946925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.946788 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 13:43:00.946925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.946856 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8rh7w\"" Jul 28 13:43:00.949262 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.949241 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5hp6"] Jul 28 13:43:00.956498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:00.956474 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hzc5l"] Jul 28 13:43:01.036072 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036032 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-installation-pull-secrets\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036261 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-bound-sa-token\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036261 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2670bb84-7fb6-410a-9477-2a1fc51299f0-cert\") pod \"ingress-canary-hzc5l\" (UID: \"2670bb84-7fb6-410a-9477-2a1fc51299f0\") " pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.036261 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-config-volume\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.036261 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.036261 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-image-registry-private-configuration\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zclwh\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-kube-api-access-zclwh\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-tmp-dir\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036337 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-ca-trust-extracted\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7xq9\" (UniqueName: \"kubernetes.io/projected/2670bb84-7fb6-410a-9477-2a1fc51299f0-kube-api-access-c7xq9\") pod \"ingress-canary-hzc5l\" (UID: \"2670bb84-7fb6-410a-9477-2a1fc51299f0\") " pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khd24\" (UniqueName: \"kubernetes.io/projected/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-kube-api-access-khd24\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-certificates\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036488 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-trusted-ca\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.036805 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.036588 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.115986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.115954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:43:01.116157 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.116003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:43:01.116157 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.115954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:43:01.119371 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.119310 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:43:01.119518 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.119379 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:43:01.119518 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.119400 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:43:01.119518 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.119404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7bxcb\"" Jul 28 13:43:01.119518 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.119428 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:43:01.119736 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.119524 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzm8z\"" Jul 28 13:43:01.137805 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.137776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-bound-sa-token\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.137947 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.137817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2670bb84-7fb6-410a-9477-2a1fc51299f0-cert\") pod \"ingress-canary-hzc5l\" (UID: \"2670bb84-7fb6-410a-9477-2a1fc51299f0\") " pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.138032 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-config-volume\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.138087 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.138122 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-image-registry-private-configuration\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.138122 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zclwh\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-kube-api-access-zclwh\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.138197 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-tmp-dir\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.138197 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138172 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-ca-trust-extracted\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.138259 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138195 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7xq9\" (UniqueName: \"kubernetes.io/projected/2670bb84-7fb6-410a-9477-2a1fc51299f0-kube-api-access-c7xq9\") pod \"ingress-canary-hzc5l\" (UID: \"2670bb84-7fb6-410a-9477-2a1fc51299f0\") " pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.138259 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.138202 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:01.138259 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khd24\" (UniqueName: \"kubernetes.io/projected/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-kube-api-access-khd24\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.138259 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-certificates\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.138372 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.138268 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:01.638248435 +0000 UTC m=+35.090638968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:01.138372 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-trusted-ca\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.138372 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.138478 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.138393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-installation-pull-secrets\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.139249 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-tmp-dir\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.139278 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-ca-trust-extracted\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.139386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-certificates\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.139512 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.139526 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.139579 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-config-volume\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.139625 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.139592 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:43:01.639576082 +0000 UTC m=+35.091966627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:01.140719 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.140180 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-trusted-ca\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.143404 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.143267 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-installation-pull-secrets\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.143500 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.143273 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2670bb84-7fb6-410a-9477-2a1fc51299f0-cert\") pod \"ingress-canary-hzc5l\" (UID: \"2670bb84-7fb6-410a-9477-2a1fc51299f0\") " pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.143712 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.143677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-image-registry-private-configuration\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.146843 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.146826 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7xq9\" (UniqueName: \"kubernetes.io/projected/2670bb84-7fb6-410a-9477-2a1fc51299f0-kube-api-access-c7xq9\") pod \"ingress-canary-hzc5l\" (UID: \"2670bb84-7fb6-410a-9477-2a1fc51299f0\") " pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.150782 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.150754 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khd24\" (UniqueName: \"kubernetes.io/projected/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-kube-api-access-khd24\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.151104 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.151084 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-bound-sa-token\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.151220 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.151196 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zclwh\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-kube-api-access-zclwh\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.254585 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.254548 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hzc5l" Jul 28 13:43:01.643456 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.643417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:01.643673 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:01.643511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:01.643673 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.643621 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:01.643673 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.643659 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:01.643828 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.643677 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:01.643828 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.643749 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:43:02.643726152 +0000 UTC m=+36.096116688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:01.643828 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:01.643770 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:02.643760575 +0000 UTC m=+36.096151099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:02.311420 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:02.311228 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hzc5l"] Jul 28 13:43:02.313955 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:43:02.313925 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2670bb84_7fb6_410a_9477_2a1fc51299f0.slice/crio-55b898c6bc5cc5059104db16ca8f06c672c570eb89a2cda725e8fd17b2199875 WatchSource:0}: Error finding container 55b898c6bc5cc5059104db16ca8f06c672c570eb89a2cda725e8fd17b2199875: Status 404 returned error can't find the container with id 55b898c6bc5cc5059104db16ca8f06c672c570eb89a2cda725e8fd17b2199875 Jul 28 13:43:02.421564 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:02.421516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hzc5l" event={"ID":"2670bb84-7fb6-410a-9477-2a1fc51299f0","Type":"ContainerStarted","Data":"55b898c6bc5cc5059104db16ca8f06c672c570eb89a2cda725e8fd17b2199875"} Jul 28 13:43:02.424303 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:02.424280 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf" containerID="c7ceb84c185beba6f2a256adc34ab1c0d44f43dd0bb8f98a6826d7c1ab9649b3" exitCode=0 Jul 28 13:43:02.424404 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:02.424328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerDied","Data":"c7ceb84c185beba6f2a256adc34ab1c0d44f43dd0bb8f98a6826d7c1ab9649b3"} Jul 28 13:43:02.652229 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:02.652193 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:02.652398 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:02.652247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:02.652398 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:02.652337 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:02.652398 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:02.652346 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:02.652398 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:02.652363 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:02.652398 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:02.652388 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:04.652375253 +0000 UTC m=+38.104765772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:02.652622 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:02.652405 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:43:04.652393607 +0000 UTC m=+38.104784131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:03.430694 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:03.430657 2572 generic.go:356] "Generic (PLEG): container finished" podID="3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf" containerID="9e645d0017ff9b7cb60a5c43fa6aacb2e5577fc0347cd2974834841ea09fcd3d" exitCode=0 Jul 28 13:43:03.431195 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:03.430716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerDied","Data":"9e645d0017ff9b7cb60a5c43fa6aacb2e5577fc0347cd2974834841ea09fcd3d"} Jul 28 13:43:04.437419 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:04.437170 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" event={"ID":"3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf","Type":"ContainerStarted","Data":"5a5fe069ae1d3ceb990e669783024a07f9b497dc7855ed60919754fc1afdf165"} Jul 28 13:43:04.462832 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:04.462772 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vzjsz" podStartSLOduration=7.8742854 podStartE2EDuration="37.46275568s" totalImagesPullingTime="29.58847028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:04.4622965 +0000 UTC m=+37.914687044" watchObservedRunningTime="2026-07-28 13:43:04.46275568 +0000 UTC m=+37.915146220" Jul 28 13:43:04.630314 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:04.630266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:04.668803 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:04.668768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:04.668962 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:04.668835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:04.668962 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:04.668928 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:04.668962 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:04.668946 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:04.669095 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:04.668962 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:04.669095 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:04.669019 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:08.668999025 +0000 UTC m=+42.121389555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:04.669095 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:04.669041 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:43:08.669030219 +0000 UTC m=+42.121420738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:04.725148 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:04.725113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.197416 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.197377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.296588 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.296548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.394438 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.394403 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.440822 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.440729 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hzc5l" event={"ID":"2670bb84-7fb6-410a-9477-2a1fc51299f0","Type":"ContainerStarted","Data":"58ce842771e78fde0bc399f71c286b995ca2c421802f098c38b06ac56bcd981a"} Jul 28 13:43:05.458729 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.458683 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hzc5l" podStartSLOduration=2.620560893 podStartE2EDuration="5.458668662s" totalImagesPullingTime="2.838107769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:05.458407958 +0000 UTC m=+38.910798500" watchObservedRunningTime="2026-07-28 13:43:05.458668662 +0000 UTC m=+38.911059232" Jul 28 13:43:05.493318 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.493282 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.594936 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.594899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.692398 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.692317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.930504 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.930474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:05.990571 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:05.990524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:06.730308 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:06.730270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:06.784266 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:06.784231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:07.140744 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:07.140644 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:07.210225 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:07.210188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:07.944498 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:07.944460 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:08.002961 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:08.002928 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:08.335095 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:08.335059 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:08.392262 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:08.392234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:08.698601 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:08.698486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:08.704403 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:08.704385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:08.704465 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:08.704441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:08.704562 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:08.704546 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:08.704614 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:08.704605 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:16.704589636 +0000 UTC m=+50.156980158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:08.704670 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:08.704546 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:08.704670 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:08.704644 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:08.704739 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:08.704687 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:43:16.704674248 +0000 UTC m=+50.157064773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:14.642057 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:14.642016 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:15.984317 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:15.984286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:16.764473 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:16.764438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:16.764657 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:16.764497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:16.764657 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:16.764606 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:16.764728 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:16.764659 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:32.764646972 +0000 UTC m=+66.217037491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:16.764728 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:16.764611 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:16.764728 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:16.764700 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:16.764825 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:16.764754 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:43:32.764740265 +0000 UTC m=+66.217130790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:27.419571 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:27.419527 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nqtlw" Jul 28 13:43:27.582745 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:27.582707 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:27.683743 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:27.683658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:27.794161 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:27.794131 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:27.883701 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:27.883671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:28.592657 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:28.592615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:28.689382 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:28.689350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:28.924160 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:28.924068 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:28.981491 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:28.981454 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:29.762496 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:29.762453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:29.833872 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:29.833845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:30.208239 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:30.208151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:30.313691 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:30.313657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:31.538422 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.538389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:31.775554 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.775501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:43:31.775738 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.775570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:43:31.781620 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.781599 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 13:43:31.781745 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.781640 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 13:43:31.785945 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:31.785926 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 13:43:31.786023 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:31.785980 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs podName:d3dea567-3dc4-4cc1-94dd-e4ca443b61e9 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:35.785965329 +0000 UTC m=+129.238355853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs") pod "network-metrics-daemon-s2q2t" (UID: "d3dea567-3dc4-4cc1-94dd-e4ca443b61e9") : secret "metrics-daemon-secret" not found Jul 28 13:43:31.788994 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.788942 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52a03453-1eb2-40f8-a987-c45321d52aa5-original-pull-secret\") pod \"global-pull-secret-syncer-8p8xl\" (UID: \"52a03453-1eb2-40f8-a987-c45321d52aa5\") " pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:43:31.876482 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.876423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:43:31.879319 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.879297 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 13:43:31.890114 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.890092 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 13:43:31.900608 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:31.900587 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqb8\" (UniqueName: \"kubernetes.io/projected/cc32c33f-234b-4b8a-af04-eaecb45a1ba5-kube-api-access-6zqb8\") pod \"network-check-target-4b59g\" (UID: \"cc32c33f-234b-4b8a-af04-eaecb45a1ba5\") " pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:43:32.031056 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.031024 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kzm8z\"" Jul 28 13:43:32.038433 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.038409 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:43:32.043357 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.043343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8p8xl" Jul 28 13:43:32.167141 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.167110 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8p8xl"] Jul 28 13:43:32.171340 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:43:32.171312 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a03453_1eb2_40f8_a987_c45321d52aa5.slice/crio-40cd718e5d9e44f659da14e1c908eb5e4a82604d0daf8aacacfa89a7d4aa986b WatchSource:0}: Error finding container 40cd718e5d9e44f659da14e1c908eb5e4a82604d0daf8aacacfa89a7d4aa986b: Status 404 returned error can't find the container with id 40cd718e5d9e44f659da14e1c908eb5e4a82604d0daf8aacacfa89a7d4aa986b Jul 28 13:43:32.182672 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.182650 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4b59g"] Jul 28 13:43:32.183308 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:43:32.183288 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc32c33f_234b_4b8a_af04_eaecb45a1ba5.slice/crio-efbbd48a34bbc0227bc188505295d63aa38a467c267a8edcab478c1cc426fc1d WatchSource:0}: Error finding container efbbd48a34bbc0227bc188505295d63aa38a467c267a8edcab478c1cc426fc1d: Status 404 returned error can't find the container with id efbbd48a34bbc0227bc188505295d63aa38a467c267a8edcab478c1cc426fc1d Jul 28 13:43:32.503615 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.503581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p8xl" event={"ID":"52a03453-1eb2-40f8-a987-c45321d52aa5","Type":"ContainerStarted","Data":"40cd718e5d9e44f659da14e1c908eb5e4a82604d0daf8aacacfa89a7d4aa986b"} Jul 28 13:43:32.504632 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.504607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4b59g" event={"ID":"cc32c33f-234b-4b8a-af04-eaecb45a1ba5","Type":"ContainerStarted","Data":"efbbd48a34bbc0227bc188505295d63aa38a467c267a8edcab478c1cc426fc1d"} Jul 28 13:43:32.785550 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.785453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:43:32.785550 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:32.785524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:43:32.786020 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:32.785655 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 13:43:32.786020 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:32.785657 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 13:43:32.786020 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:32.785684 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54b7f7cb9c-z42h6: secret "image-registry-tls" not found Jul 28 13:43:32.786020 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:32.785732 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls podName:eb7ae083-40c3-4674-8c3d-e40ca40dd7c1 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:04.785713771 +0000 UTC m=+98.238104296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls") pod "dns-default-l5hp6" (UID: "eb7ae083-40c3-4674-8c3d-e40ca40dd7c1") : secret "dns-default-metrics-tls" not found Jul 28 13:43:32.786020 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:32.785751 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls podName:aeef0b49-5ac5-4f46-b0c3-4d399c281f1c nodeName:}" failed. No retries permitted until 2026-07-28 13:44:04.785742103 +0000 UTC m=+98.238132625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls") pod "image-registry-54b7f7cb9c-z42h6" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c") : secret "image-registry-tls" not found Jul 28 13:43:37.518801 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:37.518763 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8p8xl" event={"ID":"52a03453-1eb2-40f8-a987-c45321d52aa5","Type":"ContainerStarted","Data":"fff9940f93297270fe241ba6d579eb9c2667a5d46594bffc771420937ac06e19"} Jul 28 13:43:37.520224 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:37.520202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4b59g" event={"ID":"cc32c33f-234b-4b8a-af04-eaecb45a1ba5","Type":"ContainerStarted","Data":"f7bdcd5628d881db690ce6cb7b7b81f9402ff5346305206f96ac3999c2a78c66"} Jul 28 13:43:37.520338 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:37.520325 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:43:37.534419 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:37.534381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8p8xl" podStartSLOduration=65.62439998 podStartE2EDuration="1m10.534370324s" totalImagesPullingTime="4.909970344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:37.533824658 +0000 UTC m=+70.986215199" watchObservedRunningTime="2026-07-28 13:43:37.534370324 +0000 UTC m=+70.986760865" Jul 28 13:43:37.549037 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:37.548999 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4b59g" podStartSLOduration=65.662983915 podStartE2EDuration="1m10.548987672s" totalImagesPullingTime="4.886003757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:37.548579173 +0000 UTC m=+71.000969714" watchObservedRunningTime="2026-07-28 13:43:37.548987672 +0000 UTC m=+71.001378191" Jul 28 13:43:38.663252 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:38.663222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:38.760279 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:38.760243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:40.168600 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:40.168564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:40.237417 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:40.237382 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:43.664006 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:43.663968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:43.730177 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:43.730140 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:45.289839 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:45.289802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:45.348055 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:45.348015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:49.067888 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.067857 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g"] Jul 28 13:43:49.071160 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.071060 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" Jul 28 13:43:49.074205 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.074188 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nh2g8\"" Jul 28 13:43:49.101284 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.101252 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g"] Jul 28 13:43:49.104665 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.104639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4g8x\" (UniqueName: \"kubernetes.io/projected/27bf234a-ac04-4f67-9c49-e850ca3f3ebe-kube-api-access-c4g8x\") pod \"network-check-source-7d88cb55d8-6pg7g\" (UID: \"27bf234a-ac04-4f67-9c49-e850ca3f3ebe\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" Jul 28 13:43:49.154591 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.154560 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6pngg"] Jul 28 13:43:49.157329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.157314 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.160545 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.160508 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 13:43:49.160668 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.160648 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 13:43:49.162277 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.162246 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 13:43:49.162388 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.162325 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bhn4t\"" Jul 28 13:43:49.162512 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.162494 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 13:43:49.169227 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.169206 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 13:43:49.179642 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.179617 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6pngg"] Jul 28 13:43:49.205187 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205161 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4217eae-66e3-4276-9cef-f0c99a377bf5-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.205187 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ltg2\" (UniqueName: \"kubernetes.io/projected/e4217eae-66e3-4276-9cef-f0c99a377bf5-kube-api-access-5ltg2\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.205395 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4217eae-66e3-4276-9cef-f0c99a377bf5-tmp\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.205395 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4217eae-66e3-4276-9cef-f0c99a377bf5-service-ca-bundle\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.205395 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4g8x\" (UniqueName: \"kubernetes.io/projected/27bf234a-ac04-4f67-9c49-e850ca3f3ebe-kube-api-access-c4g8x\") pod \"network-check-source-7d88cb55d8-6pg7g\" (UID: \"27bf234a-ac04-4f67-9c49-e850ca3f3ebe\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" Jul 28 13:43:49.205573 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4217eae-66e3-4276-9cef-f0c99a377bf5-serving-cert\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.205573 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.205423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4217eae-66e3-4276-9cef-f0c99a377bf5-snapshots\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.214470 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.214438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4g8x\" (UniqueName: \"kubernetes.io/projected/27bf234a-ac04-4f67-9c49-e850ca3f3ebe-kube-api-access-c4g8x\") pod \"network-check-source-7d88cb55d8-6pg7g\" (UID: \"27bf234a-ac04-4f67-9c49-e850ca3f3ebe\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" Jul 28 13:43:49.305749 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.305720 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4217eae-66e3-4276-9cef-f0c99a377bf5-serving-cert\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.305749 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.305755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4217eae-66e3-4276-9cef-f0c99a377bf5-snapshots\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306003 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.305809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4217eae-66e3-4276-9cef-f0c99a377bf5-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306003 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.305833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ltg2\" (UniqueName: \"kubernetes.io/projected/e4217eae-66e3-4276-9cef-f0c99a377bf5-kube-api-access-5ltg2\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306003 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.305860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4217eae-66e3-4276-9cef-f0c99a377bf5-tmp\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306003 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.305992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4217eae-66e3-4276-9cef-f0c99a377bf5-service-ca-bundle\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306412 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.306371 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4217eae-66e3-4276-9cef-f0c99a377bf5-tmp\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306560 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.306440 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e4217eae-66e3-4276-9cef-f0c99a377bf5-snapshots\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306560 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.306526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:49.306806 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.306788 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4217eae-66e3-4276-9cef-f0c99a377bf5-service-ca-bundle\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.306903 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.306888 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4217eae-66e3-4276-9cef-f0c99a377bf5-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.308223 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.308207 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4217eae-66e3-4276-9cef-f0c99a377bf5-serving-cert\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.316161 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.316141 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ltg2\" (UniqueName: \"kubernetes.io/projected/e4217eae-66e3-4276-9cef-f0c99a377bf5-kube-api-access-5ltg2\") pod \"insights-operator-5885fdb759-6pngg\" (UID: \"e4217eae-66e3-4276-9cef-f0c99a377bf5\") " pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.378771 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.378692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" Jul 28 13:43:49.388347 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.388307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:49.465890 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.465864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-6pngg" Jul 28 13:43:49.499241 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.499210 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g"] Jul 28 13:43:49.502080 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:43:49.502053 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bf234a_ac04_4f67_9c49_e850ca3f3ebe.slice/crio-4eeb730483c87d947d07567d0d2641d8576966c84d8224fa52295a757d2cdf9a WatchSource:0}: Error finding container 4eeb730483c87d947d07567d0d2641d8576966c84d8224fa52295a757d2cdf9a: Status 404 returned error can't find the container with id 4eeb730483c87d947d07567d0d2641d8576966c84d8224fa52295a757d2cdf9a Jul 28 13:43:49.549843 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.549814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" event={"ID":"27bf234a-ac04-4f67-9c49-e850ca3f3ebe","Type":"ContainerStarted","Data":"4eeb730483c87d947d07567d0d2641d8576966c84d8224fa52295a757d2cdf9a"} Jul 28 13:43:49.590019 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:49.589895 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6pngg"] Jul 28 13:43:49.592316 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:43:49.592291 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4217eae_66e3_4276_9cef_f0c99a377bf5.slice/crio-4af8308832ccb2fbcef945dcd0ee09d5a91b8798660d230cfbd0e327a78b18ad WatchSource:0}: Error finding container 4af8308832ccb2fbcef945dcd0ee09d5a91b8798660d230cfbd0e327a78b18ad: Status 404 returned error can't find the container with id 4af8308832ccb2fbcef945dcd0ee09d5a91b8798660d230cfbd0e327a78b18ad Jul 28 13:43:50.555480 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:50.555231 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" event={"ID":"27bf234a-ac04-4f67-9c49-e850ca3f3ebe","Type":"ContainerStarted","Data":"150db6ed2acbec66f06b7052d40c8e6bf8b7648c915a82e7f7cc817bcab4730a"} Jul 28 13:43:50.556568 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:50.556522 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6pngg" event={"ID":"e4217eae-66e3-4276-9cef-f0c99a377bf5","Type":"ContainerStarted","Data":"4af8308832ccb2fbcef945dcd0ee09d5a91b8798660d230cfbd0e327a78b18ad"} Jul 28 13:43:50.572657 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:50.572602 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-6pg7g" podStartSLOduration=1.5725814649999998 podStartE2EDuration="1.572581465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:50.571362181 +0000 UTC m=+84.023752722" watchObservedRunningTime="2026-07-28 13:43:50.572581465 +0000 UTC m=+84.024972007" Jul 28 13:43:52.399123 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.399081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:52.456938 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.456900 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:52.563221 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.563183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6pngg" event={"ID":"e4217eae-66e3-4276-9cef-f0c99a377bf5","Type":"ContainerStarted","Data":"b7d6ab98b6ea43bf3db84caf2b1cb4b2cab42e0ecb518db555c60b02566c9495"} Jul 28 13:43:52.583212 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.583159 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-6pngg" podStartSLOduration=1.594716671 podStartE2EDuration="3.583139301s" totalImagesPullingTime="1.98842263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:52.582320303 +0000 UTC m=+86.034710850" watchObservedRunningTime="2026-07-28 13:43:52.583139301 +0000 UTC m=+86.035529844" Jul 28 13:43:52.676549 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.676434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:52.738649 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.738620 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l52wv"] Jul 28 13:43:52.741778 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.741759 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.745750 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.745733 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 13:43:52.746807 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.746789 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2kzl\"" Jul 28 13:43:52.750566 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.750547 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 13:43:52.771177 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.771151 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l52wv"] Jul 28 13:43:52.790963 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.790936 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:52.837658 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.837621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-data-volume\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.837658 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.837651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddcb\" (UniqueName: \"kubernetes.io/projected/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-api-access-mddcb\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.837890 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.837672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.837890 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.837771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.837890 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.837822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-crio-socket\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.881263 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.881228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:52.939058 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.938979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.939058 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.939038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.939062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-crio-socket\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.939100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-data-volume\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:52.939104 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:52.939186 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:53.439167176 +0000 UTC m=+86.891557718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : configmap "kube-rbac-proxy" not found Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:52.939188 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.939115 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddcb\" (UniqueName: \"kubernetes.io/projected/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-api-access-mddcb\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:52.939223 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:53.439213485 +0000 UTC m=+86.891604005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:52.939242 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.939237 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-crio-socket\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.939592 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.939380 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-data-volume\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:52.948336 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:52.948312 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddcb\" (UniqueName: \"kubernetes.io/projected/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-api-access-mddcb\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:53.081260 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.081211 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:53.180528 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.180498 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g"] Jul 28 13:43:53.181329 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.181297 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:53.183663 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.183647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" Jul 28 13:43:53.186994 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.186968 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 13:43:53.187110 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.186998 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wlt8r\"" Jul 28 13:43:53.187110 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.186969 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 13:43:53.194095 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.194077 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g"] Jul 28 13:43:53.242474 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.242437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrmx\" (UniqueName: \"kubernetes.io/projected/b0481646-9b95-4647-8a3a-00ad8e556926-kube-api-access-bdrmx\") pod \"migrator-6865c9967-qp84g\" (UID: \"b0481646-9b95-4647-8a3a-00ad8e556926\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" Jul 28 13:43:53.270812 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.270778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:53.343740 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.343705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrmx\" (UniqueName: \"kubernetes.io/projected/b0481646-9b95-4647-8a3a-00ad8e556926-kube-api-access-bdrmx\") pod \"migrator-6865c9967-qp84g\" (UID: \"b0481646-9b95-4647-8a3a-00ad8e556926\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" Jul 28 13:43:53.352234 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.352204 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrmx\" (UniqueName: \"kubernetes.io/projected/b0481646-9b95-4647-8a3a-00ad8e556926-kube-api-access-bdrmx\") pod \"migrator-6865c9967-qp84g\" (UID: \"b0481646-9b95-4647-8a3a-00ad8e556926\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" Jul 28 13:43:53.365047 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.365024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:53.444734 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.444643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:53.444734 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.444682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:53.445159 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:53.444785 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:53.445159 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:53.444824 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:53.445159 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:53.444867 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:54.444845665 +0000 UTC m=+87.897236197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : configmap "kube-rbac-proxy" not found Jul 28 13:43:53.445159 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:53.444889 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:54.4448787 +0000 UTC m=+87.897269223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:53.492613 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.492582 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" Jul 28 13:43:53.615824 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:53.615793 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g"] Jul 28 13:43:53.618958 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:43:53.618930 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0481646_9b95_4647_8a3a_00ad8e556926.slice/crio-ea47c977dff36bda85fe39391bfe6a532cf35a5cffc0a661c6143282f065a81c WatchSource:0}: Error finding container ea47c977dff36bda85fe39391bfe6a532cf35a5cffc0a661c6143282f065a81c: Status 404 returned error can't find the container with id ea47c977dff36bda85fe39391bfe6a532cf35a5cffc0a661c6143282f065a81c Jul 28 13:43:54.453098 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:54.453059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:54.453523 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:54.453197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:54.453523 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:54.453251 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:54.453523 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:54.453278 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:54.453523 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:54.453321 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:56.453302214 +0000 UTC m=+89.905692742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : configmap "kube-rbac-proxy" not found Jul 28 13:43:54.453523 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:54.453335 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:43:56.453327794 +0000 UTC m=+89.905718313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:54.570495 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:54.570460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" event={"ID":"b0481646-9b95-4647-8a3a-00ad8e556926","Type":"ContainerStarted","Data":"ea47c977dff36bda85fe39391bfe6a532cf35a5cffc0a661c6143282f065a81c"} Jul 28 13:43:54.718144 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:54.718116 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5kf5_5e247c04-2030-4ce6-8821-f546e39b87c2/dns-node-resolver/0.log" Jul 28 13:43:54.730129 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:54.730083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:54.816300 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:54.816265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:55.575578 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:55.575530 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" event={"ID":"b0481646-9b95-4647-8a3a-00ad8e556926","Type":"ContainerStarted","Data":"ce72aecc00b03e9e9578820655e3bb32a1c5402ec8962f72d18aa9c3092d9e7c"} Jul 28 13:43:55.575983 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:55.575596 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" event={"ID":"b0481646-9b95-4647-8a3a-00ad8e556926","Type":"ContainerStarted","Data":"17eed14ed6555c642c84a65d10ef3ee29b7f1209a5eb1103ced842787a186533"} Jul 28 13:43:55.594925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:55.594881 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-qp84g" podStartSLOduration=1.292970632 podStartE2EDuration="2.594865352s" totalImagesPullingTime="1.30189472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:55.593264589 +0000 UTC m=+89.045655132" watchObservedRunningTime="2026-07-28 13:43:55.594865352 +0000 UTC m=+89.047255897" Jul 28 13:43:55.712487 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:55.712452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:55.718110 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:55.718089 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nb6lz_58ac3485-70e7-45f3-9e71-124e3633defd/node-ca/0.log" Jul 28 13:43:56.468129 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:56.468084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:56.468322 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:56.468190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:43:56.468322 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:56.468242 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:43:56.468322 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:56.468265 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:43:56.468322 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:56.468306 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:00.46829404 +0000 UTC m=+93.920684559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : configmap "kube-rbac-proxy" not found Jul 28 13:43:56.468322 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:43:56.468319 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:00.468312848 +0000 UTC m=+93.920703367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : secret "insights-runtime-extractor-tls" not found Jul 28 13:43:56.723752 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:56.723653 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzc5l_2670bb84-7fb6-410a-9477-2a1fc51299f0/serve-healthcheck-canary/0.log" Jul 28 13:43:58.863834 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:58.863801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:59.046213 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:59.046178 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:59.191356 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:59.191275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:59.361592 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:59.361554 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:59.494783 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:59.494749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:43:59.587802 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:43:59.587762 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:00.150227 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:00.150193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:00.500727 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:00.500694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:00.500727 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:00.500732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:00.500937 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:44:00.500817 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 13:44:00.500937 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:44:00.500866 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:44:00.500937 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:44:00.500889 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:08.50087433 +0000 UTC m=+101.953264854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : configmap "kube-rbac-proxy" not found Jul 28 13:44:00.500937 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:44:00.500910 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:08.500898874 +0000 UTC m=+101.953289394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : secret "insights-runtime-extractor-tls" not found Jul 28 13:44:00.533332 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:00.533298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:00.912568 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:00.912462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:01.129821 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:01.129785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:01.338647 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:01.338601 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:01.740991 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:01.740957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:02.329039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:02.329002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:02.406552 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:02.406502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:02.535310 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:02.535276 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:02.750005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:02.749972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:02.933410 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:02.933374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:03.027349 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:03.027261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:03.315647 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:03.315554 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:03.709220 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:03.709124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:04.108910 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.108874 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:04.710942 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.710910 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:04.811184 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.811147 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:04.836304 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.836273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:44:04.836420 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.836326 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:44:04.838742 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.838716 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb7ae083-40c3-4674-8c3d-e40ca40dd7c1-metrics-tls\") pod \"dns-default-l5hp6\" (UID: \"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1\") " pod="openshift-dns/dns-default-l5hp6" Jul 28 13:44:04.838742 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.838736 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"image-registry-54b7f7cb9c-z42h6\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:44:04.847016 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.846996 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8spsv\"" Jul 28 13:44:04.854337 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:04.854320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l5hp6" Jul 28 13:44:05.004636 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.004609 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l5hp6"] Jul 28 13:44:05.006249 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:44:05.006220 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7ae083_40c3_4674_8c3d_e40ca40dd7c1.slice/crio-cdf60863259e0e7804b79c637995cd0a15926098459bd264ce943711ddfce329 WatchSource:0}: Error finding container cdf60863259e0e7804b79c637995cd0a15926098459bd264ce943711ddfce329: Status 404 returned error can't find the container with id cdf60863259e0e7804b79c637995cd0a15926098459bd264ce943711ddfce329 Jul 28 13:44:05.111743 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.111709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:05.136883 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.136853 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j9bk9\"" Jul 28 13:44:05.144655 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.144627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:44:05.284350 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.284269 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b7f7cb9c-z42h6"] Jul 28 13:44:05.288314 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:44:05.288286 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeef0b49_5ac5_4f46_b0c3_4d399c281f1c.slice/crio-b7ae4cc700191d4feb38cc96fb8691fad0da3bb094f56b2100ec4d37bb02556e WatchSource:0}: Error finding container b7ae4cc700191d4feb38cc96fb8691fad0da3bb094f56b2100ec4d37bb02556e: Status 404 returned error can't find the container with id b7ae4cc700191d4feb38cc96fb8691fad0da3bb094f56b2100ec4d37bb02556e Jul 28 13:44:05.522390 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.522356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:05.612059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.611958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" event={"ID":"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c","Type":"ContainerStarted","Data":"b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9"} Jul 28 13:44:05.612059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.612019 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" event={"ID":"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c","Type":"ContainerStarted","Data":"b7ae4cc700191d4feb38cc96fb8691fad0da3bb094f56b2100ec4d37bb02556e"} Jul 28 13:44:05.612059 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.612060 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:44:05.613310 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.613272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5hp6" event={"ID":"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1","Type":"ContainerStarted","Data":"cdf60863259e0e7804b79c637995cd0a15926098459bd264ce943711ddfce329"} Jul 28 13:44:05.637297 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.637237 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" podStartSLOduration=98.637218998 podStartE2EDuration="1m38.637218998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:05.636348272 +0000 UTC m=+99.088738830" watchObservedRunningTime="2026-07-28 13:44:05.637218998 +0000 UTC m=+99.089609540" Jul 28 13:44:05.942975 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:05.942886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:06.337970 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:06.337939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:06.736291 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:06.736230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:07.197751 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.197709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:07.257847 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.257748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:07.328576 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.328525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:07.621494 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.621411 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5hp6" event={"ID":"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1","Type":"ContainerStarted","Data":"2c41794e28b148d2148811d4fd732eeafb32b57ad7f582dcb61f3a822336929f"} Jul 28 13:44:07.621494 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.621486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l5hp6" event={"ID":"eb7ae083-40c3-4674-8c3d-e40ca40dd7c1","Type":"ContainerStarted","Data":"edabc715ebe69012f30e5a16f2461faa76fcfefc4c9119cdabaee575c09fa895"} Jul 28 13:44:07.621698 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.621593 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l5hp6" Jul 28 13:44:07.642183 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.642116 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l5hp6" podStartSLOduration=65.828441304 podStartE2EDuration="1m7.642097841s" totalImagesPullingTime="1.813656537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:07.641074289 +0000 UTC m=+101.093464831" watchObservedRunningTime="2026-07-28 13:44:07.642097841 +0000 UTC m=+101.094488381" Jul 28 13:44:07.755097 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:07.755058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:08.305658 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:08.305625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:08.525426 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:08.525397 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4b59g" Jul 28 13:44:08.566581 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:08.566472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:08.566581 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:08.566520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:08.566767 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:44:08.566645 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 13:44:08.566767 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:44:08.566698 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls podName:fcdbc080-6e9d-437b-a805-c10fcf59e2e7 nodeName:}" failed. No retries permitted until 2026-07-28 13:44:24.566684454 +0000 UTC m=+118.019074972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l52wv" (UID: "fcdbc080-6e9d-437b-a805-c10fcf59e2e7") : secret "insights-runtime-extractor-tls" not found Jul 28 13:44:08.567098 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:08.567076 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:08.984011 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:08.983982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:09.154085 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:09.154046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:09.314885 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:09.314798 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:09.517371 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:09.517334 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:14.714684 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:14.714646 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:14.770781 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:14.770735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:17.627118 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:17.627089 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l5hp6" Jul 28 13:44:18.447588 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.447554 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9"] Jul 28 13:44:18.450506 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.450490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.454834 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.454812 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 13:44:18.454953 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.454898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 13:44:18.455729 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.455712 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 13:44:18.458887 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.458872 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 13:44:18.461511 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.461494 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 13:44:18.461651 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.461633 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 13:44:18.462641 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.462616 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 13:44:18.483025 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.482990 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9"] Jul 28 13:44:18.623596 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.623559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:18.639734 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.639701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx7sx\" (UniqueName: \"kubernetes.io/projected/b950b9e9-092a-4f09-af20-6feb6c65ebd3-kube-api-access-vx7sx\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.640106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.639743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.640106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.639762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-ca\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.640106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.639844 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.640106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.639908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-hub\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.640106 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.639933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b950b9e9-092a-4f09-af20-6feb6c65ebd3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.740948 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.740910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx7sx\" (UniqueName: \"kubernetes.io/projected/b950b9e9-092a-4f09-af20-6feb6c65ebd3-kube-api-access-vx7sx\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.741112 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.740979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.741112 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.741007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-ca\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.741112 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.741033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.741217 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.741179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-hub\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.741271 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.741229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b950b9e9-092a-4f09-af20-6feb6c65ebd3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.741980 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.741956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b950b9e9-092a-4f09-af20-6feb6c65ebd3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.743626 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.743605 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.743741 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.743677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.743907 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.743888 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-ca\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.744012 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.743993 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b950b9e9-092a-4f09-af20-6feb6c65ebd3-hub\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.745904 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.745881 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:18.751970 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.751941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx7sx\" (UniqueName: \"kubernetes.io/projected/b950b9e9-092a-4f09-af20-6feb6c65ebd3-kube-api-access-vx7sx\") pod \"cluster-proxy-proxy-agent-78555444bc-dl7t9\" (UID: \"b950b9e9-092a-4f09-af20-6feb6c65ebd3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.774602 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.774572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" Jul 28 13:44:18.843737 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.843706 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:18.909228 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:18.909099 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9"] Jul 28 13:44:18.911577 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:44:18.911555 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb950b9e9_092a_4f09_af20_6feb6c65ebd3.slice/crio-1e17a950d8fb9769a673296ec45b8172c87d903213b2f228372159f9acfd59a7 WatchSource:0}: Error finding container 1e17a950d8fb9769a673296ec45b8172c87d903213b2f228372159f9acfd59a7: Status 404 returned error can't find the container with id 1e17a950d8fb9769a673296ec45b8172c87d903213b2f228372159f9acfd59a7 Jul 28 13:44:19.666824 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:19.666787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" event={"ID":"b950b9e9-092a-4f09-af20-6feb6c65ebd3","Type":"ContainerStarted","Data":"1e17a950d8fb9769a673296ec45b8172c87d903213b2f228372159f9acfd59a7"} Jul 28 13:44:22.680915 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:22.680825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" event={"ID":"b950b9e9-092a-4f09-af20-6feb6c65ebd3","Type":"ContainerStarted","Data":"d111141fb063c1beba9baf9f7bd1b7b6f57c797a92514f84c6b2fd1cad29d96d"} Jul 28 13:44:22.680915 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:22.680865 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" event={"ID":"b950b9e9-092a-4f09-af20-6feb6c65ebd3","Type":"ContainerStarted","Data":"68aca52ab764ef7007bf2e6ee1ad519d6ea7f33725a3f9ce7969027b4f204caf"} Jul 28 13:44:22.680915 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:22.680878 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" event={"ID":"b950b9e9-092a-4f09-af20-6feb6c65ebd3","Type":"ContainerStarted","Data":"268b998c19f6856bdfc0f0f0b2a0da145b0d0c9e0206fb55ee022685156bedd4"} Jul 28 13:44:22.704251 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:22.704202 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78555444bc-dl7t9" podStartSLOduration=1.340317452 podStartE2EDuration="4.704186242s" totalImagesPullingTime="3.36386879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:22.702683224 +0000 UTC m=+116.155073791" watchObservedRunningTime="2026-07-28 13:44:22.704186242 +0000 UTC m=+116.156576813" Jul 28 13:44:24.256433 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.256395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:24.353096 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.353057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:24.446852 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.446821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:24.522850 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.522760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:24.602206 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.602158 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:24.604586 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.604567 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcdbc080-6e9d-437b-a805-c10fcf59e2e7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l52wv\" (UID: \"fcdbc080-6e9d-437b-a805-c10fcf59e2e7\") " pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:24.805401 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.805317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:24.850703 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.850674 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l52wv" Jul 28 13:44:24.976797 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:24.976775 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l52wv"] Jul 28 13:44:24.979323 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:44:24.979298 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdbc080_6e9d_437b_a805_c10fcf59e2e7.slice/crio-7bfea8dbef8e46899859a46fc9448543f303f7eaeb34bb0ee90ad0f8f0efc054 WatchSource:0}: Error finding container 7bfea8dbef8e46899859a46fc9448543f303f7eaeb34bb0ee90ad0f8f0efc054: Status 404 returned error can't find the container with id 7bfea8dbef8e46899859a46fc9448543f303f7eaeb34bb0ee90ad0f8f0efc054 Jul 28 13:44:25.148852 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:25.148758 2572 patch_prober.go:28] interesting pod/image-registry-54b7f7cb9c-z42h6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 13:44:25.148852 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:25.148816 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" podUID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 13:44:25.692737 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:25.692642 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l52wv" event={"ID":"fcdbc080-6e9d-437b-a805-c10fcf59e2e7","Type":"ContainerStarted","Data":"7bfea8dbef8e46899859a46fc9448543f303f7eaeb34bb0ee90ad0f8f0efc054"} Jul 28 13:44:26.623489 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:26.623451 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:44:26.819463 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:26.819416 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:26.901796 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:26.901707 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:27.721158 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:27.721119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:27.784130 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:27.784084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:28.797897 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:28.797857 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:28.866105 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:28.866057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:30.349452 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:30.349401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:30.441184 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:30.441074 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:30.712387 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:30.712295 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l52wv" event={"ID":"fcdbc080-6e9d-437b-a805-c10fcf59e2e7","Type":"ContainerStarted","Data":"cdb8b4c937578b3830fd57b53b5594ced79eab5bc50e1b62f08b1d68ce84b268"} Jul 28 13:44:31.496691 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:31.496655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:31.603833 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:31.603776 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:31.803320 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:31.803231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:33.725252 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:33.725208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l52wv" event={"ID":"fcdbc080-6e9d-437b-a805-c10fcf59e2e7","Type":"ContainerStarted","Data":"775b1800f009f33535dff8f96b6cc1d7423b8c78672490b31bef74a70dd891f9"} Jul 28 13:44:34.672586 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:34.672522 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:35.801197 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:35.801161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:44:35.803779 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:35.803749 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3dea567-3dc4-4cc1-94dd-e4ca443b61e9-metrics-certs\") pod \"network-metrics-daemon-s2q2t\" (UID: \"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9\") " pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:44:35.937818 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:35.937784 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7bxcb\"" Jul 28 13:44:35.945341 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:35.945300 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2q2t" Jul 28 13:44:36.355889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:36.355849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:36.456096 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:36.456066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:36.768063 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:36.768022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:36.876202 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:36.876165 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:36.973094 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:36.973046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.194390 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.194322 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h2nh6"] Jul 28 13:44:37.220404 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.220371 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.225617 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.225588 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 13:44:37.225764 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.225659 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 13:44:37.225840 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.225764 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 13:44:37.226924 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.226791 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 13:44:37.226924 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.226809 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 13:44:37.226924 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.226800 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 13:44:37.227525 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.227228 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qbfrr\"" Jul 28 13:44:37.252682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.252631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.313754 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.313720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-wtmp\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.313906 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.313812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-textfile\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.313906 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.313868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc7lz\" (UniqueName: \"kubernetes.io/projected/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-kube-api-access-vc7lz\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.314018 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.313902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.314018 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.313940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-sys\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.314018 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.313966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-metrics-client-ca\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.314018 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.314005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-root\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.314210 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.314051 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.314210 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.314091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-tls\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.362747 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.362705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.398414 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.398388 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s2q2t"] Jul 28 13:44:37.398560 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:44:37.398515 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3dea567_3dc4_4cc1_94dd_e4ca443b61e9.slice/crio-a73a0d54ef241fc0b4c5118481fd2ac86d23c9b7bd860bf56cd99dbf466e6346 WatchSource:0}: Error finding container a73a0d54ef241fc0b4c5118481fd2ac86d23c9b7bd860bf56cd99dbf466e6346: Status 404 returned error can't find the container with id a73a0d54ef241fc0b4c5118481fd2ac86d23c9b7bd860bf56cd99dbf466e6346 Jul 28 13:44:37.414729 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-root\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.414862 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.414862 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-tls\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.414862 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414808 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-root\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-wtmp\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414895 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-textfile\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc7lz\" (UniqueName: \"kubernetes.io/projected/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-kube-api-access-vc7lz\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.414982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-sys\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415039 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.415004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-metrics-client-ca\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415322 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.415058 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-wtmp\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415322 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.415180 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-sys\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415516 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.415495 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-textfile\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.415917 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.415884 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.416250 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.416220 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-metrics-client-ca\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.417584 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.417566 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.417705 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.417688 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-node-exporter-tls\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.424648 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.424631 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc7lz\" (UniqueName: \"kubernetes.io/projected/f8aed8e7-0947-4ff1-a479-923a2f89f3b9-kube-api-access-vc7lz\") pod \"node-exporter-h2nh6\" (UID: \"f8aed8e7-0947-4ff1-a479-923a2f89f3b9\") " pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.469567 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.469520 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.529634 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.529604 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h2nh6" Jul 28 13:44:37.541950 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:44:37.541923 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aed8e7_0947_4ff1_a479_923a2f89f3b9.slice/crio-b7714ca18ff158d54bbcbd95c5de6dbd839528f78b969aa332313ff93d23ea8d WatchSource:0}: Error finding container b7714ca18ff158d54bbcbd95c5de6dbd839528f78b969aa332313ff93d23ea8d: Status 404 returned error can't find the container with id b7714ca18ff158d54bbcbd95c5de6dbd839528f78b969aa332313ff93d23ea8d Jul 28 13:44:37.579245 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.579213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.742284 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.742200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2nh6" event={"ID":"f8aed8e7-0947-4ff1-a479-923a2f89f3b9","Type":"ContainerStarted","Data":"b7714ca18ff158d54bbcbd95c5de6dbd839528f78b969aa332313ff93d23ea8d"} Jul 28 13:44:37.743287 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.743265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2q2t" event={"ID":"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9","Type":"ContainerStarted","Data":"a73a0d54ef241fc0b4c5118481fd2ac86d23c9b7bd860bf56cd99dbf466e6346"} Jul 28 13:44:37.745155 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.745134 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l52wv" event={"ID":"fcdbc080-6e9d-437b-a805-c10fcf59e2e7","Type":"ContainerStarted","Data":"f8f7443c39bd6e3d5ceebbfc96793a7d615d8d53c4093833bd747b9a16263843"} Jul 28 13:44:37.749162 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.749138 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.770705 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.770564 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l52wv" podStartSLOduration=33.560322448 podStartE2EDuration="45.770526724s" totalImagesPullingTime="12.210204276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:43:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:37.769821004 +0000 UTC m=+131.222211555" watchObservedRunningTime="2026-07-28 13:44:37.770526724 +0000 UTC m=+131.222917265" Jul 28 13:44:37.863863 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.863830 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:37.985864 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:37.985829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:38.091391 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:38.091323 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:38.197956 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:38.197918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:38.753336 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:38.753301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2q2t" event={"ID":"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9","Type":"ContainerStarted","Data":"e7e4e805c1a4f3d94c5bcc45958fac9c3ee43378c18b825cca5c67cc0412f455"} Jul 28 13:44:38.753526 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:38.753366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2q2t" event={"ID":"d3dea567-3dc4-4cc1-94dd-e4ca443b61e9","Type":"ContainerStarted","Data":"b29dc83eed20c7b9c4ffc1844ad5bd8bf4bdef16e92f2807c8192830f1a75f34"} Jul 28 13:44:38.775618 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:38.775558 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s2q2t" podStartSLOduration=130.824312044 podStartE2EDuration="2m11.77551163s" totalImagesPullingTime="951.199586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:38.774266327 +0000 UTC m=+132.226656870" watchObservedRunningTime="2026-07-28 13:44:38.77551163 +0000 UTC m=+132.227902173" Jul 28 13:44:38.987018 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:38.986983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:39.070729 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:39.070650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:39.420010 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:39.419922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:39.534626 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:39.534594 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:39.757486 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:39.757448 2572 generic.go:356] "Generic (PLEG): container finished" podID="f8aed8e7-0947-4ff1-a479-923a2f89f3b9" containerID="0ca6a53963dcaf5f39ef326c960073387c2666c11d63d9b995969247bb5b2692" exitCode=0 Jul 28 13:44:39.757636 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:39.757558 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2nh6" event={"ID":"f8aed8e7-0947-4ff1-a479-923a2f89f3b9","Type":"ContainerDied","Data":"0ca6a53963dcaf5f39ef326c960073387c2666c11d63d9b995969247bb5b2692"} Jul 28 13:44:40.034134 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.034050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:40.160951 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.160917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:40.258991 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.258956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:40.312921 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.312845 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54b7f7cb9c-z42h6"] Jul 28 13:44:40.414321 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.414277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:40.513934 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.513899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:40.766591 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.766554 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2nh6" event={"ID":"f8aed8e7-0947-4ff1-a479-923a2f89f3b9","Type":"ContainerStarted","Data":"cac3ac17bb79d74f703a452b7a29b8acf1430cc6430da684f00320f8e34b778f"} Jul 28 13:44:40.766772 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.766646 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h2nh6" event={"ID":"f8aed8e7-0947-4ff1-a479-923a2f89f3b9","Type":"ContainerStarted","Data":"e43be0f58f9071f70f277c698c177254c0794b708d95266a7a9a0f902a752ff2"} Jul 28 13:44:40.831910 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.831873 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:40.927147 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:40.927112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:41.788929 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:41.788899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:42.069321 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:42.069230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:43.366627 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:43.366590 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:44.645008 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:44.644970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:44.726661 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:44.726626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:44.802028 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:44.801997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.025924 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.025877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.371078 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.370991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.467932 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.467897 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.633209 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.633126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.704120 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.704090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.769264 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.769218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.831240 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.831211 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:45.962096 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:45.962005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:46.030773 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:46.030744 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:46.163375 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:46.163339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:46.223054 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:46.223027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:46.379635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:46.379593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:46.513134 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:46.513046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:46.619093 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:46.619038 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:48.401198 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:48.401160 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:48.602681 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:48.602644 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:59.644222 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:59.644177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:44:59.746439 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:44:59.746406 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:00.593875 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:00.593836 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:00.656501 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:00.656468 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:03.834597 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.834518 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h2nh6" podStartSLOduration=25.194859066 podStartE2EDuration="26.83449894s" totalImagesPullingTime="1.576852228s" totalInitContainerRuntime="62.787646ms" isStatefulPod=true podCreationTimestamp="2026-07-28 13:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:40.797081212 +0000 UTC m=+134.249471754" watchObservedRunningTime="2026-07-28 13:45:03.83449894 +0000 UTC m=+157.286889481" Jul 28 13:45:03.834973 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.834940 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbdb444bf-6mgz7"] Jul 28 13:45:03.978726 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.978694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbdb444bf-6mgz7"] Jul 28 13:45:03.978892 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.978813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:03.986922 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.986898 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 13:45:03.986922 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.986915 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 13:45:03.987104 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.986980 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 13:45:03.988323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.988307 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 13:45:03.988523 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.988507 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 13:45:03.988621 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.988561 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 13:45:03.989412 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.989394 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c2kc8\"" Jul 28 13:45:03.995107 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.995092 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 13:45:03.998935 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:03.998915 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 13:45:04.121208 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lpjx\" (UniqueName: \"kubernetes.io/projected/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-kube-api-access-5lpjx\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.121208 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-oauth-config\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.121208 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121196 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-oauth-serving-cert\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.121420 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-trusted-ca-bundle\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.121420 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-serving-cert\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.121420 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121299 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-service-ca\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.121420 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.121320 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-config\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-serving-cert\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-service-ca\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222847 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-config\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222847 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lpjx\" (UniqueName: \"kubernetes.io/projected/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-kube-api-access-5lpjx\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222847 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-oauth-config\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222847 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-oauth-serving-cert\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.222847 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.222786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-trusted-ca-bundle\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.223555 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.223519 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-oauth-serving-cert\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.223663 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.223574 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-config\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.223705 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.223689 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-trusted-ca-bundle\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.223743 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.223712 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-service-ca\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.225271 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.225249 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-serving-cert\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.225362 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.225313 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-oauth-config\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.233583 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.233560 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lpjx\" (UniqueName: \"kubernetes.io/projected/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-kube-api-access-5lpjx\") pod \"console-5cbdb444bf-6mgz7\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.245107 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.245075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:04.288066 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.288038 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:04.370599 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.370567 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:04.439956 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.439925 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbdb444bf-6mgz7"] Jul 28 13:45:04.442785 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:45:04.442758 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c81e3d_741a_4ab0_bdc2_e22ae40da9be.slice/crio-f45d21465cbcd45444c0ff393ed8799ffe9f7285f4a436d8a32efc38747f5ba8 WatchSource:0}: Error finding container f45d21465cbcd45444c0ff393ed8799ffe9f7285f4a436d8a32efc38747f5ba8: Status 404 returned error can't find the container with id f45d21465cbcd45444c0ff393ed8799ffe9f7285f4a436d8a32efc38747f5ba8 Jul 28 13:45:04.844157 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:04.844123 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbdb444bf-6mgz7" event={"ID":"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be","Type":"ContainerStarted","Data":"f45d21465cbcd45444c0ff393ed8799ffe9f7285f4a436d8a32efc38747f5ba8"} Jul 28 13:45:05.331621 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.331374 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" podUID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" containerName="registry" containerID="cri-o://b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9" gracePeriod=30 Jul 28 13:45:05.617310 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.617280 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:45:05.735331 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735290 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-installation-pull-secrets\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735558 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735380 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-ca-trust-extracted\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735558 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735407 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-certificates\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735558 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735432 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-bound-sa-token\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735558 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735489 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-image-registry-private-configuration\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735856 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735566 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zclwh\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-kube-api-access-zclwh\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735856 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735610 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-trusted-ca\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.735856 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.735636 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") pod \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\" (UID: \"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c\") " Jul 28 13:45:05.736060 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.736029 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:45:05.736522 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.736482 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:45:05.740233 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.740203 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:05.740513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.740480 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:45:05.741036 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.740991 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-kube-api-access-zclwh" (OuterVolumeSpecName: "kube-api-access-zclwh") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "kube-api-access-zclwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:45:05.741489 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.741452 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:45:05.741644 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.741603 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:45:05.746930 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.746903 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" (UID: "aeef0b49-5ac5-4f46-b0c3-4d399c281f1c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 13:45:05.837124 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837077 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-image-registry-private-configuration\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837124 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837117 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zclwh\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-kube-api-access-zclwh\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837124 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837133 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-trusted-ca\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837146 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837160 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-installation-pull-secrets\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837173 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-ca-trust-extracted\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837197 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-registry-certificates\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.837461 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.837213 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c-bound-sa-token\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:45:05.850342 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.850306 2572 generic.go:356] "Generic (PLEG): container finished" podID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" containerID="b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9" exitCode=0 Jul 28 13:45:05.850784 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.850366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" event={"ID":"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c","Type":"ContainerDied","Data":"b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9"} Jul 28 13:45:05.850784 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.850412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" event={"ID":"aeef0b49-5ac5-4f46-b0c3-4d399c281f1c","Type":"ContainerDied","Data":"b7ae4cc700191d4feb38cc96fb8691fad0da3bb094f56b2100ec4d37bb02556e"} Jul 28 13:45:05.850784 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.850424 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b7f7cb9c-z42h6" Jul 28 13:45:05.850784 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.850454 2572 scope.go:117] "RemoveContainer" containerID="b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9" Jul 28 13:45:05.861301 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.861207 2572 scope.go:117] "RemoveContainer" containerID="b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9" Jul 28 13:45:05.861915 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:45:05.861880 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9\": container with ID starting with b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9 not found: ID does not exist" containerID="b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9" Jul 28 13:45:05.862005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.861924 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9"} err="failed to get container status \"b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9\": rpc error: code = NotFound desc = could not find container \"b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9\": container with ID starting with b1ef09dacff8e4e881c19abb24e66cc6980d79192d235d30f6a4cfa57fd8e9c9 not found: ID does not exist" Jul 28 13:45:05.878390 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.878359 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54b7f7cb9c-z42h6"] Jul 28 13:45:05.885485 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:05.885462 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54b7f7cb9c-z42h6"] Jul 28 13:45:07.120799 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:07.120765 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" path="/var/lib/kubelet/pods/aeef0b49-5ac5-4f46-b0c3-4d399c281f1c/volumes" Jul 28 13:45:07.860476 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:07.860386 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbdb444bf-6mgz7" event={"ID":"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be","Type":"ContainerStarted","Data":"5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184"} Jul 28 13:45:07.885127 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:07.885073 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbdb444bf-6mgz7" podStartSLOduration=1.772919535 podStartE2EDuration="4.885058602s" totalImagesPullingTime="3.112139067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:45:07.884873048 +0000 UTC m=+161.337263588" watchObservedRunningTime="2026-07-28 13:45:07.885058602 +0000 UTC m=+161.337449143" Jul 28 13:45:11.037791 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:11.037759 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:11.209953 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:11.209912 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:14.288279 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:14.288246 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:14.288708 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:14.288308 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:14.293027 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:14.293006 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:14.890366 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:14.890339 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:45:15.122364 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:15.122326 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:15.694468 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:15.694429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:15.817719 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:15.817685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:17.894702 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:17.894671 2572 generic.go:356] "Generic (PLEG): container finished" podID="e4217eae-66e3-4276-9cef-f0c99a377bf5" containerID="b7d6ab98b6ea43bf3db84caf2b1cb4b2cab42e0ecb518db555c60b02566c9495" exitCode=0 Jul 28 13:45:17.895109 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:17.894748 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6pngg" event={"ID":"e4217eae-66e3-4276-9cef-f0c99a377bf5","Type":"ContainerDied","Data":"b7d6ab98b6ea43bf3db84caf2b1cb4b2cab42e0ecb518db555c60b02566c9495"} Jul 28 13:45:17.895109 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:17.895077 2572 scope.go:117] "RemoveContainer" containerID="b7d6ab98b6ea43bf3db84caf2b1cb4b2cab42e0ecb518db555c60b02566c9495" Jul 28 13:45:18.899160 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:18.899126 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6pngg" event={"ID":"e4217eae-66e3-4276-9cef-f0c99a377bf5","Type":"ContainerStarted","Data":"b981c66ea703094a8bf0a1c137bac96c8b66d9fd225b154504cb108d4e045f4f"} Jul 28 13:45:29.822191 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:29.822153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:29.958755 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:29.958720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:56.433242 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:56.433204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:45:56.644730 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:45:56.644692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:07.875143 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.875107 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cbb5c7958-hhf4v"] Jul 28 13:46:07.875570 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.875367 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" containerName="registry" Jul 28 13:46:07.875570 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.875379 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" containerName="registry" Jul 28 13:46:07.875570 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.875430 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeef0b49-5ac5-4f46-b0c3-4d399c281f1c" containerName="registry" Jul 28 13:46:07.878381 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.878366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.922350 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.922321 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbb5c7958-hhf4v"] Jul 28 13:46:07.973651 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-console-config\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.973651 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-serving-cert\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.973857 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-trusted-ca-bundle\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.973857 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xzjg\" (UniqueName: \"kubernetes.io/projected/45ae4562-b17d-492a-81cb-e925545cd01a-kube-api-access-4xzjg\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.973857 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-oauth-config\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.973857 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-service-ca\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:07.973857 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:07.973853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-oauth-serving-cert\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075090 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-service-ca\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075090 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-oauth-serving-cert\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-console-config\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-serving-cert\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-trusted-ca-bundle\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075181 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xzjg\" (UniqueName: \"kubernetes.io/projected/45ae4562-b17d-492a-81cb-e925545cd01a-kube-api-access-4xzjg\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075323 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075210 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-oauth-config\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.075879 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075854 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-service-ca\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.076005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075949 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-console-config\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.076005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.075924 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-oauth-serving-cert\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.076275 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.076255 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-trusted-ca-bundle\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.077620 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.077599 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-serving-cert\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.077742 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.077726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-oauth-config\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.087446 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.087421 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xzjg\" (UniqueName: \"kubernetes.io/projected/45ae4562-b17d-492a-81cb-e925545cd01a-kube-api-access-4xzjg\") pod \"console-cbb5c7958-hhf4v\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.094196 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.094175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:08.186716 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.186628 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:08.352682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:08.352650 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbb5c7958-hhf4v"] Jul 28 13:46:08.358470 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:46:08.357641 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ae4562_b17d_492a_81cb_e925545cd01a.slice/crio-ba111266e10187be0bae1af81e62a96e19361452a35a076c62e369c5df5f1c38 WatchSource:0}: Error finding container ba111266e10187be0bae1af81e62a96e19361452a35a076c62e369c5df5f1c38: Status 404 returned error can't find the container with id ba111266e10187be0bae1af81e62a96e19361452a35a076c62e369c5df5f1c38 Jul 28 13:46:09.072431 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:09.072393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbb5c7958-hhf4v" event={"ID":"45ae4562-b17d-492a-81cb-e925545cd01a","Type":"ContainerStarted","Data":"97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61"} Jul 28 13:46:09.072849 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:09.072442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbb5c7958-hhf4v" event={"ID":"45ae4562-b17d-492a-81cb-e925545cd01a","Type":"ContainerStarted","Data":"ba111266e10187be0bae1af81e62a96e19361452a35a076c62e369c5df5f1c38"} Jul 28 13:46:09.102757 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:09.102700 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cbb5c7958-hhf4v" podStartSLOduration=2.102683293 podStartE2EDuration="2.102683293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:09.101511897 +0000 UTC m=+222.553902451" watchObservedRunningTime="2026-07-28 13:46:09.102683293 +0000 UTC m=+222.555073835" Jul 28 13:46:18.187712 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:18.187665 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:18.188205 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:18.187731 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:18.192400 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:18.192377 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:19.112614 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:19.112583 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:46:19.174024 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:19.173992 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbdb444bf-6mgz7"] Jul 28 13:46:19.493686 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:19.493652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:19.566504 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:19.566470 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:22.396618 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:22.396580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:40.190011 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:40.189953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:44.193477 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.193440 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbdb444bf-6mgz7" podUID="d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" containerName="console" containerID="cri-o://5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184" gracePeriod=15 Jul 28 13:46:44.436069 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.436042 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:46:44.540473 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540441 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-trusted-ca-bundle\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.540700 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540489 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lpjx\" (UniqueName: \"kubernetes.io/projected/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-kube-api-access-5lpjx\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.540700 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-oauth-config\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.540700 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540562 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-serving-cert\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.540700 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540592 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-oauth-serving-cert\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.540700 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540633 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-service-ca\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.540700 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.540664 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-config\") pod \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\" (UID: \"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be\") " Jul 28 13:46:44.541070 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.541018 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:44.541070 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.541045 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:44.541178 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.541080 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:44.541178 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.541148 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-config" (OuterVolumeSpecName: "console-config") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:46:44.542883 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.542845 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:44.543005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.542941 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-kube-api-access-5lpjx" (OuterVolumeSpecName: "kube-api-access-5lpjx") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "kube-api-access-5lpjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:46:44.543005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.542948 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" (UID: "d8c81e3d-741a-4ab0-bdc2-e22ae40da9be"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:46:44.641889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641856 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lpjx\" (UniqueName: \"kubernetes.io/projected/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-kube-api-access-5lpjx\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:44.641889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641882 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-oauth-config\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:44.641889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641893 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-serving-cert\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:44.642118 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641901 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-oauth-serving-cert\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:44.642118 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641911 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-service-ca\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:44.642118 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641920 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-console-config\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:44.642118 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:44.641929 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be-trusted-ca-bundle\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:46:45.193611 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.193575 2572 generic.go:356] "Generic (PLEG): container finished" podID="d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" containerID="5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184" exitCode=0 Jul 28 13:46:45.193986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.193620 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbdb444bf-6mgz7" Jul 28 13:46:45.193986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.193656 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbdb444bf-6mgz7" event={"ID":"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be","Type":"ContainerDied","Data":"5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184"} Jul 28 13:46:45.193986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.193701 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbdb444bf-6mgz7" event={"ID":"d8c81e3d-741a-4ab0-bdc2-e22ae40da9be","Type":"ContainerDied","Data":"f45d21465cbcd45444c0ff393ed8799ffe9f7285f4a436d8a32efc38747f5ba8"} Jul 28 13:46:45.193986 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.193723 2572 scope.go:117] "RemoveContainer" containerID="5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184" Jul 28 13:46:45.201165 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.201151 2572 scope.go:117] "RemoveContainer" containerID="5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184" Jul 28 13:46:45.201408 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:46:45.201388 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184\": container with ID starting with 5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184 not found: ID does not exist" containerID="5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184" Jul 28 13:46:45.201469 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.201419 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184"} err="failed to get container status \"5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184\": rpc error: code = NotFound desc = could not find container \"5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184\": container with ID starting with 5d0c7338a0adfbbbb4a144d47e610517a01cf5b2c89551eafdd3b90c6fe27184 not found: ID does not exist" Jul 28 13:46:45.213731 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.213708 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbdb444bf-6mgz7"] Jul 28 13:46:45.217268 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:45.217247 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbdb444bf-6mgz7"] Jul 28 13:46:47.121104 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:47.121064 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" path="/var/lib/kubelet/pods/d8c81e3d-741a-4ab0-bdc2-e22ae40da9be/volumes" Jul 28 13:46:48.837512 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:48.837477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:46:48.909662 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:46:48.909620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:11.778509 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:11.778475 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:11.863651 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:11.863606 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:20.148471 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.148437 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7786dcb764-5lmpg"] Jul 28 13:47:20.148889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.148691 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" containerName="console" Jul 28 13:47:20.148889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.148703 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" containerName="console" Jul 28 13:47:20.148889 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.148751 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8c81e3d-741a-4ab0-bdc2-e22ae40da9be" containerName="console" Jul 28 13:47:20.151455 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.151438 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.166435 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.166408 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7786dcb764-5lmpg"] Jul 28 13:47:20.182596 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-oauth-serving-cert\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.182722 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-trusted-ca-bundle\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.182722 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-service-ca\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.182722 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875ms\" (UniqueName: \"kubernetes.io/projected/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-kube-api-access-875ms\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.182722 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-oauth-config\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.182863 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-config\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.182863 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.182836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-serving-cert\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.221936 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.221886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:20.284005 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.283969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-serving-cert\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.284185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-oauth-serving-cert\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.284185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-trusted-ca-bundle\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.284185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-service-ca\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.284185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-875ms\" (UniqueName: \"kubernetes.io/projected/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-kube-api-access-875ms\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.284185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-oauth-config\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.284185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-config\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.285018 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284991 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-oauth-serving-cert\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.285153 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.284991 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-service-ca\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.285153 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.285043 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-config\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.285153 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.285143 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-trusted-ca-bundle\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.286609 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.286592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-serving-cert\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.286661 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.286618 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-oauth-config\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.292901 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.292882 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-875ms\" (UniqueName: \"kubernetes.io/projected/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-kube-api-access-875ms\") pod \"console-7786dcb764-5lmpg\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.318463 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.318437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:20.420020 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.419925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:20.459960 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.459929 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:20.595566 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.595433 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7786dcb764-5lmpg"] Jul 28 13:47:20.598270 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:47:20.598244 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0902c1a7_8254_4efe_a5f1_ecf2e4903cef.slice/crio-c0183ac113655e100dab67085064775ab8b2a86f20bce54c34fe87c7261e3787 WatchSource:0}: Error finding container c0183ac113655e100dab67085064775ab8b2a86f20bce54c34fe87c7261e3787: Status 404 returned error can't find the container with id c0183ac113655e100dab67085064775ab8b2a86f20bce54c34fe87c7261e3787 Jul 28 13:47:20.974181 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:20.974151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:21.047404 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:21.047375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:21.312788 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:21.312698 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786dcb764-5lmpg" event={"ID":"0902c1a7-8254-4efe-a5f1-ecf2e4903cef","Type":"ContainerStarted","Data":"3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88"} Jul 28 13:47:21.312788 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:21.312749 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786dcb764-5lmpg" event={"ID":"0902c1a7-8254-4efe-a5f1-ecf2e4903cef","Type":"ContainerStarted","Data":"c0183ac113655e100dab67085064775ab8b2a86f20bce54c34fe87c7261e3787"} Jul 28 13:47:21.344338 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:21.344278 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7786dcb764-5lmpg" podStartSLOduration=1.344261211 podStartE2EDuration="1.344261211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:47:21.344116115 +0000 UTC m=+294.796506655" watchObservedRunningTime="2026-07-28 13:47:21.344261211 +0000 UTC m=+294.796651752" Jul 28 13:47:23.730896 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:23.730858 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:24.236802 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:24.236766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:26.975188 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:26.975157 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 13:47:29.683556 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:29.683508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:29.866289 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:29.866249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:30.460891 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:30.460838 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:30.461093 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:30.460991 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:30.465595 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:30.465575 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:31.350123 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:31.350095 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:47:31.417837 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:31.417808 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cbb5c7958-hhf4v"] Jul 28 13:47:31.554900 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:31.554871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:31.666368 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:31.666284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:31.753665 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:31.753633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:49.250001 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:49.249966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:51.805720 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:51.805687 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:47:56.436320 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.436263 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cbb5c7958-hhf4v" podUID="45ae4562-b17d-492a-81cb-e925545cd01a" containerName="console" containerID="cri-o://97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61" gracePeriod=15 Jul 28 13:47:56.681022 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.680998 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:47:56.770495 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770463 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xzjg\" (UniqueName: \"kubernetes.io/projected/45ae4562-b17d-492a-81cb-e925545cd01a-kube-api-access-4xzjg\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.770717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770503 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-trusted-ca-bundle\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.770717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770569 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-oauth-config\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.770717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770592 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-serving-cert\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.770717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770613 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-service-ca\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.770717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770631 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-console-config\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.770717 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.770653 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-oauth-serving-cert\") pod \"45ae4562-b17d-492a-81cb-e925545cd01a\" (UID: \"45ae4562-b17d-492a-81cb-e925545cd01a\") " Jul 28 13:47:56.771117 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.771076 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-console-config" (OuterVolumeSpecName: "console-config") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:47:56.771117 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.771084 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-service-ca" (OuterVolumeSpecName: "service-ca") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:47:56.771117 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.771111 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:47:56.771287 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.771089 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:47:56.772748 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.772719 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:47:56.772864 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.772821 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ae4562-b17d-492a-81cb-e925545cd01a-kube-api-access-4xzjg" (OuterVolumeSpecName: "kube-api-access-4xzjg") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "kube-api-access-4xzjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:47:56.772909 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.772878 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45ae4562-b17d-492a-81cb-e925545cd01a" (UID: "45ae4562-b17d-492a-81cb-e925545cd01a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:47:56.871396 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871361 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-oauth-config\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.871396 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871388 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ae4562-b17d-492a-81cb-e925545cd01a-console-serving-cert\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.871396 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871399 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-service-ca\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.871635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871407 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-console-config\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.871635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871416 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-oauth-serving-cert\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.871635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871425 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xzjg\" (UniqueName: \"kubernetes.io/projected/45ae4562-b17d-492a-81cb-e925545cd01a-kube-api-access-4xzjg\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:56.871635 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:56.871434 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45ae4562-b17d-492a-81cb-e925545cd01a-trusted-ca-bundle\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:47:57.443870 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.443772 2572 generic.go:356] "Generic (PLEG): container finished" podID="45ae4562-b17d-492a-81cb-e925545cd01a" containerID="97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61" exitCode=0 Jul 28 13:47:57.443870 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.443824 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbb5c7958-hhf4v" Jul 28 13:47:57.444359 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.443867 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbb5c7958-hhf4v" event={"ID":"45ae4562-b17d-492a-81cb-e925545cd01a","Type":"ContainerDied","Data":"97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61"} Jul 28 13:47:57.444359 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.443919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbb5c7958-hhf4v" event={"ID":"45ae4562-b17d-492a-81cb-e925545cd01a","Type":"ContainerDied","Data":"ba111266e10187be0bae1af81e62a96e19361452a35a076c62e369c5df5f1c38"} Jul 28 13:47:57.444359 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.443939 2572 scope.go:117] "RemoveContainer" containerID="97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61" Jul 28 13:47:57.451667 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.451610 2572 scope.go:117] "RemoveContainer" containerID="97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61" Jul 28 13:47:57.451895 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:47:57.451874 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61\": container with ID starting with 97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61 not found: ID does not exist" containerID="97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61" Jul 28 13:47:57.451989 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.451902 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61"} err="failed to get container status \"97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61\": rpc error: code = NotFound desc = could not find container \"97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61\": container with ID starting with 97442ab25a01a24d2bfcf01f42c4ebee38a6e9c94b50363bf81cc8e88a20ac61 not found: ID does not exist" Jul 28 13:47:57.463054 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.463033 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cbb5c7958-hhf4v"] Jul 28 13:47:57.470214 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:57.470192 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cbb5c7958-hhf4v"] Jul 28 13:47:59.120602 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:47:59.120572 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45ae4562-b17d-492a-81cb-e925545cd01a" path="/var/lib/kubelet/pods/45ae4562-b17d-492a-81cb-e925545cd01a/volumes" Jul 28 13:48:25.875855 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:48:25.875775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:48:28.877754 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:48:28.877715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:04.098619 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.098586 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:04.184078 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.184041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:04.944300 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.944267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:04.944507 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.944488 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t"] Jul 28 13:50:04.944763 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.944749 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45ae4562-b17d-492a-81cb-e925545cd01a" containerName="console" Jul 28 13:50:04.944805 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.944765 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="45ae4562-b17d-492a-81cb-e925545cd01a" containerName="console" Jul 28 13:50:04.944838 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.944816 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="45ae4562-b17d-492a-81cb-e925545cd01a" containerName="console" Jul 28 13:50:04.947529 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.947509 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:04.950485 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.950469 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-lqttk\"" Jul 28 13:50:04.951511 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.951492 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 28 13:50:04.951632 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.951553 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 28 13:50:04.967832 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:04.967804 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t"] Jul 28 13:50:05.091330 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.091294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwvc\" (UniqueName: \"kubernetes.io/projected/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a-kube-api-access-8pwvc\") pod \"feast-operator-controller-manager-688d9fd4c8-c629t\" (UID: \"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a\") " pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:05.192593 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.192564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwvc\" (UniqueName: \"kubernetes.io/projected/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a-kube-api-access-8pwvc\") pod \"feast-operator-controller-manager-688d9fd4c8-c629t\" (UID: \"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a\") " pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:05.201667 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.201600 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwvc\" (UniqueName: \"kubernetes.io/projected/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a-kube-api-access-8pwvc\") pod \"feast-operator-controller-manager-688d9fd4c8-c629t\" (UID: \"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a\") " pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:05.256990 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.256946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:05.386803 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.386067 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t"] Jul 28 13:50:05.392443 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:50:05.392417 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3b09e6_1d36_48cb_9feb_e7c38ba3a70a.slice/crio-809a4f879d50bb76e4f001218347ac7f43f561c4110b4433b532069a9bc69f70 WatchSource:0}: Error finding container 809a4f879d50bb76e4f001218347ac7f43f561c4110b4433b532069a9bc69f70: Status 404 returned error can't find the container with id 809a4f879d50bb76e4f001218347ac7f43f561c4110b4433b532069a9bc69f70 Jul 28 13:50:05.394696 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.394679 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:50:05.869101 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:05.869066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" event={"ID":"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a","Type":"ContainerStarted","Data":"809a4f879d50bb76e4f001218347ac7f43f561c4110b4433b532069a9bc69f70"} Jul 28 13:50:08.880820 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:08.880779 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" event={"ID":"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a","Type":"ContainerStarted","Data":"a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f"} Jul 28 13:50:08.881208 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:08.880905 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:08.916043 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:08.915987 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" podStartSLOduration=2.473786526 podStartE2EDuration="4.91597014s" totalImagesPullingTime="2.442183614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:50:08.914691236 +0000 UTC m=+462.367081778" watchObservedRunningTime="2026-07-28 13:50:08.91597014 +0000 UTC m=+462.368360673" Jul 28 13:50:19.887145 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:19.887112 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 13:50:22.261559 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:22.261511 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:22.359770 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:22.359736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:44.320108 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:44.320073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:44.415434 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:44.415375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:44.686449 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:44.686378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:44.783512 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:44.783484 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:44.988983 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:44.988954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:45.087165 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:45.087132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:50:45.187609 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:50:45.187582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:10.346706 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.346673 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d584bcbd5-8hqmr"] Jul 28 13:51:10.349749 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.349730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.363651 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.363624 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d584bcbd5-8hqmr"] Jul 28 13:51:10.414727 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.414690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:10.453486 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-config\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.453680 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v654n\" (UniqueName: \"kubernetes.io/projected/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-kube-api-access-v654n\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.453680 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-oauth-config\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.453680 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-trusted-ca-bundle\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.453680 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-serving-cert\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.453680 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-service-ca\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.453884 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.453708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-oauth-serving-cert\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.492609 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.492572 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:10.555017 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.554980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-oauth-config\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555017 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-trusted-ca-bundle\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555233 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-serving-cert\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555233 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-service-ca\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555233 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-oauth-serving-cert\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555233 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-config\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555233 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v654n\" (UniqueName: \"kubernetes.io/projected/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-kube-api-access-v654n\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555996 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555970 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-trusted-ca-bundle\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.555996 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.555981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-service-ca\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.556205 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.556014 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-oauth-serving-cert\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.556205 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.556154 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-config\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.557682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.557653 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-oauth-config\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.557785 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.557705 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-console-serving-cert\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.566921 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.566900 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v654n\" (UniqueName: \"kubernetes.io/projected/0fe4a57e-bdb9-4527-b315-18c907ccb4b5-kube-api-access-v654n\") pod \"console-7d584bcbd5-8hqmr\" (UID: \"0fe4a57e-bdb9-4527-b315-18c907ccb4b5\") " pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.658905 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.658817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:10.793086 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:10.793055 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d584bcbd5-8hqmr"] Jul 28 13:51:10.796230 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:51:10.796202 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe4a57e_bdb9_4527_b315_18c907ccb4b5.slice/crio-90ded1b804b09c60f13c84cfdb823ec8e659cd0f27af132cbf2cc0f69b23f04d WatchSource:0}: Error finding container 90ded1b804b09c60f13c84cfdb823ec8e659cd0f27af132cbf2cc0f69b23f04d: Status 404 returned error can't find the container with id 90ded1b804b09c60f13c84cfdb823ec8e659cd0f27af132cbf2cc0f69b23f04d Jul 28 13:51:11.087119 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:11.087079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d584bcbd5-8hqmr" event={"ID":"0fe4a57e-bdb9-4527-b315-18c907ccb4b5","Type":"ContainerStarted","Data":"2dbe051dc9997e2e6db1de50015fdfeefe93207590ea96d63109eddbe57a9a49"} Jul 28 13:51:11.087291 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:11.087131 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d584bcbd5-8hqmr" event={"ID":"0fe4a57e-bdb9-4527-b315-18c907ccb4b5","Type":"ContainerStarted","Data":"90ded1b804b09c60f13c84cfdb823ec8e659cd0f27af132cbf2cc0f69b23f04d"} Jul 28 13:51:11.110985 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:11.110936 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d584bcbd5-8hqmr" podStartSLOduration=1.110914512 podStartE2EDuration="1.110914512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:51:11.109745643 +0000 UTC m=+524.562136185" watchObservedRunningTime="2026-07-28 13:51:11.110914512 +0000 UTC m=+524.563305118" Jul 28 13:51:20.659057 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:20.658978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:20.659057 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:20.659033 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:20.663623 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:20.663598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:21.123219 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:21.123188 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d584bcbd5-8hqmr" Jul 28 13:51:21.210547 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:21.210503 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7786dcb764-5lmpg"] Jul 28 13:51:21.514330 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:21.514290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:21.695004 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:21.694969 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:31.452892 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:31.452861 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:40.124693 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:40.124657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:51:46.229416 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.229370 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7786dcb764-5lmpg" podUID="0902c1a7-8254-4efe-a5f1-ecf2e4903cef" containerName="console" containerID="cri-o://3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88" gracePeriod=15 Jul 28 13:51:46.473951 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.473927 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:51:46.628598 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-oauth-config\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.628598 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628560 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-trusted-ca-bundle\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.628598 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628590 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-serving-cert\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.628865 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628622 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-config\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.628865 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628657 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-service-ca\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.628865 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628696 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-oauth-serving-cert\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.628865 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.628760 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-875ms\" (UniqueName: \"kubernetes.io/projected/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-kube-api-access-875ms\") pod \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\" (UID: \"0902c1a7-8254-4efe-a5f1-ecf2e4903cef\") " Jul 28 13:51:46.629109 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.629078 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:46.629109 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.629095 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-service-ca" (OuterVolumeSpecName: "service-ca") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:46.629259 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.629089 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-config" (OuterVolumeSpecName: "console-config") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:46.629259 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.629124 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 13:51:46.630823 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.630801 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:51:46.630925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.630847 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 13:51:46.630925 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.630903 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-kube-api-access-875ms" (OuterVolumeSpecName: "kube-api-access-875ms") pod "0902c1a7-8254-4efe-a5f1-ecf2e4903cef" (UID: "0902c1a7-8254-4efe-a5f1-ecf2e4903cef"). InnerVolumeSpecName "kube-api-access-875ms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:51:46.730067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730030 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-oauth-config\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:46.730067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730059 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-trusted-ca-bundle\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:46.730067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730068 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-serving-cert\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:46.730067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730076 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-console-config\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:46.730325 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730084 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-service-ca\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:46.730325 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730092 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-oauth-serving-cert\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:46.730325 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:46.730100 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-875ms\" (UniqueName: \"kubernetes.io/projected/0902c1a7-8254-4efe-a5f1-ecf2e4903cef-kube-api-access-875ms\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:51:47.204432 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.204396 2572 generic.go:356] "Generic (PLEG): container finished" podID="0902c1a7-8254-4efe-a5f1-ecf2e4903cef" containerID="3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88" exitCode=0 Jul 28 13:51:47.204650 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.204446 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7786dcb764-5lmpg" Jul 28 13:51:47.204650 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.204481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786dcb764-5lmpg" event={"ID":"0902c1a7-8254-4efe-a5f1-ecf2e4903cef","Type":"ContainerDied","Data":"3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88"} Jul 28 13:51:47.204650 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.204545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7786dcb764-5lmpg" event={"ID":"0902c1a7-8254-4efe-a5f1-ecf2e4903cef","Type":"ContainerDied","Data":"c0183ac113655e100dab67085064775ab8b2a86f20bce54c34fe87c7261e3787"} Jul 28 13:51:47.204650 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.204569 2572 scope.go:117] "RemoveContainer" containerID="3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88" Jul 28 13:51:47.213338 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.213321 2572 scope.go:117] "RemoveContainer" containerID="3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88" Jul 28 13:51:47.213624 ip-10-0-136-179 kubenswrapper[2572]: E0728 13:51:47.213605 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88\": container with ID starting with 3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88 not found: ID does not exist" containerID="3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88" Jul 28 13:51:47.213690 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.213637 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88"} err="failed to get container status \"3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88\": rpc error: code = NotFound desc = could not find container \"3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88\": container with ID starting with 3c726a0ce81ac745072c281c51ececc37b534786ca1b92a29c4ac397fed79a88 not found: ID does not exist" Jul 28 13:51:47.226768 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.226742 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7786dcb764-5lmpg"] Jul 28 13:51:47.233185 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:47.233165 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7786dcb764-5lmpg"] Jul 28 13:51:49.120201 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:51:49.120167 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0902c1a7-8254-4efe-a5f1-ecf2e4903cef" path="/var/lib/kubelet/pods/0902c1a7-8254-4efe-a5f1-ecf2e4903cef/volumes" Jul 28 13:52:32.263998 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.263949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:32.360809 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.360757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:32.460314 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.460286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:32.567121 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.567037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:32.712437 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.712404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:32.820066 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.819984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:32.951190 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:32.951161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:52:51.529369 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:52:51.529284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:53:54.044452 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:53:54.044414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:53:55.582383 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:53:55.582348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:54:13.838573 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:54:13.838523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:00.480410 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:00.480376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:11.990403 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:11.990362 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:15.684117 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:15.684080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:15.865140 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:15.865103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:15.962514 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:15.962433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:20.979194 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:20.979159 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:34.530708 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:34.530668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:58.501202 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:58.501163 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:58.777228 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:58.777154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:55:58.880339 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:55:58.880306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:56:09.310672 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:09.310634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:56:09.447332 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:09.447295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:56:09.716248 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:09.716215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:56:09.815846 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:09.815809 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:56:34.135621 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:34.135587 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:56:53.645675 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.645641 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-fcllk"] Jul 28 13:56:53.646358 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.645898 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0902c1a7-8254-4efe-a5f1-ecf2e4903cef" containerName="console" Jul 28 13:56:53.646358 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.645910 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0902c1a7-8254-4efe-a5f1-ecf2e4903cef" containerName="console" Jul 28 13:56:53.646358 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.645947 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0902c1a7-8254-4efe-a5f1-ecf2e4903cef" containerName="console" Jul 28 13:56:53.648780 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.648764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:56:53.651563 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.651525 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 13:56:53.651699 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.651603 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-w8m9k\"" Jul 28 13:56:53.651699 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.651660 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 13:56:53.651699 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.651608 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 28 13:56:53.656682 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.656658 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-fcllk"] Jul 28 13:56:53.795523 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.795486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2vtw\" (UniqueName: \"kubernetes.io/projected/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67-kube-api-access-t2vtw\") pod \"feast-test-apply-fcllk\" (UID: \"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67\") " pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:56:53.896934 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.896873 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2vtw\" (UniqueName: \"kubernetes.io/projected/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67-kube-api-access-t2vtw\") pod \"feast-test-apply-fcllk\" (UID: \"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67\") " pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:56:53.906989 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.906956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2vtw\" (UniqueName: \"kubernetes.io/projected/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67-kube-api-access-t2vtw\") pod \"feast-test-apply-fcllk\" (UID: \"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67\") " pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:56:53.957913 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:53.957884 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:56:54.081940 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:54.081915 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-fcllk"] Jul 28 13:56:54.084470 ip-10-0-136-179 kubenswrapper[2572]: W0728 13:56:54.084441 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cc8a4c3_b4a1_423b_8897_9bf4a0bf8d67.slice/crio-0456e23cc288263b7c3e11136a8e32b2ec70219c418102e14f493c853892fec3 WatchSource:0}: Error finding container 0456e23cc288263b7c3e11136a8e32b2ec70219c418102e14f493c853892fec3: Status 404 returned error can't find the container with id 0456e23cc288263b7c3e11136a8e32b2ec70219c418102e14f493c853892fec3 Jul 28 13:56:54.086734 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:54.086714 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 13:56:54.224319 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:54.224289 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fcllk" event={"ID":"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67","Type":"ContainerStarted","Data":"0456e23cc288263b7c3e11136a8e32b2ec70219c418102e14f493c853892fec3"} Jul 28 13:56:59.244470 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:56:59.244434 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fcllk" event={"ID":"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67","Type":"ContainerStarted","Data":"c6c497d3f8b5ab08c1c2d76c75d8ac00d1efc2a3bd4e6fa25c4afd992508fda2"} Jul 28 13:57:06.270007 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:06.269967 2572 generic.go:356] "Generic (PLEG): container finished" podID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerID="c6c497d3f8b5ab08c1c2d76c75d8ac00d1efc2a3bd4e6fa25c4afd992508fda2" exitCode=0 Jul 28 13:57:06.270397 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:06.270018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fcllk" event={"ID":"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67","Type":"ContainerDied","Data":"c6c497d3f8b5ab08c1c2d76c75d8ac00d1efc2a3bd4e6fa25c4afd992508fda2"} Jul 28 13:57:07.274310 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:07.274275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fcllk" event={"ID":"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67","Type":"ContainerStarted","Data":"90fbd4b3631ded485d9dbd72fb1f88f96ed53fcb549781129a2ada20b4c6bac4"} Jul 28 13:57:07.292166 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:07.292114 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-fcllk" podStartSLOduration=3.150036678 podStartE2EDuration="14.292099416s" totalImagesPullingTime="4.56425955s" totalInitContainerRuntime="6.577803188s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:57:07.291652922 +0000 UTC m=+880.744043464" watchObservedRunningTime="2026-07-28 13:57:07.292099416 +0000 UTC m=+880.744489957" Jul 28 13:57:16.306491 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:16.306410 2572 generic.go:356] "Generic (PLEG): container finished" podID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerID="90fbd4b3631ded485d9dbd72fb1f88f96ed53fcb549781129a2ada20b4c6bac4" exitCode=0 Jul 28 13:57:16.306491 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:16.306466 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fcllk" event={"ID":"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67","Type":"ContainerDied","Data":"90fbd4b3631ded485d9dbd72fb1f88f96ed53fcb549781129a2ada20b4c6bac4"} Jul 28 13:57:17.432606 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:17.432585 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:57:17.575140 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:17.575063 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2vtw\" (UniqueName: \"kubernetes.io/projected/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67-kube-api-access-t2vtw\") pod \"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67\" (UID: \"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67\") " Jul 28 13:57:17.577284 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:17.577255 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67-kube-api-access-t2vtw" (OuterVolumeSpecName: "kube-api-access-t2vtw") pod "3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" (UID: "3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67"). InnerVolumeSpecName "kube-api-access-t2vtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 13:57:17.676067 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:17.676038 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2vtw\" (UniqueName: \"kubernetes.io/projected/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67-kube-api-access-t2vtw\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 13:57:18.314573 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:18.314546 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fcllk" Jul 28 13:57:18.314711 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:18.314551 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fcllk" event={"ID":"3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67","Type":"ContainerDied","Data":"0456e23cc288263b7c3e11136a8e32b2ec70219c418102e14f493c853892fec3"} Jul 28 13:57:18.314711 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:18.314657 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0456e23cc288263b7c3e11136a8e32b2ec70219c418102e14f493c853892fec3" Jul 28 13:57:18.520125 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:18.520095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-fcllk_3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67/feast-0/0.log" Jul 28 13:57:18.527643 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:18.527620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-fcllk_3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67/feast-1/0.log" Jul 28 13:57:52.851785 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:52.851740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:57:57.828213 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:57.828178 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-fcllk"] Jul 28 13:57:57.838164 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:57.838133 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-fcllk"] Jul 28 13:57:57.910076 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:57.910044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:57:59.120045 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:57:59.120011 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" path="/var/lib/kubelet/pods/3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67/volumes" Jul 28 13:58:35.398789 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:35.398734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:35.499140 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:35.499104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:35.722513 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:35.722481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:35.777727 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:35.777699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:35.845585 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:35.845552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:35.975886 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:35.975793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:36.074718 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:36.074690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:36.238421 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:36.238322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:58:36.338808 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:58:36.338776 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 13:59:35.965921 ip-10-0-136-179 kubenswrapper[2572]: I0728 13:59:35.965856 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:01:48.119370 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:01:48.119315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:01:48.173930 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:01:48.173893 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:22.891383 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:22.891347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:22.991931 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:22.991897 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:23.403418 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:23.403374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:29.103139 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:29.103107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:34.345647 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:34.345610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:34.420331 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:34.420293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:34.691330 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:34.691249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:34.790510 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:34.790479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:02:57.039054 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:02:57.039006 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:03:00.252847 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:03:00.252808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:03:00.362794 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:03:00.362762 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:03:00.459726 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:03:00.459695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:03:02.839321 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:03:02.839266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:03:27.067618 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:03:27.067530 2572 scope.go:117] "RemoveContainer" containerID="90fbd4b3631ded485d9dbd72fb1f88f96ed53fcb549781129a2ada20b4c6bac4" Jul 28 14:03:27.074713 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:03:27.074695 2572 scope.go:117] "RemoveContainer" containerID="c6c497d3f8b5ab08c1c2d76c75d8ac00d1efc2a3bd4e6fa25c4afd992508fda2" Jul 28 14:04:43.734100 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:43.734071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:46.036884 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.036848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:46.446480 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.446387 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t"] Jul 28 14:04:46.446675 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.446631 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" podUID="7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" containerName="manager" containerID="cri-o://a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f" gracePeriod=10 Jul 28 14:04:46.469121 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.469096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:46.692075 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.692052 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 14:04:46.781379 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.781346 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pwvc\" (UniqueName: \"kubernetes.io/projected/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a-kube-api-access-8pwvc\") pod \"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a\" (UID: \"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a\") " Jul 28 14:04:46.786596 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.786567 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a-kube-api-access-8pwvc" (OuterVolumeSpecName: "kube-api-access-8pwvc") pod "7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" (UID: "7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a"). InnerVolumeSpecName "kube-api-access-8pwvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:04:46.807315 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.807284 2572 generic.go:356] "Generic (PLEG): container finished" podID="7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" containerID="a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f" exitCode=0 Jul 28 14:04:46.807481 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.807325 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" Jul 28 14:04:46.807481 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.807358 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" event={"ID":"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a","Type":"ContainerDied","Data":"a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f"} Jul 28 14:04:46.807481 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.807409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t" event={"ID":"7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a","Type":"ContainerDied","Data":"809a4f879d50bb76e4f001218347ac7f43f561c4110b4433b532069a9bc69f70"} Jul 28 14:04:46.807481 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.807440 2572 scope.go:117] "RemoveContainer" containerID="a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f" Jul 28 14:04:46.815738 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.815719 2572 scope.go:117] "RemoveContainer" containerID="a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f" Jul 28 14:04:46.816016 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:04:46.815993 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f\": container with ID starting with a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f not found: ID does not exist" containerID="a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f" Jul 28 14:04:46.816111 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.816021 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f"} err="failed to get container status \"a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f\": rpc error: code = NotFound desc = could not find container \"a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f\": container with ID starting with a9f4d6805e6d758e0ceb41adc2e8cf48a2f0405804cf68e7fb73048318e0687f not found: ID does not exist" Jul 28 14:04:46.862639 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.862609 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t"] Jul 28 14:04:46.875950 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.875919 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:46.876611 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.876589 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-688d9fd4c8-c629t"] Jul 28 14:04:46.882256 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:46.882235 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pwvc\" (UniqueName: \"kubernetes.io/projected/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a-kube-api-access-8pwvc\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:04:47.016808 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:47.016778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:47.124907 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:47.124825 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" path="/var/lib/kubelet/pods/7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a/volumes" Jul 28 14:04:49.352794 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:49.352712 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:51.948128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:51.948093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:52.013273 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:52.013239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:58.133359 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.133297 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:58.289650 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.289614 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:58.953154 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.953119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:04:58.959337 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959311 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4"] Jul 28 14:04:58.959621 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959606 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerName="feast-0" Jul 28 14:04:58.959718 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959624 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerName="feast-0" Jul 28 14:04:58.959718 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959636 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerName="feast-1" Jul 28 14:04:58.959718 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959644 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerName="feast-1" Jul 28 14:04:58.959718 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959673 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" containerName="manager" Jul 28 14:04:58.959718 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959681 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" containerName="manager" Jul 28 14:04:58.959946 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959756 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3b09e6-1d36-48cb-9feb-e7c38ba3a70a" containerName="manager" Jul 28 14:04:58.959946 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.959770 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cc8a4c3-b4a1-423b-8897-9bf4a0bf8d67" containerName="feast-1" Jul 28 14:04:58.962573 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.962555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:04:58.966384 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.966365 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 28 14:04:58.967386 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.967371 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pwb4l\"" Jul 28 14:04:58.967438 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.967372 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 28 14:04:58.989568 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:58.989546 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4"] Jul 28 14:04:59.070453 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.070419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngxvb\" (UniqueName: \"kubernetes.io/projected/38ccf4f9-1ba9-40de-9832-1ac6c938020e-kube-api-access-ngxvb\") pod \"feast-operator-controller-manager-7495bcd-sffk4\" (UID: \"38ccf4f9-1ba9-40de-9832-1ac6c938020e\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:04:59.171491 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.171458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngxvb\" (UniqueName: \"kubernetes.io/projected/38ccf4f9-1ba9-40de-9832-1ac6c938020e-kube-api-access-ngxvb\") pod \"feast-operator-controller-manager-7495bcd-sffk4\" (UID: \"38ccf4f9-1ba9-40de-9832-1ac6c938020e\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:04:59.183952 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.183918 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngxvb\" (UniqueName: \"kubernetes.io/projected/38ccf4f9-1ba9-40de-9832-1ac6c938020e-kube-api-access-ngxvb\") pod \"feast-operator-controller-manager-7495bcd-sffk4\" (UID: \"38ccf4f9-1ba9-40de-9832-1ac6c938020e\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:04:59.272051 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.272015 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:04:59.410291 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.410250 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4"] Jul 28 14:04:59.413420 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:04:59.413395 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ccf4f9_1ba9_40de_9832_1ac6c938020e.slice/crio-934a2f1efabb46ce322090fb90fa4890288f60bfab23ac6d9b829c7930c90caf WatchSource:0}: Error finding container 934a2f1efabb46ce322090fb90fa4890288f60bfab23ac6d9b829c7930c90caf: Status 404 returned error can't find the container with id 934a2f1efabb46ce322090fb90fa4890288f60bfab23ac6d9b829c7930c90caf Jul 28 14:04:59.415278 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.415262 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 14:04:59.853276 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:04:59.853241 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" event={"ID":"38ccf4f9-1ba9-40de-9832-1ac6c938020e","Type":"ContainerStarted","Data":"934a2f1efabb46ce322090fb90fa4890288f60bfab23ac6d9b829c7930c90caf"} Jul 28 14:05:02.865134 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:02.865090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" event={"ID":"38ccf4f9-1ba9-40de-9832-1ac6c938020e","Type":"ContainerStarted","Data":"7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f"} Jul 28 14:05:02.865526 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:02.865232 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:05:02.892856 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:02.892802 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" podStartSLOduration=2.465919654 podStartE2EDuration="4.892788209s" totalImagesPullingTime="2.426868555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:05:02.891313745 +0000 UTC m=+1356.343704287" watchObservedRunningTime="2026-07-28 14:05:02.892788209 +0000 UTC m=+1356.345178749" Jul 28 14:05:13.870788 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:13.870753 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:05:15.192633 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.192598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:15.292122 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.292077 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:15.592416 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.592375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:15.693162 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.693136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:15.718945 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.718915 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t"] Jul 28 14:05:15.725336 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.725316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.728207 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728173 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 14:05:15.728317 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728208 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 28 14:05:15.728317 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728258 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 28 14:05:15.728317 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728281 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-x9gs7\"" Jul 28 14:05:15.728317 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728292 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 28 14:05:15.728504 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728432 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 14:05:15.728604 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.728589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 28 14:05:15.738616 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.738595 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t"] Jul 28 14:05:15.788965 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.788940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gts\" (UniqueName: \"kubernetes.io/projected/ada6f14b-9e50-44e0-86ad-3ebbf1190634-kube-api-access-42gts\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.789071 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.788970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.789071 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.788995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada6f14b-9e50-44e0-86ad-3ebbf1190634-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.789151 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.789068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.789151 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.789097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.789151 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.789115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890375 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.890308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890375 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.890339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890375 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.890359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890609 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.890393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gts\" (UniqueName: \"kubernetes.io/projected/ada6f14b-9e50-44e0-86ad-3ebbf1190634-kube-api-access-42gts\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890609 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.890414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890609 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.890438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada6f14b-9e50-44e0-86ad-3ebbf1190634-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.890609 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:05:15.890445 2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 28 14:05:15.890609 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:05:15.890445 2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 28 14:05:15.890939 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:05:15.890920 2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 28 14:05:15.891173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.891148 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada6f14b-9e50-44e0-86ad-3ebbf1190634-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.891420 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:05:15.891400 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls podName:ada6f14b-9e50-44e0-86ad-3ebbf1190634 nodeName:}" failed. No retries permitted until 2026-07-28 14:05:16.391374412 +0000 UTC m=+1369.843764947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls") pod "feast-simple-feast-setup-777d6cc998-tsz5t" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634") : secret "feast-simple-feast-setup-ui-tls" not found Jul 28 14:05:15.891592 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:05:15.891579 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls podName:ada6f14b-9e50-44e0-86ad-3ebbf1190634 nodeName:}" failed. No retries permitted until 2026-07-28 14:05:16.39156026 +0000 UTC m=+1369.843950790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls") pod "feast-simple-feast-setup-777d6cc998-tsz5t" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634") : secret "feast-simple-feast-setup-registry-tls" not found Jul 28 14:05:15.891826 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:05:15.891795 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls podName:ada6f14b-9e50-44e0-86ad-3ebbf1190634 nodeName:}" failed. No retries permitted until 2026-07-28 14:05:16.391771453 +0000 UTC m=+1369.844161986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls") pod "feast-simple-feast-setup-777d6cc998-tsz5t" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634") : secret "feast-simple-feast-setup-online-tls" not found Jul 28 14:05:15.893929 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.893904 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:15.902281 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:15.902260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gts\" (UniqueName: \"kubernetes.io/projected/ada6f14b-9e50-44e0-86ad-3ebbf1190634-kube-api-access-42gts\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.131543 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.131501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:16.250099 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.250064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:16.394807 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.394767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.394807 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.394809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.395025 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.394830 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.397421 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.397390 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.397566 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.397466 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.397566 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.397466 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-tsz5t\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.633839 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.633758 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:16.769410 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.769384 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t"] Jul 28 14:05:16.770171 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:05:16.770146 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podada6f14b_9e50_44e0_86ad_3ebbf1190634.slice/crio-2839ded0f0fe73e80a264e96fa5a6a519d9e6ad9b844dddb43ff3a85ca22ab4a WatchSource:0}: Error finding container 2839ded0f0fe73e80a264e96fa5a6a519d9e6ad9b844dddb43ff3a85ca22ab4a: Status 404 returned error can't find the container with id 2839ded0f0fe73e80a264e96fa5a6a519d9e6ad9b844dddb43ff3a85ca22ab4a Jul 28 14:05:16.914185 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:16.914097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"2839ded0f0fe73e80a264e96fa5a6a519d9e6ad9b844dddb43ff3a85ca22ab4a"} Jul 28 14:05:22.482696 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:22.482658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:26.408584 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:26.408528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:26.510091 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:26.510052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:26.736443 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:26.736408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:05:31.976868 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:31.976830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"89a1bce5b14c5bd6a51d8e934c192695bd6b4f5622d40a496630e2f65ed7c0dc"} Jul 28 14:05:35.992382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:35.992344 2572 generic.go:356] "Generic (PLEG): container finished" podID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerID="89a1bce5b14c5bd6a51d8e934c192695bd6b4f5622d40a496630e2f65ed7c0dc" exitCode=0 Jul 28 14:05:35.992772 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:35.992401 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"89a1bce5b14c5bd6a51d8e934c192695bd6b4f5622d40a496630e2f65ed7c0dc"} Jul 28 14:05:36.998129 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:36.998093 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"6bfcdb5bf77874505944d60cf659607ba740f14bc6d52b04c9de70718335ea73"} Jul 28 14:05:42.024244 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:42.024209 2572 generic.go:356] "Generic (PLEG): container finished" podID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerID="6bfcdb5bf77874505944d60cf659607ba740f14bc6d52b04c9de70718335ea73" exitCode=0 Jul 28 14:05:42.024649 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:42.024276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"6bfcdb5bf77874505944d60cf659607ba740f14bc6d52b04c9de70718335ea73"} Jul 28 14:05:43.033663 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.033620 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"ce26a652b0e8be13f25a22d0292e1815f6bd443e0092b00682c012d87bd7b2e6"} Jul 28 14:05:43.034159 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.033691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"6a80a8f25ee52ada2417e0f07d76762a77303da53019dc06a0eee1e075be05ca"} Jul 28 14:05:43.034159 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.033714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"40c71aeae4bde9f6a0300494a3d9fcfae40bbfe363a4f20a1877bf8d2c9569f1"} Jul 28 14:05:43.034159 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.033734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerStarted","Data":"d1c1ce05f8021e5c3f0d341cf840e04a029a54ee26ba8a1a43970fe9914abc42"} Jul 28 14:05:43.081961 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.077899 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podStartSLOduration=13.717680172 podStartE2EDuration="28.077876088s" totalImagesPullingTime="14.360195916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:05:43.076069661 +0000 UTC m=+1396.528460199" watchObservedRunningTime="2026-07-28 14:05:43.077876088 +0000 UTC m=+1396.530266681" Jul 28 14:05:43.634636 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.634592 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:43.634829 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.634666 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:43.634829 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.634688 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:43.635304 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.635258 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:43.636148 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.636105 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Jul 28 14:05:43.636265 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.636195 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Jul 28 14:05:43.636341 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.636273 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Jul 28 14:05:43.636453 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:43.636428 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused" Jul 28 14:05:46.634585 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.634547 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:46.635252 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.635229 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:46.635349 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.634838 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Jul 28 14:05:46.635349 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.635266 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:46.635349 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.634922 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Jul 28 14:05:46.635349 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.634879 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Jul 28 14:05:46.635349 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.634896 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused" Jul 28 14:05:46.635738 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:46.635719 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.635693 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.635663 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.636073 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.635792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.636127 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.636115 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.636669 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.636648 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.636876 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.636862 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.637018 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.637001 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:49.641852 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:49.641834 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:05:50.068308 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:05:50.068274 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:06:40.759939 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:40.759838 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:40.822251 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:40.822215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.197582 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.197519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.202366 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.202339 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t"] Jul 28 14:06:53.202642 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.202613 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="registry" containerID="cri-o://d1c1ce05f8021e5c3f0d341cf840e04a029a54ee26ba8a1a43970fe9914abc42" gracePeriod=30 Jul 28 14:06:53.202736 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.202628 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="offline" containerID="cri-o://6a80a8f25ee52ada2417e0f07d76762a77303da53019dc06a0eee1e075be05ca" gracePeriod=30 Jul 28 14:06:53.202736 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.202649 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" containerID="cri-o://ce26a652b0e8be13f25a22d0292e1815f6bd443e0092b00682c012d87bd7b2e6" gracePeriod=30 Jul 28 14:06:53.202851 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.202648 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" containerID="cri-o://40c71aeae4bde9f6a0300494a3d9fcfae40bbfe363a4f20a1877bf8d2c9569f1" gracePeriod=30 Jul 28 14:06:53.298518 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.298487 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.414506 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.414449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.515076 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.515043 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.562268 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.562231 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f"] Jul 28 14:06:53.566615 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.566596 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.569786 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.569763 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-j4lzc\"" Jul 28 14:06:53.579106 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.579078 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f"] Jul 28 14:06:53.609976 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.609945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.624419 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.624387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.624613 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.624429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.624613 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.624456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6cz\" (UniqueName: \"kubernetes.io/projected/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-kube-api-access-qz6cz\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.624613 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.624560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.624728 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.624660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.624728 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.624721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.690410 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.690385 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.725910 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.725881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.726022 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.725939 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.726022 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.725967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.726022 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.725983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.726022 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.726000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6cz\" (UniqueName: \"kubernetes.io/projected/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-kube-api-access-qz6cz\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.726228 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.726028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.726228 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:06:53.726100 2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 28 14:06:53.726228 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:06:53.726171 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls podName:f3f192b4-4b74-4d8d-8a18-0c33ec5796d0 nodeName:}" failed. No retries permitted until 2026-07-28 14:06:54.226149895 +0000 UTC m=+1467.678540414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls") pod "feast-simple-feast-setup-777d6cc998-v8b4f" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0") : secret "feast-simple-feast-setup-registry-tls" not found Jul 28 14:06:53.726464 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.726443 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.728588 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.728560 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.728846 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.728830 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.729006 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.728981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.735369 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.735283 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6cz\" (UniqueName: \"kubernetes.io/projected/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-kube-api-access-qz6cz\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:53.790891 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.790817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:53.856869 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:53.856837 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:06:54.230174 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.230143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:54.232471 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.232452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-v8b4f\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:54.297142 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.297110 2572 generic.go:356] "Generic (PLEG): container finished" podID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerID="ce26a652b0e8be13f25a22d0292e1815f6bd443e0092b00682c012d87bd7b2e6" exitCode=0 Jul 28 14:06:54.297142 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.297135 2572 generic.go:356] "Generic (PLEG): container finished" podID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerID="40c71aeae4bde9f6a0300494a3d9fcfae40bbfe363a4f20a1877bf8d2c9569f1" exitCode=0 Jul 28 14:06:54.297338 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.297165 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"ce26a652b0e8be13f25a22d0292e1815f6bd443e0092b00682c012d87bd7b2e6"} Jul 28 14:06:54.297338 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.297201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"40c71aeae4bde9f6a0300494a3d9fcfae40bbfe363a4f20a1877bf8d2c9569f1"} Jul 28 14:06:54.476565 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.476513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:06:54.614000 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:54.613833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f"] Jul 28 14:06:54.616456 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:06:54.616421 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3f192b4_4b74_4d8d_8a18_0c33ec5796d0.slice/crio-0fe1625476e03762ce62d7d68a7962d167d084c5a0449446da40c4c0433b55e3 WatchSource:0}: Error finding container 0fe1625476e03762ce62d7d68a7962d167d084c5a0449446da40c4c0433b55e3: Status 404 returned error can't find the container with id 0fe1625476e03762ce62d7d68a7962d167d084c5a0449446da40c4c0433b55e3 Jul 28 14:06:55.301748 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:55.301713 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"5ff642a5c6aff05e9ef67925364977375bc25b047f1ab3e5d71b696bbf02f873"} Jul 28 14:06:55.302153 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:55.301760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"0fe1625476e03762ce62d7d68a7962d167d084c5a0449446da40c4c0433b55e3"} Jul 28 14:06:59.636497 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:06:59.636449 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Jul 28 14:07:00.065668 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:00.065627 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Jul 28 14:07:00.320789 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:00.320705 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerID="5ff642a5c6aff05e9ef67925364977375bc25b047f1ab3e5d71b696bbf02f873" exitCode=0 Jul 28 14:07:00.320789 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:00.320743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"5ff642a5c6aff05e9ef67925364977375bc25b047f1ab3e5d71b696bbf02f873"} Jul 28 14:07:01.327287 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:01.327251 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"7f5ba8a47f12b3ee29153a62390e9a5fe2cab8550cbbad7843ea918b5f694c61"} Jul 28 14:07:06.347960 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:06.347874 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerID="7f5ba8a47f12b3ee29153a62390e9a5fe2cab8550cbbad7843ea918b5f694c61" exitCode=0 Jul 28 14:07:06.347960 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:06.347948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"7f5ba8a47f12b3ee29153a62390e9a5fe2cab8550cbbad7843ea918b5f694c61"} Jul 28 14:07:07.357169 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:07.357128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"642d339c3b240211d6914d29288013d02b4bd6bb89aa13b2f48bc7766c59426c"} Jul 28 14:07:07.357678 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:07.357201 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"3e68877ac272f74ba0ab187e90d01cbcae795bbe5000c590704b6ee1701dbbec"} Jul 28 14:07:07.357678 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:07.357222 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"603fffb9587c292dd61ed8e32d56693f718eeeddc50f99c450389a2ea079e67e"} Jul 28 14:07:07.357678 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:07.357241 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerStarted","Data":"45becb2b4520972c291ed4e169ee502d20e40f8f0c00eb954fcb0a2d8e3272f3"} Jul 28 14:07:09.477513 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.477443 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:09.477513 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.477500 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:09.477513 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.477521 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:09.478129 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.477556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:09.479559 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.479511 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused" Jul 28 14:07:09.479773 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.479563 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Jul 28 14:07:09.479898 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.479568 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 14:07:09.479898 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.479587 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Jul 28 14:07:09.637144 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:09.637099 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Jul 28 14:07:10.065925 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:10.065866 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Jul 28 14:07:12.477727 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.477675 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 14:07:12.478528 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.478504 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.478711 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.478698 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.479152 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.479129 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.479235 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.479168 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.479499 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.479479 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.479615 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.479598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.483646 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.483623 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:12.508616 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:12.508564 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podStartSLOduration=19.508547323 podStartE2EDuration="19.508547323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:07:07.384519523 +0000 UTC m=+1480.836910065" watchObservedRunningTime="2026-07-28 14:07:12.508547323 +0000 UTC m=+1485.960937855" Jul 28 14:07:13.386495 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:13.386456 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:13.389822 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:13.389804 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:14.477038 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:14.476993 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:15.477775 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:15.477748 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:16.399383 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:16.399351 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:07:19.636909 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:19.636857 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused" Jul 28 14:07:19.637432 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:19.637004 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:07:20.065836 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:20.065795 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Jul 28 14:07:20.066015 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:20.065916 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:07:23.424949 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.424917 2572 generic.go:356] "Generic (PLEG): container finished" podID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerID="6a80a8f25ee52ada2417e0f07d76762a77303da53019dc06a0eee1e075be05ca" exitCode=137 Jul 28 14:07:23.424949 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.424939 2572 generic.go:356] "Generic (PLEG): container finished" podID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerID="d1c1ce05f8021e5c3f0d341cf840e04a029a54ee26ba8a1a43970fe9914abc42" exitCode=137 Jul 28 14:07:23.425370 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.424984 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"6a80a8f25ee52ada2417e0f07d76762a77303da53019dc06a0eee1e075be05ca"} Jul 28 14:07:23.425370 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.425025 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"d1c1ce05f8021e5c3f0d341cf840e04a029a54ee26ba8a1a43970fe9914abc42"} Jul 28 14:07:23.847971 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.847950 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:07:23.879795 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.879762 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-offline-tls\") pod \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " Jul 28 14:07:23.879963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.879804 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42gts\" (UniqueName: \"kubernetes.io/projected/ada6f14b-9e50-44e0-86ad-3ebbf1190634-kube-api-access-42gts\") pod \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " Jul 28 14:07:23.879963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.879843 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls\") pod \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " Jul 28 14:07:23.879963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.879877 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls\") pod \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " Jul 28 14:07:23.879963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.879901 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls\") pod \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " Jul 28 14:07:23.879963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.879933 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada6f14b-9e50-44e0-86ad-3ebbf1190634-feast-data\") pod \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\" (UID: \"ada6f14b-9e50-44e0-86ad-3ebbf1190634\") " Jul 28 14:07:23.880717 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.880682 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada6f14b-9e50-44e0-86ad-3ebbf1190634-feast-data" (OuterVolumeSpecName: "feast-data") pod "ada6f14b-9e50-44e0-86ad-3ebbf1190634" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:07:23.882574 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.882509 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada6f14b-9e50-44e0-86ad-3ebbf1190634-kube-api-access-42gts" (OuterVolumeSpecName: "kube-api-access-42gts") pod "ada6f14b-9e50-44e0-86ad-3ebbf1190634" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634"). InnerVolumeSpecName "kube-api-access-42gts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:07:23.882574 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.882520 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls" (OuterVolumeSpecName: "online-tls") pod "ada6f14b-9e50-44e0-86ad-3ebbf1190634" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:07:23.882729 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.882593 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ada6f14b-9e50-44e0-86ad-3ebbf1190634" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:07:23.882729 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.882619 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ada6f14b-9e50-44e0-86ad-3ebbf1190634" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:07:23.882729 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.882689 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ada6f14b-9e50-44e0-86ad-3ebbf1190634" (UID: "ada6f14b-9e50-44e0-86ad-3ebbf1190634"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:07:23.980948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.980853 2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-offline-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:07:23.980948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.980897 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42gts\" (UniqueName: \"kubernetes.io/projected/ada6f14b-9e50-44e0-86ad-3ebbf1190634-kube-api-access-42gts\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:07:23.980948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.980908 2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-online-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:07:23.980948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.980917 2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-ui-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:07:23.980948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.980924 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada6f14b-9e50-44e0-86ad-3ebbf1190634-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:07:23.980948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:23.980932 2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada6f14b-9e50-44e0-86ad-3ebbf1190634-feast-data\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:07:24.431191 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.431098 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" event={"ID":"ada6f14b-9e50-44e0-86ad-3ebbf1190634","Type":"ContainerDied","Data":"2839ded0f0fe73e80a264e96fa5a6a519d9e6ad9b844dddb43ff3a85ca22ab4a"} Jul 28 14:07:24.431191 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.431139 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t" Jul 28 14:07:24.431191 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.431159 2572 scope.go:117] "RemoveContainer" containerID="ce26a652b0e8be13f25a22d0292e1815f6bd443e0092b00682c012d87bd7b2e6" Jul 28 14:07:24.439853 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.439835 2572 scope.go:117] "RemoveContainer" containerID="6a80a8f25ee52ada2417e0f07d76762a77303da53019dc06a0eee1e075be05ca" Jul 28 14:07:24.447175 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.447157 2572 scope.go:117] "RemoveContainer" containerID="40c71aeae4bde9f6a0300494a3d9fcfae40bbfe363a4f20a1877bf8d2c9569f1" Jul 28 14:07:24.453259 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.453234 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t"] Jul 28 14:07:24.455255 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.455236 2572 scope.go:117] "RemoveContainer" containerID="d1c1ce05f8021e5c3f0d341cf840e04a029a54ee26ba8a1a43970fe9914abc42" Jul 28 14:07:24.457526 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.457504 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-tsz5t"] Jul 28 14:07:24.463893 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.463808 2572 scope.go:117] "RemoveContainer" containerID="6bfcdb5bf77874505944d60cf659607ba740f14bc6d52b04c9de70718335ea73" Jul 28 14:07:24.471322 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:24.471304 2572 scope.go:117] "RemoveContainer" containerID="89a1bce5b14c5bd6a51d8e934c192695bd6b4f5622d40a496630e2f65ed7c0dc" Jul 28 14:07:25.120485 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:07:25.120452 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" path="/var/lib/kubelet/pods/ada6f14b-9e50-44e0-86ad-3ebbf1190634/volumes" Jul 28 14:08:21.839244 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839208 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq"] Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839459 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="feast-init" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839471 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="feast-init" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839486 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839493 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839501 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="registry" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839506 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="registry" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839516 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839521 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839527 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="feast-apply" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839546 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="feast-apply" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839559 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="offline" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839564 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="offline" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839604 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="offline" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839612 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="registry" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839617 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="online" Jul 28 14:08:21.841740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.839624 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada6f14b-9e50-44e0-86ad-3ebbf1190634" containerName="ui" Jul 28 14:08:21.842559 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.842545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:21.845603 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.845582 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 28 14:08:21.847928 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.847904 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 28 14:08:21.848044 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.847973 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 28 14:08:21.848044 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.848029 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 28 14:08:21.848157 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.848146 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 28 14:08:21.848814 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.848797 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-m4jwr\"" Jul 28 14:08:21.848903 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.848805 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 28 14:08:21.858873 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.858846 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq"] Jul 28 14:08:21.929903 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.929869 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:21.929903 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.929911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0c4fd718-3862-4ae1-9734-c7c442de0ece-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:21.930152 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.929935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c4fd718-3862-4ae1-9734-c7c442de0ece-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:21.930152 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.929954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4pk6\" (UniqueName: \"kubernetes.io/projected/0c4fd718-3862-4ae1-9734-c7c442de0ece-kube-api-access-w4pk6\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:21.930152 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.930029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:21.930152 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:21.930064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031160 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031124 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031160 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031492 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:08:22.031269 2572 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 28 14:08:22.031492 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031492 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:08:22.031329 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls podName:0c4fd718-3862-4ae1-9734-c7c442de0ece nodeName:}" failed. No retries permitted until 2026-07-28 14:08:22.531311122 +0000 UTC m=+1555.983701642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-pt5mq" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 28 14:08:22.031492 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031357 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0c4fd718-3862-4ae1-9734-c7c442de0ece-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031492 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c4fd718-3862-4ae1-9734-c7c442de0ece-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031492 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4pk6\" (UniqueName: \"kubernetes.io/projected/0c4fd718-3862-4ae1-9734-c7c442de0ece-kube-api-access-w4pk6\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.031854 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.031837 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c4fd718-3862-4ae1-9734-c7c442de0ece-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.032078 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.032061 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0c4fd718-3862-4ae1-9734-c7c442de0ece-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.033729 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.033704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.033850 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.033779 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.044018 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.043996 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4pk6\" (UniqueName: \"kubernetes.io/projected/0c4fd718-3862-4ae1-9734-c7c442de0ece-kube-api-access-w4pk6\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.536967 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.536932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.539290 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.539268 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pt5mq\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.752579 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.752501 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:22.895469 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:22.895445 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq"] Jul 28 14:08:22.897702 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:08:22.897684 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c4fd718_3862_4ae1_9734_c7c442de0ece.slice/crio-ea83e0eb64790a4a7821de1b9eb20c4423780879270556865ff1076b85e8d930 WatchSource:0}: Error finding container ea83e0eb64790a4a7821de1b9eb20c4423780879270556865ff1076b85e8d930: Status 404 returned error can't find the container with id ea83e0eb64790a4a7821de1b9eb20c4423780879270556865ff1076b85e8d930 Jul 28 14:08:23.442101 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:23.442065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:08:23.542908 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:23.542880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:08:23.637853 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:23.637822 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerStarted","Data":"4ecc270b2c1fed7fcee36d835f4f60b3df4ef3de38e6fa6453041bcda696cc8d"} Jul 28 14:08:23.638036 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:23.637864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerStarted","Data":"ea83e0eb64790a4a7821de1b9eb20c4423780879270556865ff1076b85e8d930"} Jul 28 14:08:28.657324 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:28.657294 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerID="4ecc270b2c1fed7fcee36d835f4f60b3df4ef3de38e6fa6453041bcda696cc8d" exitCode=0 Jul 28 14:08:28.657705 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:28.657362 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerDied","Data":"4ecc270b2c1fed7fcee36d835f4f60b3df4ef3de38e6fa6453041bcda696cc8d"} Jul 28 14:08:29.664227 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:29.664185 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerStarted","Data":"a23289dd71e205abf635a466bd81e06369f45affd5661b774b1f954f1dee492e"} Jul 28 14:08:34.684343 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:34.684308 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerID="a23289dd71e205abf635a466bd81e06369f45affd5661b774b1f954f1dee492e" exitCode=0 Jul 28 14:08:34.684845 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:34.684370 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerDied","Data":"a23289dd71e205abf635a466bd81e06369f45affd5661b774b1f954f1dee492e"} Jul 28 14:08:35.692460 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:35.692421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerStarted","Data":"11eeeff827fc2e05aab7734ee19e42593d198a0cb80211f415a5c6c830a6b5a1"} Jul 28 14:08:35.692952 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:35.692473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerStarted","Data":"8826bdea617273973a170fece0941b3dcade1beaf0c9afcc012a5dda215b18ff"} Jul 28 14:08:35.692952 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:35.692490 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerStarted","Data":"b608ded2805dba151b634faa112d7c7160eed2fb24b8b9ff8d637ce55ab06a79"} Jul 28 14:08:35.725147 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:35.725072 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podStartSLOduration=14.725045822 podStartE2EDuration="14.725045822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:35.723869778 +0000 UTC m=+1569.176260321" watchObservedRunningTime="2026-07-28 14:08:35.725045822 +0000 UTC m=+1569.177436365" Jul 28 14:08:37.752815 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:37.752778 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:37.753324 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:37.752886 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:37.753324 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:37.752907 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:37.754726 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:37.754690 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 28 14:08:37.754726 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:37.754711 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Jul 28 14:08:37.754914 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:37.754757 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 28 14:08:40.753106 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:40.753056 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 28 14:08:40.753822 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:40.753798 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:40.754269 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:40.754245 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:40.754662 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:40.754644 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:40.760638 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:40.760616 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:41.718379 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:41.718351 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:41.722981 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:41.722956 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:42.187033 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:42.186950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:08:42.753151 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:42.753121 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:43.753634 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:43.753609 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:08:44.729219 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:08:44.729190 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:09:55.815299 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:55.815268 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq"] Jul 28 14:09:55.815882 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:55.815482 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" containerID="cri-o://b608ded2805dba151b634faa112d7c7160eed2fb24b8b9ff8d637ce55ab06a79" gracePeriod=30 Jul 28 14:09:55.815882 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:55.815569 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="offline" containerID="cri-o://8826bdea617273973a170fece0941b3dcade1beaf0c9afcc012a5dda215b18ff" gracePeriod=30 Jul 28 14:09:55.815882 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:55.815602 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" containerID="cri-o://11eeeff827fc2e05aab7734ee19e42593d198a0cb80211f415a5c6c830a6b5a1" gracePeriod=30 Jul 28 14:09:55.825673 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:55.825648 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:09:56.037198 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.037152 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f"] Jul 28 14:09:56.037512 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.037478 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="registry" containerID="cri-o://45becb2b4520972c291ed4e169ee502d20e40f8f0c00eb954fcb0a2d8e3272f3" gracePeriod=30 Jul 28 14:09:56.037650 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.037596 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="offline" containerID="cri-o://3e68877ac272f74ba0ab187e90d01cbcae795bbe5000c590704b6ee1701dbbec" gracePeriod=30 Jul 28 14:09:56.037650 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.037597 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" containerID="cri-o://642d339c3b240211d6914d29288013d02b4bd6bb89aa13b2f48bc7766c59426c" gracePeriod=30 Jul 28 14:09:56.037784 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.037603 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" containerID="cri-o://603fffb9587c292dd61ed8e32d56693f718eeeddc50f99c450389a2ea079e67e" gracePeriod=30 Jul 28 14:09:56.399728 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.399679 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 14:09:56.994526 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.994497 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerID="11eeeff827fc2e05aab7734ee19e42593d198a0cb80211f415a5c6c830a6b5a1" exitCode=0 Jul 28 14:09:56.994526 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.994519 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerID="b608ded2805dba151b634faa112d7c7160eed2fb24b8b9ff8d637ce55ab06a79" exitCode=0 Jul 28 14:09:56.994989 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.994571 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerDied","Data":"11eeeff827fc2e05aab7734ee19e42593d198a0cb80211f415a5c6c830a6b5a1"} Jul 28 14:09:56.994989 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.994612 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerDied","Data":"b608ded2805dba151b634faa112d7c7160eed2fb24b8b9ff8d637ce55ab06a79"} Jul 28 14:09:56.997353 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.997332 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerID="642d339c3b240211d6914d29288013d02b4bd6bb89aa13b2f48bc7766c59426c" exitCode=0 Jul 28 14:09:56.997353 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.997351 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerID="603fffb9587c292dd61ed8e32d56693f718eeeddc50f99c450389a2ea079e67e" exitCode=0 Jul 28 14:09:56.997505 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.997405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"642d339c3b240211d6914d29288013d02b4bd6bb89aa13b2f48bc7766c59426c"} Jul 28 14:09:56.997505 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:56.997441 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"603fffb9587c292dd61ed8e32d56693f718eeeddc50f99c450389a2ea079e67e"} Jul 28 14:09:57.356157 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:09:57.356079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:01.146521 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:01.146486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:01.719399 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:01.719359 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 28 14:10:03.387237 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:03.387199 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Jul 28 14:10:03.961546 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:03.961514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:04.728854 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:04.728814 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 28 14:10:06.399610 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:06.399564 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 14:10:11.719501 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:11.719461 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 28 14:10:13.386947 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:13.386901 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Jul 28 14:10:14.729167 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:14.729115 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 28 14:10:16.399194 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:16.399150 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 14:10:16.399628 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:16.399297 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:10:21.719392 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:21.719348 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 28 14:10:21.719933 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:21.719471 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:10:23.387162 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:23.387120 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Jul 28 14:10:23.387578 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:23.387242 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:10:24.729747 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:24.729706 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 28 14:10:24.730132 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:24.729826 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:10:26.103273 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.103192 2572 generic.go:356] "Generic (PLEG): container finished" podID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerID="8826bdea617273973a170fece0941b3dcade1beaf0c9afcc012a5dda215b18ff" exitCode=137 Jul 28 14:10:26.103273 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.103262 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerDied","Data":"8826bdea617273973a170fece0941b3dcade1beaf0c9afcc012a5dda215b18ff"} Jul 28 14:10:26.106021 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.106001 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerID="3e68877ac272f74ba0ab187e90d01cbcae795bbe5000c590704b6ee1701dbbec" exitCode=137 Jul 28 14:10:26.106021 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.106018 2572 generic.go:356] "Generic (PLEG): container finished" podID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerID="45becb2b4520972c291ed4e169ee502d20e40f8f0c00eb954fcb0a2d8e3272f3" exitCode=137 Jul 28 14:10:26.106160 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.106044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"3e68877ac272f74ba0ab187e90d01cbcae795bbe5000c590704b6ee1701dbbec"} Jul 28 14:10:26.106160 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.106071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"45becb2b4520972c291ed4e169ee502d20e40f8f0c00eb954fcb0a2d8e3272f3"} Jul 28 14:10:26.398918 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.398875 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 14:10:26.463289 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.463264 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:10:26.617932 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.617905 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls\") pod \"0c4fd718-3862-4ae1-9734-c7c442de0ece\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " Jul 28 14:10:26.618073 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.617952 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4pk6\" (UniqueName: \"kubernetes.io/projected/0c4fd718-3862-4ae1-9734-c7c442de0ece-kube-api-access-w4pk6\") pod \"0c4fd718-3862-4ae1-9734-c7c442de0ece\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " Jul 28 14:10:26.618073 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.617975 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0c4fd718-3862-4ae1-9734-c7c442de0ece-registry-tls\") pod \"0c4fd718-3862-4ae1-9734-c7c442de0ece\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " Jul 28 14:10:26.618073 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.618010 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c4fd718-3862-4ae1-9734-c7c442de0ece-feast-data\") pod \"0c4fd718-3862-4ae1-9734-c7c442de0ece\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " Jul 28 14:10:26.618073 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.618047 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-offline-tls\") pod \"0c4fd718-3862-4ae1-9734-c7c442de0ece\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " Jul 28 14:10:26.618261 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.618093 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-online-tls\") pod \"0c4fd718-3862-4ae1-9734-c7c442de0ece\" (UID: \"0c4fd718-3862-4ae1-9734-c7c442de0ece\") " Jul 28 14:10:26.618370 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.618338 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c4fd718-3862-4ae1-9734-c7c442de0ece-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0c4fd718-3862-4ae1-9734-c7c442de0ece" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:10:26.618798 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.618760 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4fd718-3862-4ae1-9734-c7c442de0ece-feast-data" (OuterVolumeSpecName: "feast-data") pod "0c4fd718-3862-4ae1-9734-c7c442de0ece" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:10:26.620608 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.620559 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0c4fd718-3862-4ae1-9734-c7c442de0ece" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.620608 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.620600 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-online-tls" (OuterVolumeSpecName: "online-tls") pod "0c4fd718-3862-4ae1-9734-c7c442de0ece" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.620734 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.620627 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0c4fd718-3862-4ae1-9734-c7c442de0ece" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.620796 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.620775 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4fd718-3862-4ae1-9734-c7c442de0ece-kube-api-access-w4pk6" (OuterVolumeSpecName: "kube-api-access-w4pk6") pod "0c4fd718-3862-4ae1-9734-c7c442de0ece" (UID: "0c4fd718-3862-4ae1-9734-c7c442de0ece"). InnerVolumeSpecName "kube-api-access-w4pk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:10:26.682059 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.682032 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:10:26.719022 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.718993 2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-ui-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.719022 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.719023 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4pk6\" (UniqueName: \"kubernetes.io/projected/0c4fd718-3862-4ae1-9734-c7c442de0ece-kube-api-access-w4pk6\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.719248 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.719037 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0c4fd718-3862-4ae1-9734-c7c442de0ece-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.719248 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.719054 2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0c4fd718-3862-4ae1-9734-c7c442de0ece-feast-data\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.719248 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.719068 2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-offline-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.719248 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.719079 2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0c4fd718-3862-4ae1-9734-c7c442de0ece-online-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.746922 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.746888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:26.819307 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819272 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-feast-data\") pod \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " Jul 28 14:10:26.819307 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819317 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-offline-tls\") pod \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " Jul 28 14:10:26.819581 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819356 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls\") pod \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " Jul 28 14:10:26.819581 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819401 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-ui-tls\") pod \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " Jul 28 14:10:26.819581 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819427 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-online-tls\") pod \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " Jul 28 14:10:26.819581 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819474 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz6cz\" (UniqueName: \"kubernetes.io/projected/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-kube-api-access-qz6cz\") pod \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\" (UID: \"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0\") " Jul 28 14:10:26.819943 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.819911 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-feast-data" (OuterVolumeSpecName: "feast-data") pod "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:10:26.821726 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.821660 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-online-tls" (OuterVolumeSpecName: "online-tls") pod "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.821852 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.821769 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.821923 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.821895 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.822058 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.822033 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:10:26.822114 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.822097 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-kube-api-access-qz6cz" (OuterVolumeSpecName: "kube-api-access-qz6cz") pod "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" (UID: "f3f192b4-4b74-4d8d-8a18-0c33ec5796d0"). InnerVolumeSpecName "kube-api-access-qz6cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:10:26.920592 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.920553 2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-ui-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.920592 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.920581 2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-online-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.920592 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.920594 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz6cz\" (UniqueName: \"kubernetes.io/projected/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-kube-api-access-qz6cz\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.920592 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.920604 2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-feast-data\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.920864 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.920612 2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-offline-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:26.920864 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:26.920620 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:27.111958 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.111921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" event={"ID":"0c4fd718-3862-4ae1-9734-c7c442de0ece","Type":"ContainerDied","Data":"ea83e0eb64790a4a7821de1b9eb20c4423780879270556865ff1076b85e8d930"} Jul 28 14:10:27.111958 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.111942 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq" Jul 28 14:10:27.112472 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.111985 2572 scope.go:117] "RemoveContainer" containerID="11eeeff827fc2e05aab7734ee19e42593d198a0cb80211f415a5c6c830a6b5a1" Jul 28 14:10:27.115098 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.115071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" event={"ID":"f3f192b4-4b74-4d8d-8a18-0c33ec5796d0","Type":"ContainerDied","Data":"0fe1625476e03762ce62d7d68a7962d167d084c5a0449446da40c4c0433b55e3"} Jul 28 14:10:27.115212 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.115079 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f" Jul 28 14:10:27.122221 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.122201 2572 scope.go:117] "RemoveContainer" containerID="8826bdea617273973a170fece0941b3dcade1beaf0c9afcc012a5dda215b18ff" Jul 28 14:10:27.131312 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.131294 2572 scope.go:117] "RemoveContainer" containerID="b608ded2805dba151b634faa112d7c7160eed2fb24b8b9ff8d637ce55ab06a79" Jul 28 14:10:27.138589 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.138572 2572 scope.go:117] "RemoveContainer" containerID="a23289dd71e205abf635a466bd81e06369f45affd5661b774b1f954f1dee492e" Jul 28 14:10:27.144008 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.143983 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq"] Jul 28 14:10:27.146615 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.146588 2572 scope.go:117] "RemoveContainer" containerID="4ecc270b2c1fed7fcee36d835f4f60b3df4ef3de38e6fa6453041bcda696cc8d" Jul 28 14:10:27.147310 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.147289 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pt5mq"] Jul 28 14:10:27.158565 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.158541 2572 scope.go:117] "RemoveContainer" containerID="642d339c3b240211d6914d29288013d02b4bd6bb89aa13b2f48bc7766c59426c" Jul 28 14:10:27.162348 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.162327 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f"] Jul 28 14:10:27.166982 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.166938 2572 scope.go:117] "RemoveContainer" containerID="3e68877ac272f74ba0ab187e90d01cbcae795bbe5000c590704b6ee1701dbbec" Jul 28 14:10:27.167589 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.167571 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-v8b4f"] Jul 28 14:10:27.174126 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.174106 2572 scope.go:117] "RemoveContainer" containerID="603fffb9587c292dd61ed8e32d56693f718eeeddc50f99c450389a2ea079e67e" Jul 28 14:10:27.180939 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.180923 2572 scope.go:117] "RemoveContainer" containerID="45becb2b4520972c291ed4e169ee502d20e40f8f0c00eb954fcb0a2d8e3272f3" Jul 28 14:10:27.187748 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.187731 2572 scope.go:117] "RemoveContainer" containerID="7f5ba8a47f12b3ee29153a62390e9a5fe2cab8550cbbad7843ea918b5f694c61" Jul 28 14:10:27.193923 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:27.193905 2572 scope.go:117] "RemoveContainer" containerID="5ff642a5c6aff05e9ef67925364977375bc25b047f1ab3e5d71b696bbf02f873" Jul 28 14:10:29.120402 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:29.120370 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" path="/var/lib/kubelet/pods/0c4fd718-3862-4ae1-9734-c7c442de0ece/volumes" Jul 28 14:10:29.120920 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:29.120905 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" path="/var/lib/kubelet/pods/f3f192b4-4b74-4d8d-8a18-0c33ec5796d0/volumes" Jul 28 14:10:39.007568 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:39.007518 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:39.190382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:39.190336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:45.264600 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.264560 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:45.358386 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.358353 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4"] Jul 28 14:10:45.358608 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.358570 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" podUID="38ccf4f9-1ba9-40de-9832-1ac6c938020e" containerName="manager" containerID="cri-o://7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f" gracePeriod=10 Jul 28 14:10:45.384110 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:10:45.384081 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ccf4f9_1ba9_40de_9832_1ac6c938020e.slice/crio-7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f.scope\": RecentStats: unable to find data in memory cache]" Jul 28 14:10:45.604384 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.604356 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:10:45.655954 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.655925 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngxvb\" (UniqueName: \"kubernetes.io/projected/38ccf4f9-1ba9-40de-9832-1ac6c938020e-kube-api-access-ngxvb\") pod \"38ccf4f9-1ba9-40de-9832-1ac6c938020e\" (UID: \"38ccf4f9-1ba9-40de-9832-1ac6c938020e\") " Jul 28 14:10:45.658059 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.658025 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ccf4f9-1ba9-40de-9832-1ac6c938020e-kube-api-access-ngxvb" (OuterVolumeSpecName: "kube-api-access-ngxvb") pod "38ccf4f9-1ba9-40de-9832-1ac6c938020e" (UID: "38ccf4f9-1ba9-40de-9832-1ac6c938020e"). InnerVolumeSpecName "kube-api-access-ngxvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:10:45.756680 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:45.756620 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngxvb\" (UniqueName: \"kubernetes.io/projected/38ccf4f9-1ba9-40de-9832-1ac6c938020e-kube-api-access-ngxvb\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:10:46.187327 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.187289 2572 generic.go:356] "Generic (PLEG): container finished" podID="38ccf4f9-1ba9-40de-9832-1ac6c938020e" containerID="7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f" exitCode=0 Jul 28 14:10:46.187505 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.187337 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" Jul 28 14:10:46.187505 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.187375 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" event={"ID":"38ccf4f9-1ba9-40de-9832-1ac6c938020e","Type":"ContainerDied","Data":"7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f"} Jul 28 14:10:46.187505 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.187430 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4" event={"ID":"38ccf4f9-1ba9-40de-9832-1ac6c938020e","Type":"ContainerDied","Data":"934a2f1efabb46ce322090fb90fa4890288f60bfab23ac6d9b829c7930c90caf"} Jul 28 14:10:46.187505 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.187452 2572 scope.go:117] "RemoveContainer" containerID="7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f" Jul 28 14:10:46.195307 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.195289 2572 scope.go:117] "RemoveContainer" containerID="7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f" Jul 28 14:10:46.195585 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:10:46.195559 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f\": container with ID starting with 7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f not found: ID does not exist" containerID="7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f" Jul 28 14:10:46.195659 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.195594 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f"} err="failed to get container status \"7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f\": rpc error: code = NotFound desc = could not find container \"7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f\": container with ID starting with 7e94b282e6884ad8d6b60de7d9a39d12fedba4a72cce5ce78db142d68065741f not found: ID does not exist" Jul 28 14:10:46.209983 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.209963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:10:46.213781 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.213761 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4"] Jul 28 14:10:46.221319 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:46.221299 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-sffk4"] Jul 28 14:10:47.119456 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:47.119422 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ccf4f9-1ba9-40de-9832-1ac6c938020e" path="/var/lib/kubelet/pods/38ccf4f9-1ba9-40de-9832-1ac6c938020e/volumes" Jul 28 14:10:50.611064 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.610982 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh"] Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611258 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="feast-init" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611271 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="feast-init" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611284 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611290 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611298 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="offline" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611303 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="offline" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611311 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ccf4f9-1ba9-40de-9832-1ac6c938020e" containerName="manager" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611316 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ccf4f9-1ba9-40de-9832-1ac6c938020e" containerName="manager" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611322 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611327 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611335 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="offline" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611340 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="offline" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611347 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="registry" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611352 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="registry" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611360 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="feast-init" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611365 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="feast-init" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611370 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="feast-apply" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611375 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="feast-apply" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611384 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="feast-apply" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611389 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="feast-apply" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611395 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611400 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611407 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" Jul 28 14:10:50.611422 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611412 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611454 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ccf4f9-1ba9-40de-9832-1ac6c938020e" containerName="manager" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611461 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="registry" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611465 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="offline" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611471 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="online" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611477 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f192b4-4b74-4d8d-8a18-0c33ec5796d0" containerName="ui" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611482 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="offline" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611487 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="online" Jul 28 14:10:50.612128 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.611491 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4fd718-3862-4ae1-9734-c7c442de0ece" containerName="ui" Jul 28 14:10:50.615767 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.615751 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:10:50.618910 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.618890 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 28 14:10:50.619948 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.619930 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 28 14:10:50.620002 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.619956 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pwb4l\"" Jul 28 14:10:50.624729 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.624704 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh"] Jul 28 14:10:50.695136 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.695101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwnkf\" (UniqueName: \"kubernetes.io/projected/23e70694-e712-4efd-8f1a-ef1667c5edc9-kube-api-access-xwnkf\") pod \"feast-operator-controller-manager-7495bcd-n8lrh\" (UID: \"23e70694-e712-4efd-8f1a-ef1667c5edc9\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:10:50.796328 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.796285 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwnkf\" (UniqueName: \"kubernetes.io/projected/23e70694-e712-4efd-8f1a-ef1667c5edc9-kube-api-access-xwnkf\") pod \"feast-operator-controller-manager-7495bcd-n8lrh\" (UID: \"23e70694-e712-4efd-8f1a-ef1667c5edc9\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:10:50.819264 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.819235 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwnkf\" (UniqueName: \"kubernetes.io/projected/23e70694-e712-4efd-8f1a-ef1667c5edc9-kube-api-access-xwnkf\") pod \"feast-operator-controller-manager-7495bcd-n8lrh\" (UID: \"23e70694-e712-4efd-8f1a-ef1667c5edc9\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:10:50.926139 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:50.926051 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:10:51.053635 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:51.053605 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh"] Jul 28 14:10:51.056015 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:10:51.055988 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e70694_e712_4efd_8f1a_ef1667c5edc9.slice/crio-0a919d4eb7f375111c4d8bb9e3ddb2c579e42b16ff800937e3938808a74be0ff WatchSource:0}: Error finding container 0a919d4eb7f375111c4d8bb9e3ddb2c579e42b16ff800937e3938808a74be0ff: Status 404 returned error can't find the container with id 0a919d4eb7f375111c4d8bb9e3ddb2c579e42b16ff800937e3938808a74be0ff Jul 28 14:10:51.205836 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:51.205741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" event={"ID":"23e70694-e712-4efd-8f1a-ef1667c5edc9","Type":"ContainerStarted","Data":"3cf9baf34e13e982ab4ce24076add5af27834359b9977739cadec023667c33a2"} Jul 28 14:10:51.205836 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:51.205790 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" event={"ID":"23e70694-e712-4efd-8f1a-ef1667c5edc9","Type":"ContainerStarted","Data":"0a919d4eb7f375111c4d8bb9e3ddb2c579e42b16ff800937e3938808a74be0ff"} Jul 28 14:10:51.205836 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:10:51.205824 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:11:02.211694 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:02.211665 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" Jul 28 14:11:02.231100 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:02.231054 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-n8lrh" podStartSLOduration=12.231039459 podStartE2EDuration="12.231039459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:10:51.226997552 +0000 UTC m=+1704.679388093" watchObservedRunningTime="2026-07-28 14:11:02.231039459 +0000 UTC m=+1715.683430000" Jul 28 14:11:04.993863 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:04.993829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:05.095666 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:05.095635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:07.923855 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:07.923824 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:08.026392 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.026357 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:08.039012 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.038983 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk"] Jul 28 14:11:08.042403 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.042387 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.045125 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.045102 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ls2x9\"" Jul 28 14:11:08.045511 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.045492 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 28 14:11:08.045645 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.045513 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 28 14:11:08.045645 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.045630 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 14:11:08.046289 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.046265 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 28 14:11:08.046289 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.046276 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 28 14:11:08.046289 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.046286 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 14:11:08.056417 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.056396 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk"] Jul 28 14:11:08.116525 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.116481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.116525 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.116525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpmpb\" (UniqueName: \"kubernetes.io/projected/b69b6c5c-0767-4ec0-9701-839fdf233a4f-kube-api-access-kpmpb\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.116775 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.116569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.116775 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.116603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.116775 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.116624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b69b6c5c-0767-4ec0-9701-839fdf233a4f-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.116775 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.116654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.124141 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.124116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:08.217820 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.217780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.218007 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.217826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpmpb\" (UniqueName: \"kubernetes.io/projected/b69b6c5c-0767-4ec0-9701-839fdf233a4f-kube-api-access-kpmpb\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.218007 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.217853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.218007 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:11:08.217950 2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 28 14:11:08.218187 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:11:08.218012 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls podName:b69b6c5c-0767-4ec0-9701-839fdf233a4f nodeName:}" failed. No retries permitted until 2026-07-28 14:11:08.717992054 +0000 UTC m=+1722.170382579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls") pod "feast-simple-feast-setup-777d6cc998-wptgk" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f") : secret "feast-simple-feast-setup-online-tls" not found Jul 28 14:11:08.218187 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.218030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.218187 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.218057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b69b6c5c-0767-4ec0-9701-839fdf233a4f-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.218187 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.218093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.218187 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:11:08.218159 2572 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 28 14:11:08.218454 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:11:08.218235 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls podName:b69b6c5c-0767-4ec0-9701-839fdf233a4f nodeName:}" failed. No retries permitted until 2026-07-28 14:11:08.718217208 +0000 UTC m=+1722.170607738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls") pod "feast-simple-feast-setup-777d6cc998-wptgk" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f") : secret "feast-simple-feast-setup-offline-tls" not found Jul 28 14:11:08.218454 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.218429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b69b6c5c-0767-4ec0-9701-839fdf233a4f-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.220313 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.220290 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.220426 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.220407 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.228045 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.228014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:08.230616 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.230596 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpmpb\" (UniqueName: \"kubernetes.io/projected/b69b6c5c-0767-4ec0-9701-839fdf233a4f-kube-api-access-kpmpb\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.324811 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.324781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:08.424771 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.424738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:11:08.722644 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.722615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.722799 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.722658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.725115 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.725087 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.725234 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.725133 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-wptgk\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:08.951684 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:08.951651 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:09.100370 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:09.100336 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk"] Jul 28 14:11:09.104364 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:11:09.104339 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb69b6c5c_0767_4ec0_9701_839fdf233a4f.slice/crio-3c8ff65ecaa5caf6c8cd0f5b907389ba5a49ce357ef3457898f8cc2a9a9654c7 WatchSource:0}: Error finding container 3c8ff65ecaa5caf6c8cd0f5b907389ba5a49ce357ef3457898f8cc2a9a9654c7: Status 404 returned error can't find the container with id 3c8ff65ecaa5caf6c8cd0f5b907389ba5a49ce357ef3457898f8cc2a9a9654c7 Jul 28 14:11:09.266761 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:09.266673 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332"} Jul 28 14:11:09.266761 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:09.266721 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"3c8ff65ecaa5caf6c8cd0f5b907389ba5a49ce357ef3457898f8cc2a9a9654c7"} Jul 28 14:11:14.285660 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:14.285628 2572 generic.go:356] "Generic (PLEG): container finished" podID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerID="766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332" exitCode=0 Jul 28 14:11:14.286086 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:14.285659 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332"} Jul 28 14:11:15.291882 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:15.291850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9"} Jul 28 14:11:20.313389 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:20.313357 2572 generic.go:356] "Generic (PLEG): container finished" podID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerID="0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9" exitCode=0 Jul 28 14:11:20.313783 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:20.313429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9"} Jul 28 14:11:21.323029 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:21.322985 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02"} Jul 28 14:11:21.323582 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:21.323053 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435"} Jul 28 14:11:21.323582 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:21.323074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df"} Jul 28 14:11:21.323582 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:21.323093 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerStarted","Data":"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f"} Jul 28 14:11:21.351140 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:21.351046 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podStartSLOduration=13.351023701 podStartE2EDuration="13.351023701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:21.349320802 +0000 UTC m=+1734.801711344" watchObservedRunningTime="2026-07-28 14:11:21.351023701 +0000 UTC m=+1734.803414244" Jul 28 14:11:23.952303 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.952263 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:23.952829 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.952340 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:23.952829 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.952361 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:23.952829 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.952380 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:23.954589 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.954550 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 28 14:11:23.954589 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.954571 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Jul 28 14:11:23.954804 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.954587 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Jul 28 14:11:23.954804 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:23.954660 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 28 14:11:26.953530 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.953502 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.953915 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.953617 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.953915 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.953802 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.954110 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.954087 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.954227 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.954130 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.954227 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.954147 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.954413 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.954391 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.954626 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.954606 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.954688 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.954673 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:26.958783 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:26.958757 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:27.350764 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:27.350738 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:11:27.353941 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:11:27.353915 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:12:28.922338 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.922299 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk"] Jul 28 14:12:28.922838 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.922626 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="registry" containerID="cri-o://1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f" gracePeriod=30 Jul 28 14:12:28.922838 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.922652 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" containerID="cri-o://416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02" gracePeriod=30 Jul 28 14:12:28.922838 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.922774 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="offline" containerID="cri-o://a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435" gracePeriod=30 Jul 28 14:12:28.922838 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.922798 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" containerID="cri-o://141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df" gracePeriod=30 Jul 28 14:12:28.927335 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.927314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:12:28.991029 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:28.991000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:12:29.353738 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.353700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:12:29.360376 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.360345 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc"] Jul 28 14:12:29.364570 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.364545 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.367231 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.367210 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-927t6\"" Jul 28 14:12:29.379581 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.379555 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc"] Jul 28 14:12:29.453678 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.453642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.453678 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.453685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cdfb3169-aa9d-40a6-9482-a2175c631430-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.453892 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.453774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwww\" (UniqueName: \"kubernetes.io/projected/cdfb3169-aa9d-40a6-9482-a2175c631430-kube-api-access-tvwww\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.453892 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.453821 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.453892 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.453851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.453994 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.453891 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555125 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555295 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cdfb3169-aa9d-40a6-9482-a2175c631430-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555295 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwww\" (UniqueName: \"kubernetes.io/projected/cdfb3169-aa9d-40a6-9482-a2175c631430-kube-api-access-tvwww\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555295 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555463 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555463 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.555589 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.555515 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cdfb3169-aa9d-40a6-9482-a2175c631430-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.557824 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.557787 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.557957 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.557842 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.558122 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.558100 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.558187 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.558170 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.565518 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.565493 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwww\" (UniqueName: \"kubernetes.io/projected/cdfb3169-aa9d-40a6-9482-a2175c631430-kube-api-access-tvwww\") pod \"feast-simple-feast-setup-777d6cc998-bdbnc\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.569156 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.569131 2572 generic.go:356] "Generic (PLEG): container finished" podID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerID="416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02" exitCode=0 Jul 28 14:12:29.569369 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.569169 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02"} Jul 28 14:12:29.673888 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.673854 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:29.810490 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:29.810464 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc"] Jul 28 14:12:29.812846 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:12:29.812817 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdfb3169_aa9d_40a6_9482_a2175c631430.slice/crio-221e525ba3637a41a1bb40816a435edf1917b2c9f08f7f35e71e428e2860cf81 WatchSource:0}: Error finding container 221e525ba3637a41a1bb40816a435edf1917b2c9f08f7f35e71e428e2860cf81: Status 404 returned error can't find the container with id 221e525ba3637a41a1bb40816a435edf1917b2c9f08f7f35e71e428e2860cf81 Jul 28 14:12:30.576757 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:30.576725 2572 generic.go:356] "Generic (PLEG): container finished" podID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerID="141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df" exitCode=0 Jul 28 14:12:30.577342 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:30.576796 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df"} Jul 28 14:12:30.578135 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:30.578110 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"959a2fa42f871cf448ac598beed8ba8635f218013d6ab22ea0dff90918f80a9d"} Jul 28 14:12:30.578267 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:30.578142 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"221e525ba3637a41a1bb40816a435edf1917b2c9f08f7f35e71e428e2860cf81"} Jul 28 14:12:30.754005 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:30.753962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:12:30.827189 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:30.827097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:12:35.597551 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:35.597508 2572 generic.go:356] "Generic (PLEG): container finished" podID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerID="959a2fa42f871cf448ac598beed8ba8635f218013d6ab22ea0dff90918f80a9d" exitCode=0 Jul 28 14:12:35.597963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:35.597581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"959a2fa42f871cf448ac598beed8ba8635f218013d6ab22ea0dff90918f80a9d"} Jul 28 14:12:36.604572 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:36.604517 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"2ed58709be6aa01e7754e6fb12329fe34d5d17184c5ff79a4da71802c9fc8a32"} Jul 28 14:12:36.954450 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:36.954337 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 28 14:12:37.351596 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:37.351520 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 28 14:12:41.626756 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:41.626665 2572 generic.go:356] "Generic (PLEG): container finished" podID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerID="2ed58709be6aa01e7754e6fb12329fe34d5d17184c5ff79a4da71802c9fc8a32" exitCode=0 Jul 28 14:12:41.626756 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:41.626723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"2ed58709be6aa01e7754e6fb12329fe34d5d17184c5ff79a4da71802c9fc8a32"} Jul 28 14:12:42.636761 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:42.636720 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"adb510c8549c3d96d4b4131c577065c569138a36d8525898bc94a856d9952c0e"} Jul 28 14:12:42.637268 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:42.636784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"2d71b11593cc84e0d2d368d3a083a9873718b4ca7e803ae7637710e688f4854b"} Jul 28 14:12:42.637268 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:42.636807 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"c3dedaa138b989e6d0bc555ac0cf8ce4562db6cec8e8a9d122fa523f512414f5"} Jul 28 14:12:42.637268 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:42.636825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerStarted","Data":"970ec97cb4cc47913bd014f216d16dcb32395eb55874ff5adedf5169d43f805f"} Jul 28 14:12:42.666253 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:42.666179 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podStartSLOduration=13.666158196 podStartE2EDuration="13.666158196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:12:42.665146012 +0000 UTC m=+1816.117536553" watchObservedRunningTime="2026-07-28 14:12:42.666158196 +0000 UTC m=+1816.118548739" Jul 28 14:12:44.675127 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.674839 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:44.675127 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.674906 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:44.675127 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.674925 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:44.675127 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.674942 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:44.676510 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.676479 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Jul 28 14:12:44.676620 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.676523 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Jul 28 14:12:44.676620 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.676576 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 28 14:12:44.676620 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:44.676479 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 28 14:12:46.955284 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:46.955233 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 28 14:12:47.351198 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.351149 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 28 14:12:47.674881 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.674774 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 28 14:12:47.675715 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.675694 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:47.675840 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.675823 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:47.676343 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.676307 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:47.676580 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.676513 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:47.676673 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.676618 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:47.676673 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.676673 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:47.680813 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:47.680791 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:48.665812 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:48.665781 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:48.669088 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:48.669069 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:49.674941 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:49.674908 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:50.674779 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:50.674749 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:51.676576 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:51.676525 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:12:56.955130 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:56.955077 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 28 14:12:56.955843 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:56.955237 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:12:57.351399 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:57.351355 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 28 14:12:57.351621 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:57.351504 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:12:59.558807 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.558784 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:12:59.606813 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.606784 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpmpb\" (UniqueName: \"kubernetes.io/projected/b69b6c5c-0767-4ec0-9701-839fdf233a4f-kube-api-access-kpmpb\") pod \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " Jul 28 14:12:59.606977 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.606828 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-ui-tls\") pod \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " Jul 28 14:12:59.606977 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.606847 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-registry-tls\") pod \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " Jul 28 14:12:59.606977 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.606931 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls\") pod \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " Jul 28 14:12:59.606977 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.606975 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b69b6c5c-0767-4ec0-9701-839fdf233a4f-feast-data\") pod \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " Jul 28 14:12:59.607208 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.607026 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls\") pod \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\" (UID: \"b69b6c5c-0767-4ec0-9701-839fdf233a4f\") " Jul 28 14:12:59.607590 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.607561 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69b6c5c-0767-4ec0-9701-839fdf233a4f-feast-data" (OuterVolumeSpecName: "feast-data") pod "b69b6c5c-0767-4ec0-9701-839fdf233a4f" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:12:59.609132 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.609105 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69b6c5c-0767-4ec0-9701-839fdf233a4f-kube-api-access-kpmpb" (OuterVolumeSpecName: "kube-api-access-kpmpb") pod "b69b6c5c-0767-4ec0-9701-839fdf233a4f" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f"). InnerVolumeSpecName "kube-api-access-kpmpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:12:59.609250 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.609136 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b69b6c5c-0767-4ec0-9701-839fdf233a4f" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:12:59.609250 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.609156 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b69b6c5c-0767-4ec0-9701-839fdf233a4f" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:12:59.609346 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.609325 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b69b6c5c-0767-4ec0-9701-839fdf233a4f" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:12:59.609385 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.609351 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls" (OuterVolumeSpecName: "online-tls") pod "b69b6c5c-0767-4ec0-9701-839fdf233a4f" (UID: "b69b6c5c-0767-4ec0-9701-839fdf233a4f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:12:59.705801 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705716 2572 generic.go:356] "Generic (PLEG): container finished" podID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerID="a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435" exitCode=137 Jul 28 14:12:59.705801 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705744 2572 generic.go:356] "Generic (PLEG): container finished" podID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerID="1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f" exitCode=137 Jul 28 14:12:59.705801 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705773 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" Jul 28 14:12:59.706017 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705797 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435"} Jul 28 14:12:59.706017 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f"} Jul 28 14:12:59.706017 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705851 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk" event={"ID":"b69b6c5c-0767-4ec0-9701-839fdf233a4f","Type":"ContainerDied","Data":"3c8ff65ecaa5caf6c8cd0f5b907389ba5a49ce357ef3457898f8cc2a9a9654c7"} Jul 28 14:12:59.706017 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.705870 2572 scope.go:117] "RemoveContainer" containerID="416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02" Jul 28 14:12:59.707752 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.707732 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpmpb\" (UniqueName: \"kubernetes.io/projected/b69b6c5c-0767-4ec0-9701-839fdf233a4f-kube-api-access-kpmpb\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:12:59.707752 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.707752 2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-ui-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:12:59.707919 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.707762 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:12:59.707919 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.707775 2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-offline-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:12:59.707919 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.707785 2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b69b6c5c-0767-4ec0-9701-839fdf233a4f-feast-data\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:12:59.707919 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.707793 2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b69b6c5c-0767-4ec0-9701-839fdf233a4f-online-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:12:59.714133 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.714114 2572 scope.go:117] "RemoveContainer" containerID="a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435" Jul 28 14:12:59.721268 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.721251 2572 scope.go:117] "RemoveContainer" containerID="141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df" Jul 28 14:12:59.728679 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.728526 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk"] Jul 28 14:12:59.728679 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.728672 2572 scope.go:117] "RemoveContainer" containerID="1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f" Jul 28 14:12:59.732447 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.732427 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-wptgk"] Jul 28 14:12:59.735976 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.735961 2572 scope.go:117] "RemoveContainer" containerID="0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9" Jul 28 14:12:59.742680 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.742664 2572 scope.go:117] "RemoveContainer" containerID="766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332" Jul 28 14:12:59.749419 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.749404 2572 scope.go:117] "RemoveContainer" containerID="416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02" Jul 28 14:12:59.749675 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:12:59.749656 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02\": container with ID starting with 416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02 not found: ID does not exist" containerID="416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02" Jul 28 14:12:59.749750 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.749688 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02"} err="failed to get container status \"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02\": rpc error: code = NotFound desc = could not find container \"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02\": container with ID starting with 416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02 not found: ID does not exist" Jul 28 14:12:59.749750 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.749714 2572 scope.go:117] "RemoveContainer" containerID="a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435" Jul 28 14:12:59.749949 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:12:59.749932 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435\": container with ID starting with a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435 not found: ID does not exist" containerID="a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435" Jul 28 14:12:59.749988 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.749958 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435"} err="failed to get container status \"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435\": rpc error: code = NotFound desc = could not find container \"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435\": container with ID starting with a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435 not found: ID does not exist" Jul 28 14:12:59.749988 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.749974 2572 scope.go:117] "RemoveContainer" containerID="141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df" Jul 28 14:12:59.750174 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:12:59.750158 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df\": container with ID starting with 141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df not found: ID does not exist" containerID="141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df" Jul 28 14:12:59.750232 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750182 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df"} err="failed to get container status \"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df\": rpc error: code = NotFound desc = could not find container \"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df\": container with ID starting with 141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df not found: ID does not exist" Jul 28 14:12:59.750232 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750203 2572 scope.go:117] "RemoveContainer" containerID="1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f" Jul 28 14:12:59.750415 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:12:59.750400 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f\": container with ID starting with 1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f not found: ID does not exist" containerID="1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f" Jul 28 14:12:59.750464 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750419 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f"} err="failed to get container status \"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f\": rpc error: code = NotFound desc = could not find container \"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f\": container with ID starting with 1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f not found: ID does not exist" Jul 28 14:12:59.750464 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750432 2572 scope.go:117] "RemoveContainer" containerID="0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9" Jul 28 14:12:59.750674 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:12:59.750659 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9\": container with ID starting with 0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9 not found: ID does not exist" containerID="0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9" Jul 28 14:12:59.750721 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750675 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9"} err="failed to get container status \"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9\": rpc error: code = NotFound desc = could not find container \"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9\": container with ID starting with 0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9 not found: ID does not exist" Jul 28 14:12:59.750721 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750686 2572 scope.go:117] "RemoveContainer" containerID="766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332" Jul 28 14:12:59.750927 ip-10-0-136-179 kubenswrapper[2572]: E0728 14:12:59.750908 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332\": container with ID starting with 766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332 not found: ID does not exist" containerID="766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332" Jul 28 14:12:59.750972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750931 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332"} err="failed to get container status \"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332\": rpc error: code = NotFound desc = could not find container \"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332\": container with ID starting with 766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332 not found: ID does not exist" Jul 28 14:12:59.750972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.750945 2572 scope.go:117] "RemoveContainer" containerID="416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02" Jul 28 14:12:59.751158 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751141 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02"} err="failed to get container status \"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02\": rpc error: code = NotFound desc = could not find container \"416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02\": container with ID starting with 416438e419d1fbca000a95dd548dd1e6d11aad1e10e322c58d56e5479e316e02 not found: ID does not exist" Jul 28 14:12:59.751201 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751160 2572 scope.go:117] "RemoveContainer" containerID="a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435" Jul 28 14:12:59.751386 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751369 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435"} err="failed to get container status \"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435\": rpc error: code = NotFound desc = could not find container \"a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435\": container with ID starting with a63c562a7f375764d5533a315fdd42a897bb2bf3d3c96ea03bfe98933051b435 not found: ID does not exist" Jul 28 14:12:59.751386 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751384 2572 scope.go:117] "RemoveContainer" containerID="141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df" Jul 28 14:12:59.751580 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751563 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df"} err="failed to get container status \"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df\": rpc error: code = NotFound desc = could not find container \"141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df\": container with ID starting with 141f4f5742b80249f4e342e23b84228b306cdd163c0d0d181a9ba42411cfc7df not found: ID does not exist" Jul 28 14:12:59.751628 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751582 2572 scope.go:117] "RemoveContainer" containerID="1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f" Jul 28 14:12:59.751771 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751756 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f"} err="failed to get container status \"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f\": rpc error: code = NotFound desc = could not find container \"1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f\": container with ID starting with 1923ffc28d1622dfc3d12464d134d47245ddacd92784f3116ad7395fc78aa12f not found: ID does not exist" Jul 28 14:12:59.751810 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751771 2572 scope.go:117] "RemoveContainer" containerID="0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9" Jul 28 14:12:59.751952 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751937 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9"} err="failed to get container status \"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9\": rpc error: code = NotFound desc = could not find container \"0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9\": container with ID starting with 0fe4be0d39af6925a76bb917523b63e25c6ffc7c79068219eca24fbda6280ff9 not found: ID does not exist" Jul 28 14:12:59.751998 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.751952 2572 scope.go:117] "RemoveContainer" containerID="766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332" Jul 28 14:12:59.752135 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:12:59.752121 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332"} err="failed to get container status \"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332\": rpc error: code = NotFound desc = could not find container \"766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332\": container with ID starting with 766aad3de6d0f2fca341b2c90cfaac8c1862dc58de8a938686007485e6896332 not found: ID does not exist" Jul 28 14:13:01.120762 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:01.120724 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" path="/var/lib/kubelet/pods/b69b6c5c-0767-4ec0-9701-839fdf233a4f/volumes" Jul 28 14:13:52.391454 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.391368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:13:52.494400 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.494359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:13:52.648058 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.647979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:13:52.738685 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.738651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:13:52.746924 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.746898 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv"] Jul 28 14:13:52.747129 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747119 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="offline" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747131 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="offline" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747143 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747148 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747157 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="feast-init" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747162 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="feast-init" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747167 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="registry" Jul 28 14:13:52.747173 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747173 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="registry" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747184 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="feast-apply" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747189 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="feast-apply" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747199 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747204 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747243 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="online" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747251 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="offline" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747257 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="registry" Jul 28 14:13:52.747382 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.747264 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69b6c5c-0767-4ec0-9701-839fdf233a4f" containerName="ui" Jul 28 14:13:52.751580 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.751563 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:52.755052 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.755030 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 28 14:13:52.755170 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.755086 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 28 14:13:52.755170 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.755155 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 28 14:13:52.755296 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.755198 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 28 14:13:52.755703 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.755688 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 28 14:13:52.755863 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.755839 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-8qzdm\"" Jul 28 14:13:52.756050 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.756032 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 28 14:13:52.765580 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.765557 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv"] Jul 28 14:13:52.923665 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.923581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:52.923665 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.923636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:52.923936 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.923719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/733e982d-cbb6-4e14-b764-116969ca14cf-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:52.923936 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.923744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:52.923936 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.923764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dntnl\" (UniqueName: \"kubernetes.io/projected/733e982d-cbb6-4e14-b764-116969ca14cf-kube-api-access-dntnl\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:52.923936 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:52.923838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/733e982d-cbb6-4e14-b764-116969ca14cf-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.024711 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.024675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/733e982d-cbb6-4e14-b764-116969ca14cf-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.024874 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.024721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.024874 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.024767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.024874 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.024797 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/733e982d-cbb6-4e14-b764-116969ca14cf-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.024874 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.024812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.024874 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.024828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dntnl\" (UniqueName: \"kubernetes.io/projected/733e982d-cbb6-4e14-b764-116969ca14cf-kube-api-access-dntnl\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.025155 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.025129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/733e982d-cbb6-4e14-b764-116969ca14cf-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.025490 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.025470 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/733e982d-cbb6-4e14-b764-116969ca14cf-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.027284 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.027255 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.027402 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.027343 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.027402 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.027361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.033436 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.033415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dntnl\" (UniqueName: \"kubernetes.io/projected/733e982d-cbb6-4e14-b764-116969ca14cf-kube-api-access-dntnl\") pod \"feast-simple-feast-remote-setup-db6955c6c-jgqgv\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.061328 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.061302 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:13:53.191483 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.191411 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv"] Jul 28 14:13:53.194980 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:13:53.194954 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod733e982d_cbb6_4e14_b764_116969ca14cf.slice/crio-20681111e2cc0db3fef9db0be8b641b2e176048c7e282f93a4420f7102ef5d31 WatchSource:0}: Error finding container 20681111e2cc0db3fef9db0be8b641b2e176048c7e282f93a4420f7102ef5d31: Status 404 returned error can't find the container with id 20681111e2cc0db3fef9db0be8b641b2e176048c7e282f93a4420f7102ef5d31 Jul 28 14:13:53.661147 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.661111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:13:53.746121 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.746085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:13:53.894656 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.894622 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerStarted","Data":"d37fee919683738a8dfd4c2892c70685b87b103f0323e203603bdfbfa34e860f"} Jul 28 14:13:53.894656 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:53.894665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerStarted","Data":"20681111e2cc0db3fef9db0be8b641b2e176048c7e282f93a4420f7102ef5d31"} Jul 28 14:13:58.914659 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:58.914625 2572 generic.go:356] "Generic (PLEG): container finished" podID="733e982d-cbb6-4e14-b764-116969ca14cf" containerID="d37fee919683738a8dfd4c2892c70685b87b103f0323e203603bdfbfa34e860f" exitCode=0 Jul 28 14:13:58.915049 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:58.914665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerDied","Data":"d37fee919683738a8dfd4c2892c70685b87b103f0323e203603bdfbfa34e860f"} Jul 28 14:13:59.919878 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:13:59.919839 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerStarted","Data":"e5af26b4b6207ac1dc1922a05b5fa21ddb0b28d891f3829e0c48375664614376"} Jul 28 14:14:04.940356 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:04.940323 2572 generic.go:356] "Generic (PLEG): container finished" podID="733e982d-cbb6-4e14-b764-116969ca14cf" containerID="e5af26b4b6207ac1dc1922a05b5fa21ddb0b28d891f3829e0c48375664614376" exitCode=0 Jul 28 14:14:04.940761 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:04.940376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerDied","Data":"e5af26b4b6207ac1dc1922a05b5fa21ddb0b28d891f3829e0c48375664614376"} Jul 28 14:14:05.948696 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:05.948651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerStarted","Data":"7a8aeb5f82fdb7ca143b6b2fc92ffc5fb9b9479b15d44474654ccfa93c4787f2"} Jul 28 14:14:05.949210 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:05.948719 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerStarted","Data":"0b0fcdf14fd5e0fdf2764f8c1df6c656e1634538301ce50afbe34e0bb4e6ec7c"} Jul 28 14:14:05.949210 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:05.948738 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerStarted","Data":"fc953b566f05db71c01ff67fa206b46eb8522a00a070f538180fdcec2a60496f"} Jul 28 14:14:05.986322 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:05.986241 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podStartSLOduration=13.986220913 podStartE2EDuration="13.986220913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:14:05.981670452 +0000 UTC m=+1899.434060997" watchObservedRunningTime="2026-07-28 14:14:05.986220913 +0000 UTC m=+1899.438611454" Jul 28 14:14:08.062528 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:08.062476 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:08.063041 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:08.062556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:08.063041 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:08.062586 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:08.064119 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:08.064084 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 28 14:14:08.064368 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:08.064113 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Jul 28 14:14:08.064477 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:08.064121 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 28 14:14:11.062576 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.062515 2572 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 28 14:14:11.063610 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.063589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:11.064053 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.064030 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:11.064495 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.064478 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:11.070021 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.070001 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:11.976275 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.976241 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:11.980934 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:11.980908 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:13.061450 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:13.061413 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:14.063225 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:14.063192 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:14:14.988146 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:14:14.988120 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:15:12.243815 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:12.243778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:16.081572 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.081508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:16.083786 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.083755 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv"] Jul 28 14:15:16.084084 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.084034 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" containerID="cri-o://fc953b566f05db71c01ff67fa206b46eb8522a00a070f538180fdcec2a60496f" gracePeriod=30 Jul 28 14:15:16.084224 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.084143 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="offline" containerID="cri-o://0b0fcdf14fd5e0fdf2764f8c1df6c656e1634538301ce50afbe34e0bb4e6ec7c" gracePeriod=30 Jul 28 14:15:16.084224 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.084152 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" containerID="cri-o://7a8aeb5f82fdb7ca143b6b2fc92ffc5fb9b9479b15d44474654ccfa93c4787f2" gracePeriod=30 Jul 28 14:15:16.144774 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.144740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:16.258155 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.258112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:16.263621 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.263594 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc"] Jul 28 14:15:16.264036 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.263867 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="registry" containerID="cri-o://970ec97cb4cc47913bd014f216d16dcb32395eb55874ff5adedf5169d43f805f" gracePeriod=30 Jul 28 14:15:16.264036 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.263938 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="offline" containerID="cri-o://2d71b11593cc84e0d2d368d3a083a9873718b4ca7e803ae7637710e688f4854b" gracePeriod=30 Jul 28 14:15:16.264036 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.263942 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" containerID="cri-o://c3dedaa138b989e6d0bc555ac0cf8ce4562db6cec8e8a9d122fa523f512414f5" gracePeriod=30 Jul 28 14:15:16.264260 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.263949 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" containerID="cri-o://adb510c8549c3d96d4b4131c577065c569138a36d8525898bc94a856d9952c0e" gracePeriod=30 Jul 28 14:15:16.369439 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.369349 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:16.528980 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:16.528944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:17.221238 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.221203 2572 generic.go:356] "Generic (PLEG): container finished" podID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerID="adb510c8549c3d96d4b4131c577065c569138a36d8525898bc94a856d9952c0e" exitCode=0 Jul 28 14:15:17.221238 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.221232 2572 generic.go:356] "Generic (PLEG): container finished" podID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerID="c3dedaa138b989e6d0bc555ac0cf8ce4562db6cec8e8a9d122fa523f512414f5" exitCode=0 Jul 28 14:15:17.221737 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.221273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"adb510c8549c3d96d4b4131c577065c569138a36d8525898bc94a856d9952c0e"} Jul 28 14:15:17.221737 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.221316 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"c3dedaa138b989e6d0bc555ac0cf8ce4562db6cec8e8a9d122fa523f512414f5"} Jul 28 14:15:17.223983 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.223954 2572 generic.go:356] "Generic (PLEG): container finished" podID="733e982d-cbb6-4e14-b764-116969ca14cf" containerID="7a8aeb5f82fdb7ca143b6b2fc92ffc5fb9b9479b15d44474654ccfa93c4787f2" exitCode=0 Jul 28 14:15:17.223983 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.223978 2572 generic.go:356] "Generic (PLEG): container finished" podID="733e982d-cbb6-4e14-b764-116969ca14cf" containerID="fc953b566f05db71c01ff67fa206b46eb8522a00a070f538180fdcec2a60496f" exitCode=0 Jul 28 14:15:17.224184 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.223987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerDied","Data":"7a8aeb5f82fdb7ca143b6b2fc92ffc5fb9b9479b15d44474654ccfa93c4787f2"} Jul 28 14:15:17.224184 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:17.224023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerDied","Data":"fc953b566f05db71c01ff67fa206b46eb8522a00a070f538180fdcec2a60496f"} Jul 28 14:15:18.666967 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:18.666918 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 28 14:15:21.441166 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:21.441069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:21.676393 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:21.676349 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 28 14:15:21.976975 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:21.976926 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 28 14:15:24.988362 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:24.988315 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 28 14:15:28.665863 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:28.665817 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 28 14:15:31.676663 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:31.676619 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 28 14:15:31.977384 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:31.977349 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 28 14:15:34.988109 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:34.988069 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 28 14:15:38.666697 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:38.666653 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 28 14:15:38.667091 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:38.666779 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:15:41.676616 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:41.676565 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 28 14:15:41.677088 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:41.676752 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:15:41.977414 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:41.977376 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 28 14:15:41.977610 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:41.977509 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:15:44.988355 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:44.988315 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 28 14:15:44.988800 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:44.988466 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:15:46.015267 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.015229 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:46.094470 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.094427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:46.334988 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.334962 2572 generic.go:356] "Generic (PLEG): container finished" podID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerID="2d71b11593cc84e0d2d368d3a083a9873718b4ca7e803ae7637710e688f4854b" exitCode=137 Jul 28 14:15:46.334988 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.334983 2572 generic.go:356] "Generic (PLEG): container finished" podID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerID="970ec97cb4cc47913bd014f216d16dcb32395eb55874ff5adedf5169d43f805f" exitCode=137 Jul 28 14:15:46.335186 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.335039 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"2d71b11593cc84e0d2d368d3a083a9873718b4ca7e803ae7637710e688f4854b"} Jul 28 14:15:46.335186 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.335088 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"970ec97cb4cc47913bd014f216d16dcb32395eb55874ff5adedf5169d43f805f"} Jul 28 14:15:46.337514 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.337494 2572 generic.go:356] "Generic (PLEG): container finished" podID="733e982d-cbb6-4e14-b764-116969ca14cf" containerID="0b0fcdf14fd5e0fdf2764f8c1df6c656e1634538301ce50afbe34e0bb4e6ec7c" exitCode=137 Jul 28 14:15:46.337639 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.337559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerDied","Data":"0b0fcdf14fd5e0fdf2764f8c1df6c656e1634538301ce50afbe34e0bb4e6ec7c"} Jul 28 14:15:46.728349 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.728327 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:15:46.811164 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811129 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-offline-tls\") pod \"733e982d-cbb6-4e14-b764-116969ca14cf\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " Jul 28 14:15:46.811164 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811170 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/733e982d-cbb6-4e14-b764-116969ca14cf-registry-tls\") pod \"733e982d-cbb6-4e14-b764-116969ca14cf\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " Jul 28 14:15:46.811421 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811238 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dntnl\" (UniqueName: \"kubernetes.io/projected/733e982d-cbb6-4e14-b764-116969ca14cf-kube-api-access-dntnl\") pod \"733e982d-cbb6-4e14-b764-116969ca14cf\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " Jul 28 14:15:46.811421 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811269 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/733e982d-cbb6-4e14-b764-116969ca14cf-feast-data\") pod \"733e982d-cbb6-4e14-b764-116969ca14cf\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " Jul 28 14:15:46.811421 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811306 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-online-tls\") pod \"733e982d-cbb6-4e14-b764-116969ca14cf\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " Jul 28 14:15:46.811421 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811348 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-ui-tls\") pod \"733e982d-cbb6-4e14-b764-116969ca14cf\" (UID: \"733e982d-cbb6-4e14-b764-116969ca14cf\") " Jul 28 14:15:46.811677 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811565 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733e982d-cbb6-4e14-b764-116969ca14cf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "733e982d-cbb6-4e14-b764-116969ca14cf" (UID: "733e982d-cbb6-4e14-b764-116969ca14cf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:15:46.811846 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.811815 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/733e982d-cbb6-4e14-b764-116969ca14cf-feast-data" (OuterVolumeSpecName: "feast-data") pod "733e982d-cbb6-4e14-b764-116969ca14cf" (UID: "733e982d-cbb6-4e14-b764-116969ca14cf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:15:46.813601 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.813573 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "733e982d-cbb6-4e14-b764-116969ca14cf" (UID: "733e982d-cbb6-4e14-b764-116969ca14cf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:46.813601 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.813586 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733e982d-cbb6-4e14-b764-116969ca14cf-kube-api-access-dntnl" (OuterVolumeSpecName: "kube-api-access-dntnl") pod "733e982d-cbb6-4e14-b764-116969ca14cf" (UID: "733e982d-cbb6-4e14-b764-116969ca14cf"). InnerVolumeSpecName "kube-api-access-dntnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:15:46.813782 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.813720 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-online-tls" (OuterVolumeSpecName: "online-tls") pod "733e982d-cbb6-4e14-b764-116969ca14cf" (UID: "733e982d-cbb6-4e14-b764-116969ca14cf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:46.813847 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.813792 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "733e982d-cbb6-4e14-b764-116969ca14cf" (UID: "733e982d-cbb6-4e14-b764-116969ca14cf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:46.907612 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.907587 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:15:46.912339 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.912317 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dntnl\" (UniqueName: \"kubernetes.io/projected/733e982d-cbb6-4e14-b764-116969ca14cf-kube-api-access-dntnl\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:46.912434 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.912343 2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/733e982d-cbb6-4e14-b764-116969ca14cf-feast-data\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:46.912434 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.912356 2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-online-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:46.912434 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.912368 2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-ui-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:46.912434 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.912379 2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/733e982d-cbb6-4e14-b764-116969ca14cf-offline-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:46.912434 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:46.912391 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/733e982d-cbb6-4e14-b764-116969ca14cf-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.013675 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.013634 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-offline-tls\") pod \"cdfb3169-aa9d-40a6-9482-a2175c631430\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " Jul 28 14:15:47.013872 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.013682 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-ui-tls\") pod \"cdfb3169-aa9d-40a6-9482-a2175c631430\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " Jul 28 14:15:47.013872 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.013727 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cdfb3169-aa9d-40a6-9482-a2175c631430-feast-data\") pod \"cdfb3169-aa9d-40a6-9482-a2175c631430\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " Jul 28 14:15:47.013872 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.013763 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvwww\" (UniqueName: \"kubernetes.io/projected/cdfb3169-aa9d-40a6-9482-a2175c631430-kube-api-access-tvwww\") pod \"cdfb3169-aa9d-40a6-9482-a2175c631430\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " Jul 28 14:15:47.013872 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.013785 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-online-tls\") pod \"cdfb3169-aa9d-40a6-9482-a2175c631430\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " Jul 28 14:15:47.013872 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.013809 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-registry-tls\") pod \"cdfb3169-aa9d-40a6-9482-a2175c631430\" (UID: \"cdfb3169-aa9d-40a6-9482-a2175c631430\") " Jul 28 14:15:47.014341 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.014309 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdfb3169-aa9d-40a6-9482-a2175c631430-feast-data" (OuterVolumeSpecName: "feast-data") pod "cdfb3169-aa9d-40a6-9482-a2175c631430" (UID: "cdfb3169-aa9d-40a6-9482-a2175c631430"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:15:47.015873 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.015842 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "cdfb3169-aa9d-40a6-9482-a2175c631430" (UID: "cdfb3169-aa9d-40a6-9482-a2175c631430"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:47.016262 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.015956 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cdfb3169-aa9d-40a6-9482-a2175c631430" (UID: "cdfb3169-aa9d-40a6-9482-a2175c631430"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:47.016262 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.015956 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfb3169-aa9d-40a6-9482-a2175c631430-kube-api-access-tvwww" (OuterVolumeSpecName: "kube-api-access-tvwww") pod "cdfb3169-aa9d-40a6-9482-a2175c631430" (UID: "cdfb3169-aa9d-40a6-9482-a2175c631430"). InnerVolumeSpecName "kube-api-access-tvwww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:15:47.016262 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.016204 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "cdfb3169-aa9d-40a6-9482-a2175c631430" (UID: "cdfb3169-aa9d-40a6-9482-a2175c631430"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:47.016381 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.016282 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-online-tls" (OuterVolumeSpecName: "online-tls") pod "cdfb3169-aa9d-40a6-9482-a2175c631430" (UID: "cdfb3169-aa9d-40a6-9482-a2175c631430"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:15:47.114821 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.114788 2572 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-ui-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.114821 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.114815 2572 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cdfb3169-aa9d-40a6-9482-a2175c631430-feast-data\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.114821 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.114825 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvwww\" (UniqueName: \"kubernetes.io/projected/cdfb3169-aa9d-40a6-9482-a2175c631430-kube-api-access-tvwww\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.115057 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.114834 2572 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-online-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.115057 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.114842 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-registry-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.115057 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.114850 2572 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cdfb3169-aa9d-40a6-9482-a2175c631430-offline-tls\") on node \"ip-10-0-136-179.ec2.internal\" DevicePath \"\"" Jul 28 14:15:47.343791 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.343754 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" event={"ID":"cdfb3169-aa9d-40a6-9482-a2175c631430","Type":"ContainerDied","Data":"221e525ba3637a41a1bb40816a435edf1917b2c9f08f7f35e71e428e2860cf81"} Jul 28 14:15:47.343969 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.343768 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc" Jul 28 14:15:47.343969 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.343809 2572 scope.go:117] "RemoveContainer" containerID="adb510c8549c3d96d4b4131c577065c569138a36d8525898bc94a856d9952c0e" Jul 28 14:15:47.346850 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.346819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" event={"ID":"733e982d-cbb6-4e14-b764-116969ca14cf","Type":"ContainerDied","Data":"20681111e2cc0db3fef9db0be8b641b2e176048c7e282f93a4420f7102ef5d31"} Jul 28 14:15:47.346941 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.346826 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv" Jul 28 14:15:47.354020 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.353997 2572 scope.go:117] "RemoveContainer" containerID="2d71b11593cc84e0d2d368d3a083a9873718b4ca7e803ae7637710e688f4854b" Jul 28 14:15:47.362372 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.362345 2572 scope.go:117] "RemoveContainer" containerID="c3dedaa138b989e6d0bc555ac0cf8ce4562db6cec8e8a9d122fa523f512414f5" Jul 28 14:15:47.368048 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.368026 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv"] Jul 28 14:15:47.370203 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.370182 2572 scope.go:117] "RemoveContainer" containerID="970ec97cb4cc47913bd014f216d16dcb32395eb55874ff5adedf5169d43f805f" Jul 28 14:15:47.370829 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.370812 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-jgqgv"] Jul 28 14:15:47.377582 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.377564 2572 scope.go:117] "RemoveContainer" containerID="2ed58709be6aa01e7754e6fb12329fe34d5d17184c5ff79a4da71802c9fc8a32" Jul 28 14:15:47.382834 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.382815 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc"] Jul 28 14:15:47.384238 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.384224 2572 scope.go:117] "RemoveContainer" containerID="959a2fa42f871cf448ac598beed8ba8635f218013d6ab22ea0dff90918f80a9d" Jul 28 14:15:47.387519 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.387491 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-bdbnc"] Jul 28 14:15:47.391262 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.391247 2572 scope.go:117] "RemoveContainer" containerID="7a8aeb5f82fdb7ca143b6b2fc92ffc5fb9b9479b15d44474654ccfa93c4787f2" Jul 28 14:15:47.398575 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.398559 2572 scope.go:117] "RemoveContainer" containerID="0b0fcdf14fd5e0fdf2764f8c1df6c656e1634538301ce50afbe34e0bb4e6ec7c" Jul 28 14:15:47.405480 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.405464 2572 scope.go:117] "RemoveContainer" containerID="fc953b566f05db71c01ff67fa206b46eb8522a00a070f538180fdcec2a60496f" Jul 28 14:15:47.412437 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.412422 2572 scope.go:117] "RemoveContainer" containerID="e5af26b4b6207ac1dc1922a05b5fa21ddb0b28d891f3829e0c48375664614376" Jul 28 14:15:47.418943 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:47.418927 2572 scope.go:117] "RemoveContainer" containerID="d37fee919683738a8dfd4c2892c70685b87b103f0323e203603bdfbfa34e860f" Jul 28 14:15:49.121511 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:49.121481 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" path="/var/lib/kubelet/pods/733e982d-cbb6-4e14-b764-116969ca14cf/volumes" Jul 28 14:15:49.122030 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:49.122016 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" path="/var/lib/kubelet/pods/cdfb3169-aa9d-40a6-9482-a2175c631430/volumes" Jul 28 14:15:59.259782 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:59.259749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:15:59.378734 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:15:59.378690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:05.024040 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:05.023980 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:05.126987 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:05.126951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:05.348132 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:05.348040 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:05.448063 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:05.448026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:23.307005 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.306964 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:23.437641 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437607 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hn42g/must-gather-kzjjb"] Jul 28 14:16:23.437873 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437860 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="registry" Jul 28 14:16:23.437873 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437875 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="registry" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437887 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437893 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437900 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437905 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437911 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="offline" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437916 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="offline" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437928 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="offline" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437933 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="offline" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437939 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="feast-apply" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437944 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="feast-apply" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437952 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437957 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437962 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="feast-init" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437967 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="feast-init" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437974 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" Jul 28 14:16:23.437972 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437979 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437984 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="feast-init" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437989 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="feast-init" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.437995 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="feast-apply" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438000 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="feast-apply" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438035 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="offline" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438042 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="ui" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438047 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="registry" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438057 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="online" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438077 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="offline" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438083 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfb3169-aa9d-40a6-9482-a2175c631430" containerName="ui" Jul 28 14:16:23.438500 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.438089 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="733e982d-cbb6-4e14-b764-116969ca14cf" containerName="online" Jul 28 14:16:23.440886 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.440871 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.443492 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.443469 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hn42g\"/\"kube-root-ca.crt\"" Jul 28 14:16:23.444522 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.444498 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hn42g\"/\"openshift-service-ca.crt\"" Jul 28 14:16:23.444606 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.444502 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hn42g\"/\"default-dockercfg-dfdvd\"" Jul 28 14:16:23.452274 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.452251 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hn42g/must-gather-kzjjb"] Jul 28 14:16:23.457966 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.457902 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:23.523279 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.523246 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:23.585835 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.585763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whhd\" (UniqueName: \"kubernetes.io/projected/98e64786-acc7-4b22-883f-f8625fe81152-kube-api-access-5whhd\") pod \"must-gather-kzjjb\" (UID: \"98e64786-acc7-4b22-883f-f8625fe81152\") " pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.585835 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.585812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/98e64786-acc7-4b22-883f-f8625fe81152-must-gather-output\") pod \"must-gather-kzjjb\" (UID: \"98e64786-acc7-4b22-883f-f8625fe81152\") " pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.686803 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.686772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/98e64786-acc7-4b22-883f-f8625fe81152-must-gather-output\") pod \"must-gather-kzjjb\" (UID: \"98e64786-acc7-4b22-883f-f8625fe81152\") " pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.686953 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.686823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whhd\" (UniqueName: \"kubernetes.io/projected/98e64786-acc7-4b22-883f-f8625fe81152-kube-api-access-5whhd\") pod \"must-gather-kzjjb\" (UID: \"98e64786-acc7-4b22-883f-f8625fe81152\") " pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.687117 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.687097 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/98e64786-acc7-4b22-883f-f8625fe81152-must-gather-output\") pod \"must-gather-kzjjb\" (UID: \"98e64786-acc7-4b22-883f-f8625fe81152\") " pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.696895 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.696866 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whhd\" (UniqueName: \"kubernetes.io/projected/98e64786-acc7-4b22-883f-f8625fe81152-kube-api-access-5whhd\") pod \"must-gather-kzjjb\" (UID: \"98e64786-acc7-4b22-883f-f8625fe81152\") " pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.752953 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.752923 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hn42g/must-gather-kzjjb" Jul 28 14:16:23.878217 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.878133 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hn42g/must-gather-kzjjb"] Jul 28 14:16:23.880845 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:16:23.880816 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98e64786_acc7_4b22_883f_f8625fe81152.slice/crio-0e20fab347a21cafd27e8961e713718276b1efc9015a5ca112ebc17cb051ce94 WatchSource:0}: Error finding container 0e20fab347a21cafd27e8961e713718276b1efc9015a5ca112ebc17cb051ce94: Status 404 returned error can't find the container with id 0e20fab347a21cafd27e8961e713718276b1efc9015a5ca112ebc17cb051ce94 Jul 28 14:16:23.882700 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:23.882683 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 14:16:24.470255 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:24.470215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/must-gather-kzjjb" event={"ID":"98e64786-acc7-4b22-883f-f8625fe81152","Type":"ContainerStarted","Data":"0e20fab347a21cafd27e8961e713718276b1efc9015a5ca112ebc17cb051ce94"} Jul 28 14:16:25.475583 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:25.475546 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/must-gather-kzjjb" event={"ID":"98e64786-acc7-4b22-883f-f8625fe81152","Type":"ContainerStarted","Data":"fe2782255be20704e14d88375ff6983ac22e71f0e76538ec33c1ba8684ffdb0b"} Jul 28 14:16:25.475583 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:25.475590 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/must-gather-kzjjb" event={"ID":"98e64786-acc7-4b22-883f-f8625fe81152","Type":"ContainerStarted","Data":"26fe28fb250d5a8dbc98b647fc01f8c522d29babcc0d210ea5759026b97acc20"} Jul 28 14:16:25.492834 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:25.492773 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hn42g/must-gather-kzjjb" podStartSLOduration=1.314298926 podStartE2EDuration="2.49275092s" totalImagesPullingTime="1.178451994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:16:25.491662978 +0000 UTC m=+2038.944053523" watchObservedRunningTime="2026-07-28 14:16:25.49275092 +0000 UTC m=+2038.945141461" Jul 28 14:16:26.431992 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:26.431902 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8p8xl_52a03453-1eb2-40f8-a987-c45321d52aa5/global-pull-secret-syncer/0.log" Jul 28 14:16:26.611003 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:26.610971 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" Jul 28 14:16:26.840929 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:26.840899 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-179.ec2.internal_dc35a73c3bd937735bd26ee52ef00159/haproxy/0.log" Jul 28 14:16:28.927963 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:28.927922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:28.988602 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:28.988561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:31.037434 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:31.037391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2nh6_f8aed8e7-0947-4ff1-a479-923a2f89f3b9/node-exporter/0.log" Jul 28 14:16:31.093246 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:31.093218 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2nh6_f8aed8e7-0947-4ff1-a479-923a2f89f3b9/kube-rbac-proxy/0.log" Jul 28 14:16:31.147857 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:31.147822 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h2nh6_f8aed8e7-0947-4ff1-a479-923a2f89f3b9/init-textfile/0.log" Jul 28 14:16:33.436086 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.436047 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp"] Jul 28 14:16:33.441466 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.441442 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.455108 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.455078 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp"] Jul 28 14:16:33.569766 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.569727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-lib-modules\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.570051 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.570022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-podres\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.570180 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.570059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-sys\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.570180 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.570105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-proc\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.570305 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.570177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp4d9\" (UniqueName: \"kubernetes.io/projected/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-kube-api-access-tp4d9\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671090 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp4d9\" (UniqueName: \"kubernetes.io/projected/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-kube-api-access-tp4d9\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671291 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-lib-modules\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671291 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-podres\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671291 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671186 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-sys\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671291 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-proc\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671291 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671273 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-lib-modules\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671572 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671321 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-proc\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671572 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671329 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-sys\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.671572 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.671364 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-podres\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.680733 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.680703 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp4d9\" (UniqueName: \"kubernetes.io/projected/05f3cb44-85e2-40cd-aab5-93b7cd011a5f-kube-api-access-tp4d9\") pod \"perf-node-gather-daemonset-kkjjp\" (UID: \"05f3cb44-85e2-40cd-aab5-93b7cd011a5f\") " pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.754690 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.754658 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:33.907105 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:33.907074 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp"] Jul 28 14:16:33.912979 ip-10-0-136-179 kubenswrapper[2572]: W0728 14:16:33.912938 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05f3cb44_85e2_40cd_aab5_93b7cd011a5f.slice/crio-6ac52e816b385e352496599515c42c904b21c983dd71c424dd4f6bd635c7af1c WatchSource:0}: Error finding container 6ac52e816b385e352496599515c42c904b21c983dd71c424dd4f6bd635c7af1c: Status 404 returned error can't find the container with id 6ac52e816b385e352496599515c42c904b21c983dd71c424dd4f6bd635c7af1c Jul 28 14:16:34.354517 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:34.354489 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d584bcbd5-8hqmr_0fe4a57e-bdb9-4527-b315-18c907ccb4b5/console/0.log" Jul 28 14:16:34.518870 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:34.518836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" event={"ID":"05f3cb44-85e2-40cd-aab5-93b7cd011a5f","Type":"ContainerStarted","Data":"7606afc7ebb91edaf54fa502744015485a54dea41298a3cc1b0dfd259685fc24"} Jul 28 14:16:34.519395 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:34.518886 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" event={"ID":"05f3cb44-85e2-40cd-aab5-93b7cd011a5f","Type":"ContainerStarted","Data":"6ac52e816b385e352496599515c42c904b21c983dd71c424dd4f6bd635c7af1c"} Jul 28 14:16:34.519395 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:34.518974 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:34.542081 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:34.542020 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" podStartSLOduration=1.541996831 podStartE2EDuration="1.541996831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:16:34.541167081 +0000 UTC m=+2047.993557604" watchObservedRunningTime="2026-07-28 14:16:34.541996831 +0000 UTC m=+2047.994387373" Jul 28 14:16:35.660746 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:35.660719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5hp6_eb7ae083-40c3-4674-8c3d-e40ca40dd7c1/dns/0.log" Jul 28 14:16:35.688028 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:35.687998 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l5hp6_eb7ae083-40c3-4674-8c3d-e40ca40dd7c1/kube-rbac-proxy/0.log" Jul 28 14:16:35.852776 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:35.852749 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5kf5_5e247c04-2030-4ce6-8821-f546e39b87c2/dns-node-resolver/0.log" Jul 28 14:16:36.376970 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:36.376937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nb6lz_58ac3485-70e7-45f3-9e71-124e3633defd/node-ca/0.log" Jul 28 14:16:37.600871 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:37.600843 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hzc5l_2670bb84-7fb6-410a-9477-2a1fc51299f0/serve-healthcheck-canary/0.log" Jul 28 14:16:37.967667 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:37.967638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-6pngg_e4217eae-66e3-4276-9cef-f0c99a377bf5/insights-operator/0.log" Jul 28 14:16:37.967867 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:37.967846 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-6pngg_e4217eae-66e3-4276-9cef-f0c99a377bf5/insights-operator/1.log" Jul 28 14:16:37.989039 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:37.989015 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l52wv_fcdbc080-6e9d-437b-a805-c10fcf59e2e7/kube-rbac-proxy/0.log" Jul 28 14:16:38.011109 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:38.011084 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l52wv_fcdbc080-6e9d-437b-a805-c10fcf59e2e7/exporter/0.log" Jul 28 14:16:38.034960 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:38.034932 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l52wv_fcdbc080-6e9d-437b-a805-c10fcf59e2e7/extractor/0.log" Jul 28 14:16:40.532405 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:40.532378 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hn42g/perf-node-gather-daemonset-kkjjp" Jul 28 14:16:42.823229 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:42.823195 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-qp84g_b0481646-9b95-4647-8a3a-00ad8e556926/migrator/0.log" Jul 28 14:16:42.850741 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:42.850717 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-qp84g_b0481646-9b95-4647-8a3a-00ad8e556926/graceful-termination/0.log" Jul 28 14:16:44.412851 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.412827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/kube-multus-additional-cni-plugins/0.log" Jul 28 14:16:44.437847 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.437822 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/egress-router-binary-copy/0.log" Jul 28 14:16:44.462002 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.461944 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/cni-plugins/0.log" Jul 28 14:16:44.485987 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.485961 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/bond-cni-plugin/0.log" Jul 28 14:16:44.514217 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.514187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/routeoverride-cni/0.log" Jul 28 14:16:44.541591 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.541567 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/whereabouts-cni-bincopy/0.log" Jul 28 14:16:44.572066 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.572039 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vzjsz_3d2c6d91-7b90-46ec-87b8-54f63a2ffcbf/whereabouts-cni/0.log" Jul 28 14:16:44.681854 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.681820 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-srwmv_7b3f5fb3-2999-47cd-829c-b57d500ffa21/kube-multus/0.log" Jul 28 14:16:44.757522 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.757493 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s2q2t_d3dea567-3dc4-4cc1-94dd-e4ca443b61e9/network-metrics-daemon/0.log" Jul 28 14:16:44.780703 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:44.780680 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s2q2t_d3dea567-3dc4-4cc1-94dd-e4ca443b61e9/kube-rbac-proxy/0.log" Jul 28 14:16:45.821703 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.821674 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/ovn-controller/0.log" Jul 28 14:16:45.844478 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.844446 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/ovn-acl-logging/0.log" Jul 28 14:16:45.874212 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.874187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/kube-rbac-proxy-node/0.log" Jul 28 14:16:45.906777 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.906748 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 14:16:45.927643 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.927609 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/northd/0.log" Jul 28 14:16:45.949746 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.949722 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/nbdb/0.log" Jul 28 14:16:45.972509 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:45.972486 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/sbdb/0.log" Jul 28 14:16:46.019140 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:46.019107 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nqtlw_2ddff9fd-0ea8-43de-baf9-2e29f724e637/ovnkube-controller/0.log" Jul 28 14:16:47.359740 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:47.359686 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-6pg7g_27bf234a-ac04-4f67-9c49-e850ca3f3ebe/check-endpoints/0.log" Jul 28 14:16:47.385797 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:47.385775 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4b59g_cc32c33f-234b-4b8a-af04-eaecb45a1ba5/network-check-target-container/0.log" Jul 28 14:16:47.737002 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:47.736955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ftq6j_2059b595-60f4-45e0-bc85-b974a54e70c7/konnectivity-agent/0.log" limit=1024 Jul 28 14:16:48.370279 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:48.370251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7smr4_d3fced16-1c1f-4775-af4b-e8be973fb1fb/iptables-alerter/0.log" Jul 28 14:16:49.148757 ip-10-0-136-179 kubenswrapper[2572]: I0728 14:16:49.148661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qhcfz_e46c7d99-8b7d-4c32-aaf8-e9a3eac755d5/tuned/0.log"