Jul 07 16:39:24.675342 ip-10-0-140-181 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.112473 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118722 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118734 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118739 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118743 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118746 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118749 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118751 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:39:25.167814 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118754 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118756 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118759 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118763 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118765 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118768 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118772 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118776 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118779 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118782 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118786 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118788 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118797 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118800 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118803 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118805 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118808 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118811 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118814 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118817 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:39:25.169088 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118819 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118823 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118825 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118828 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118830 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118833 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118837 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118841 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118844 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118847 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118850 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118853 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118857 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118859 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118862 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118865 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118867 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118870 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118873 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:39:25.170020 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118876 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118878 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118881 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118885 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118889 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118891 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118894 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118896 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118899 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118902 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118904 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118907 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118909 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118912 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118914 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118917 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118919 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118922 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118924 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:39:25.170650 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118927 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118931 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118934 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118937 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118940 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118943 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118946 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118948 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118952 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118955 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118958 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118960 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118963 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118965 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118967 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118970 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118972 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118975 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118977 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:39:25.171240 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118979 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118982 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118984 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118987 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118989 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118992 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.118994 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119013 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119018 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119022 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119025 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119027 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119030 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119033 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119035 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119836 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119847 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119850 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119854 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:39:25.171768 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119858 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119862 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119866 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119869 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119872 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119875 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119878 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119881 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119884 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119886 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119889 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119892 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119894 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119897 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119899 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119902 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119905 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119907 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119910 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119912 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:39:25.173352 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119915 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119917 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119920 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119922 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119924 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119927 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119929 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119932 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119934 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119937 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119940 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119942 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119944 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119947 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119950 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119953 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119956 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119959 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119961 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119963 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:39:25.173944 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119967 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119970 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119972 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119975 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119977 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119980 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119982 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119985 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119987 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119990 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119992 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119995 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.119997 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120000 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120002 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120004 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120007 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120009 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120011 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120014 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:39:25.174580 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120016 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120019 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120021 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120024 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120026 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120028 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120031 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120035 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120037 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120040 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120042 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120045 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120048 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120051 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120053 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120056 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120058 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120061 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120063 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120086 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:39:25.175179 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120090 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120093 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120096 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120099 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120103 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120106 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120109 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120113 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120116 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120118 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120121 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120124 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120126 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120129 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120132 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120479 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120484 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120487 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120490 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:39:25.175799 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120493 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120495 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120498 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120500 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120503 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120506 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120508 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120511 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120513 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120516 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120518 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120521 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120523 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120526 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120528 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120531 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120534 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120536 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120542 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120544 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:39:25.176360 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120547 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120550 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120555 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120558 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120561 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120564 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120568 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120577 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120582 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120586 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120590 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120593 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120595 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120599 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120602 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120605 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120608 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120611 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120614 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:39:25.256434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120616 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:39:25.190611 ip-10-0-140-181 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120619 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120622 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120624 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120627 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120629 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120632 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120634 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120637 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120639 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120643 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120649 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120652 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120654 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120657 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120659 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120662 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120664 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120667 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120669 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:39:25.257493 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120672 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120674 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120677 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120679 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120682 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120686 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120688 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120698 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120701 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120703 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120706 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120708 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120711 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120713 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120716 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120718 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120721 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120724 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120726 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120728 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:39:25.258434 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120731 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120733 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120736 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120740 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120742 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120745 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120747 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120750 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120752 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120754 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120757 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120761 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120763 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120765 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120768 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.120770 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120847 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120856 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120862 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120867 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:39:25.259114 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120872 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120875 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120880 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120884 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120887 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120890 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120894 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120897 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120900 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120903 2556 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120905 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120908 2556 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120911 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120914 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120918 2556 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120922 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120925 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120928 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120931 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120935 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120938 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120941 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120944 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120947 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:39:25.259862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120949 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120952 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120955 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120958 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120962 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120966 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120969 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120972 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120974 2556 flags.go:64] FLAG: --enable-server="true" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120978 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120983 2556 flags.go:64] FLAG: --event-burst="100" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120986 2556 flags.go:64] FLAG: --event-qps="50" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120988 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120991 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120994 2556 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.120998 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121000 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121004 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121007 2556 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121010 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121012 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121015 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121018 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121022 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121024 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:39:25.260681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121027 2556 flags.go:64] FLAG: --feature-gates="" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121031 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121034 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121037 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121040 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121043 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121046 2556 flags.go:64] FLAG: --help="false" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121049 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121052 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121055 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121057 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121060 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121065 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121087 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121091 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121094 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121097 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121101 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121104 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121107 2556 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121110 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121113 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121116 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121119 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:39:25.261663 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121122 2556 flags.go:64] FLAG: --lock-file="" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121125 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121128 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121131 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121136 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121139 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121143 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121146 2556 flags.go:64] FLAG: --logging-format="text" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121149 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121152 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121155 2556 flags.go:64] FLAG: --manifest-url="" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121158 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121162 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121165 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121169 2556 flags.go:64] FLAG: --max-pods="110" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121172 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121175 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121178 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121180 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121183 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121187 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121190 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121197 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121200 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121203 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:39:25.262646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121206 2556 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121209 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121215 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121218 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121221 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121224 2556 flags.go:64] FLAG: --port="10250" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121226 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121229 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0268029f9b5a3a5bd" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121233 2556 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121235 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121238 2556 flags.go:64] FLAG: --register-node="true" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121241 2556 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121245 2556 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121248 2556 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121251 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121254 2556 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121258 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121261 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121263 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121266 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121269 2556 flags.go:64] FLAG: --runonce="false" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121272 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121275 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121278 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121280 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:39:25.263714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121283 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121287 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121289 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121294 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121296 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121299 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121302 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121305 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121308 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121311 2556 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121313 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121319 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121321 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121324 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121329 2556 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121331 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121334 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121337 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121339 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121342 2556 flags.go:64] FLAG: --v="2" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121347 2556 flags.go:64] FLAG: --version="false" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121351 2556 flags.go:64] FLAG: --vmodule="" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121354 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.121358 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121482 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:39:25.264523 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121486 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121489 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121493 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121496 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121498 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121501 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121504 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121506 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121509 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121512 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121516 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121519 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121522 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121524 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121527 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121530 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121532 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121535 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121538 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:39:25.266880 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121542 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121546 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121548 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121551 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121554 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121556 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121558 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121561 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121565 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121568 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121570 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121573 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121575 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121578 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121580 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121583 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121585 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121588 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121590 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121593 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:39:25.267498 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121595 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121598 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121600 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121604 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121606 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121609 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121612 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121614 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121617 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121619 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121622 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121625 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121627 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121630 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121632 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121635 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121637 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121639 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121642 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121644 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:39:25.269599 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121648 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121651 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121653 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121655 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121658 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121661 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121663 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121666 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121668 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121671 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121673 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121676 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121678 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121680 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121684 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121689 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121692 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121695 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121698 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:39:25.270416 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121701 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121703 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121706 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121708 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121711 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121714 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121716 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121719 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121721 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121724 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121726 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121728 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121731 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121735 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121738 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121740 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121744 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121747 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121750 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:39:25.424851 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.121752 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.122338 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.129167 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.129181 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.129913 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.129920 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.129992 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.129997 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130000 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130004 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130006 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130009 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130012 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130014 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130017 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:39:25.427324 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130020 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130023 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130026 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130028 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130031 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130034 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130037 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130039 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130042 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130045 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130048 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130050 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130053 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130056 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130059 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130061 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130064 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130088 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130091 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130094 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:39:25.428083 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130098 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130100 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130103 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130106 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130108 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130111 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130113 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130116 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130118 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130121 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130123 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130126 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130128 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130131 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130134 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130136 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130139 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130141 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130146 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130150 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:39:25.428713 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130153 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130157 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130159 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130162 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130165 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130167 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130170 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130173 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130175 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130179 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130181 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130183 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130186 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130189 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130191 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130194 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130196 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130200 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130203 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:39:25.429535 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130206 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130208 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130211 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130214 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130216 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130218 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130221 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130224 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130227 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130229 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130232 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130235 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130237 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130243 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130247 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130250 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130253 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130255 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130258 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:39:25.430121 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130261 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130263 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130266 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130268 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130271 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130273 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130276 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130278 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130281 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130284 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130287 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130289 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.130294 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130419 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130425 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:39:25.430848 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130430 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130433 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130435 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130438 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130442 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130445 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130447 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130450 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130452 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130455 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130457 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130460 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130463 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130466 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130470 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130473 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130483 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130485 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130488 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:39:25.431353 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130491 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130493 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130495 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130498 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130500 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130503 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130505 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130508 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130511 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130513 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130515 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130518 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130520 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130523 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130525 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130528 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130530 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130534 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130536 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130539 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:39:25.432172 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130541 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130544 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130546 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130549 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130551 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130557 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130559 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130562 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130564 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130567 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130570 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130572 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130574 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130577 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130580 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130582 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130585 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130587 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130590 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130592 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:39:25.432776 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130595 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130598 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130600 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130603 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130606 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130610 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130612 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130615 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130618 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130622 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130625 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130627 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130629 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130632 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130634 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130637 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130639 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130643 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130646 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:39:25.433694 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130648 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130651 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130654 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130656 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130659 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130662 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130664 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130666 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130669 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130686 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130689 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130693 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130695 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130698 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130701 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130704 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130706 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130709 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:39:25.434309 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:25.130712 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.130716 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.130814 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.132691 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.134262 2556 server.go:1019] "Starting client certificate rotation" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.134360 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.135180 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.137974 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.148592 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.160415 2556 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.162880 2556 log.go:25] "Validated CRI v1 image API" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.163633 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:39:25.552355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.166634 2556 fs.go:135] Filesystem UUIDs: map[2e1e3004-f7b0-494b-b770-5e8cedaac1dc:/dev/nvme0n1p3 51c2a7a3-4871-4a72-a628-869337568f83:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 07 16:39:25.555687 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.166647 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.171428 2556 manager.go:216] Machine: {Timestamp:2026-07-07 16:39:25.170182926 +0000 UTC m=+0.353394482 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3149290 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e05c14e0724fbf75383ac8f32732 SystemUUID:ec26e05c-14e0-724f-bf75-383ac8f32732 BootID:5eccb367-f6a1-4ba8-84dd-a1cea696b93e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:bf:75:3b:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:bf:75:3b:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f4:f8:f5:95:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.171525 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.171628 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.172683 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.172722 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.172730 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-181.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:39:25.555899 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.173465 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.173475 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.173483 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.174853 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.176269 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179379 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179490 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179513 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179523 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179536 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179545 2556 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179553 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179833 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.179847 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.183150 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.184908 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.184940 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186043 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186056 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186063 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186083 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186094 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186099 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186106 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186111 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186117 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186122 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186135 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186141 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186925 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.186933 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.190036 2556 server.go:1268] "Started kubelet" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.190375 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.191376 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.191436 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.199540 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.200886 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.201288 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.204440 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-181.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:39:25.556337 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.204763 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.204765 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.204398 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-181.ec2.internal.18c00f61ce88851a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-181.ec2.internal,UID:ip-10-0-140-181.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-181.ec2.internal,},FirstTimestamp:2026-07-07 16:39:25.190014234 +0000 UTC m=+0.373225789,LastTimestamp:2026-07-07 16:39:25.190014234 +0000 UTC m=+0.373225789,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-181.ec2.internal,}" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.205800 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.206004 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.207086 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.207099 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.207101 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.207206 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.207213 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.207208 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.213919 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-frw94" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.214126 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214183 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-frw94" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.214199 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214288 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214540 2556 factory.go:55] Registering systemd factory Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214555 2556 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214786 2556 factory.go:153] Registering CRI-O factory Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214796 2556 factory.go:223] Registration of the crio container factory successfully Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214845 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214873 2556 factory.go:103] Registering Raw factory Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.214914 2556 manager.go:1196] Started watching for new ooms in manager Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.215448 2556 manager.go:349] Starting recovery of all containers Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.228262 2556 manager.go:354] Recovery completed Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.233544 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.235812 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.235837 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.235847 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.236347 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.236358 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.236372 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:39:25.558764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.236351 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.239287 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.239322 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.239341 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.239839 2556 policy_none.go:49] "None policy: Start" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.239856 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.239869 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.241236 2556 policy_none.go:47] "Start" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.289749 2556 manager.go:337] "Starting Device Plugin manager" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.289935 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.289949 2556 server.go:87] "Starting device plugin registration server" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.290162 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.290174 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.290278 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.290361 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.290374 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.290799 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.290845 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.387262 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.387303 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.387325 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.387365 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.390025 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.394037 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.394864 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.394888 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.394901 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.394929 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.403709 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.403727 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-181.ec2.internal\": node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.439936 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.489805 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal"] Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.489886 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.491580 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.491611 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.491626 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.493434 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.493568 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.559874 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.493600 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.494454 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.494477 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.494492 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.495487 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.495519 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.495532 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.497100 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.497123 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.497816 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.497841 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.497855 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.508788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72813280bf24126e5edcb5a3249c241c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal\" (UID: \"72813280bf24126e5edcb5a3249c241c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.508810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e58dd0cdc0f5405fc8099a4667ba370b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.ec2.internal\" (UID: \"e58dd0cdc0f5405fc8099a4667ba370b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.508829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72813280bf24126e5edcb5a3249c241c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal\" (UID: \"72813280bf24126e5edcb5a3249c241c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.540935 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.542944 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-181.ec2.internal\" not found" node="ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.561739 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.547617 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-181.ec2.internal\" not found" node="ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.609257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72813280bf24126e5edcb5a3249c241c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal\" (UID: \"72813280bf24126e5edcb5a3249c241c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.609280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e58dd0cdc0f5405fc8099a4667ba370b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.ec2.internal\" (UID: \"e58dd0cdc0f5405fc8099a4667ba370b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.609298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72813280bf24126e5edcb5a3249c241c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal\" (UID: \"72813280bf24126e5edcb5a3249c241c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.609335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/72813280bf24126e5edcb5a3249c241c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal\" (UID: \"72813280bf24126e5edcb5a3249c241c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.609368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72813280bf24126e5edcb5a3249c241c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal\" (UID: \"72813280bf24126e5edcb5a3249c241c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.609374 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e58dd0cdc0f5405fc8099a4667ba370b-config\") pod \"kube-apiserver-proxy-ip-10-0-140-181.ec2.internal\" (UID: \"e58dd0cdc0f5405fc8099a4667ba370b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.661960 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.641482 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.842797 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.743754 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.845804 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.845781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.845897 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.845784 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:25.851421 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:25.851402 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" Jul 07 16:39:25.947857 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:25.947824 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.050719 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.050680 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.133137 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.133042 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:39:26.133294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.133272 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:39:26.151651 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.151626 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.217531 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.217495 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:34:25 +0000 UTC" deadline="2028-02-09 21:31:28.986771237 +0000 UTC" Jul 07 16:39:26.217531 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.217523 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13972h52m2.769251745s" Jul 07 16:39:26.252163 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.252116 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.352797 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.352760 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.418026 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.418006 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:39:26.452902 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.452870 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.506331 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:26.506293 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72813280bf24126e5edcb5a3249c241c.slice/crio-8d312184adbd94fcb83740a00f3a5d022badd10199ffb463f74f164c360b862c WatchSource:0}: Error finding container 8d312184adbd94fcb83740a00f3a5d022badd10199ffb463f74f164c360b862c: Status 404 returned error can't find the container with id 8d312184adbd94fcb83740a00f3a5d022badd10199ffb463f74f164c360b862c Jul 07 16:39:26.511931 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.511912 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:39:26.553815 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.553780 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.655215 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:26.655180 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-181.ec2.internal\" not found" Jul 07 16:39:26.698011 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.697942 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:39:26.720906 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:26.720874 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58dd0cdc0f5405fc8099a4667ba370b.slice/crio-72e9268d9f4aeb749a9f677353109444fa610dca17dcb446bca84441d0dcdf00 WatchSource:0}: Error finding container 72e9268d9f4aeb749a9f677353109444fa610dca17dcb446bca84441d0dcdf00: Status 404 returned error can't find the container with id 72e9268d9f4aeb749a9f677353109444fa610dca17dcb446bca84441d0dcdf00 Jul 07 16:39:26.739291 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.739269 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:39:26.809704 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.809671 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" Jul 07 16:39:26.830866 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.830843 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:39:26.832009 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.831996 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" Jul 07 16:39:26.851935 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.851918 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:39:26.968748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:26.968669 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:39:27.182612 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.182584 2556 apiserver.go:52] "Watching apiserver" Jul 07 16:39:27.192645 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.192622 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:39:27.193715 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.193693 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zq669","kube-system/konnectivity-agent-d848s","kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4","openshift-image-registry/node-ca-cdk94","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal","openshift-multus/multus-additional-cni-plugins-j26pj","openshift-multus/multus-v6hmb","openshift-cluster-node-tuning-operator/tuned-gqb68","openshift-dns/node-resolver-wtbc6","openshift-multus/network-metrics-daemon-8gt7s","openshift-network-diagnostics/network-check-target-g6l75","openshift-network-operator/iptables-alerter-w9884","openshift-ovn-kubernetes/ovnkube-node-4mw9j"] Jul 07 16:39:27.195761 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.195740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.196954 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.196931 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.198515 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.198497 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.199939 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.199918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.201342 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.201325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.202883 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.202865 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.202955 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.202925 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.203169 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203142 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:39:27.203281 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203179 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pzj7k\"" Jul 07 16:39:27.203281 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203196 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:39:27.203281 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203248 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.203579 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203563 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:39:27.203658 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203642 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.203840 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.203821 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:39:27.204122 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.204107 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:39:27.204210 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.204106 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.204210 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.204193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tr7g2\"" Jul 07 16:39:27.204403 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.204388 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:39:27.205138 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.205107 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.205521 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.205503 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:39:27.205758 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.205739 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.206134 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.206105 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:39:27.206225 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.206142 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:39:27.206225 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.206154 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:39:27.206225 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.206206 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.206347 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.206254 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.206573 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.206555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:27.206649 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.206627 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:27.207315 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.207297 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fnvdj\"" Jul 07 16:39:27.207620 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.207598 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.207946 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.207930 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:39:27.208021 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.207946 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pkkrb\"" Jul 07 16:39:27.208076 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.207946 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.208241 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.208226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.208306 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.208290 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.208388 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.208304 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rsml7\"" Jul 07 16:39:27.209839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.209802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.209914 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.209868 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:27.210365 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.210344 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:39:27.211391 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.211372 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.212456 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.212154 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.212456 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.212237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbc8v\"" Jul 07 16:39:27.212456 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.212312 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:39:27.212456 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.212362 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.212701 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.212463 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kxz68\"" Jul 07 16:39:27.213867 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.213146 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:39:27.214978 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.214362 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9kkpq\"" Jul 07 16:39:27.215461 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.215441 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:39:27.215562 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.215475 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.215562 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.215549 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k95x9\"" Jul 07 16:39:27.215675 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.215566 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:27.216460 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.216442 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:39:27.218448 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-run\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-sys-fs\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-system-cni-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd4kd\" (UniqueName: \"kubernetes.io/projected/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-kube-api-access-xd4kd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysctl-conf\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-daemon-config\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4hz4\" (UniqueName: \"kubernetes.io/projected/706bd165-ead0-4400-9c90-bbd6e7045e67-kube-api-access-j4hz4\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-cnibin\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218665 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-kubelet\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218681 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-cni-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-cnibin\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-cni-bin\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-cni-multus\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.218964 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-etc-kubernetes\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-cni-binary-copy\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovnkube-config\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9clr\" (UniqueName: \"kubernetes.io/projected/770055d7-3c63-4c3c-8617-2e63d3e5214c-kube-api-access-r9clr\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b180eae7-efc9-4217-a331-c633e665b65d-host\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-netns\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-systemd-units\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-run-netns\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.218983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-modprobe-d\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-var-lib-kubelet\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219026 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-registration-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-cni-bin\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-slash\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-node-log\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.219642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-lib-modules\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-tmp\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4cfde5c-d2bc-45aa-92c1-17715f3826d6-agent-certs\") pod \"konnectivity-agent-d848s\" (UID: \"f4cfde5c-d2bc-45aa-92c1-17715f3826d6\") " pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76nm\" (UniqueName: \"kubernetes.io/projected/b180eae7-efc9-4217-a331-c633e665b65d-kube-api-access-x76nm\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-os-release\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-multus-certs\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219338 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-cni-netd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219361 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-env-overrides\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219384 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-tuned\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-k8s-cni-cncf-io\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219471 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-system-cni-dir\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzbk\" (UniqueName: \"kubernetes.io/projected/992d6246-04a4-4894-ab05-ae47ffc61b23-kube-api-access-bxzbk\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-host\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.220333 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zmp7\" (UniqueName: \"kubernetes.io/projected/625a886c-f29c-4007-b699-837c76793696-kube-api-access-5zmp7\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219566 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-socket-dir-parent\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219581 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-os-release\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-var-lib-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4cfde5c-d2bc-45aa-92c1-17715f3826d6-konnectivity-ca\") pod \"konnectivity-agent-d848s\" (UID: \"f4cfde5c-d2bc-45aa-92c1-17715f3826d6\") " pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-device-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/706bd165-ead0-4400-9c90-bbd6e7045e67-cni-binary-copy\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-sys\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kz7j\" (UniqueName: \"kubernetes.io/projected/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-kube-api-access-7kz7j\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-log-socket\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.220745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219947 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysconfig\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.219975 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovnkube-script-lib\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/625a886c-f29c-4007-b699-837c76793696-host-slash\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-systemd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovn-node-metrics-cert\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220068 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/625a886c-f29c-4007-b699-837c76793696-iptables-alerter-script\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-hostroot\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-socket-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b180eae7-efc9-4217-a331-c633e665b65d-serviceca\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-ovn\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-kubernetes\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.221233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysctl-d\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.221699 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-systemd\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.221699 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-kubelet\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.221699 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-conf-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.221699 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.221699 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.220370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-etc-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.223749 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.223732 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:39:27.287190 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.287158 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcblk" Jul 07 16:39:27.297601 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.297572 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcblk" Jul 07 16:39:27.308172 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.308149 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:39:27.321287 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.321396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-systemd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.321396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovn-node-metrics-cert\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.321396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/625a886c-f29c-4007-b699-837c76793696-iptables-alerter-script\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.321396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321376 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-hostroot\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-tmp-dir\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321420 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-systemd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321472 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-socket-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b180eae7-efc9-4217-a331-c633e665b65d-serviceca\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-hostroot\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-ovn\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-kubernetes\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysctl-d\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.321614 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-systemd\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-kubelet\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-conf-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-etc-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-run\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321769 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-sys-fs\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-system-cni-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321823 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd4kd\" (UniqueName: \"kubernetes.io/projected/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-kube-api-access-xd4kd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321873 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-kubelet\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321886 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysctl-conf\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321897 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-socket-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-daemon-config\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322199 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321925 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321960 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-systemd\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4hz4\" (UniqueName: \"kubernetes.io/projected/706bd165-ead0-4400-9c90-bbd6e7045e67-kube-api-access-j4hz4\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.321998 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-cnibin\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322011 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-run\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322015 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysctl-d\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-kubelet\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322055 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-kubelet\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322062 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-conf-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322184 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-cnibin\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322201 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-sys-fs\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322154 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-kubernetes\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-cni-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322240 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-run-ovn\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.322938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-etc-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-cnibin\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322288 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-cni-bin\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322301 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b180eae7-efc9-4217-a331-c633e665b65d-serviceca\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-cni-multus\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322311 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysctl-conf\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-etc-kubernetes\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-cni-binary-copy\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovnkube-config\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322381 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-system-cni-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322149 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322403 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-cnibin\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9clr\" (UniqueName: \"kubernetes.io/projected/770055d7-3c63-4c3c-8617-2e63d3e5214c-kube-api-access-r9clr\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322396 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-cni-dir\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-etc-kubernetes\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.323706 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322425 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-cni-bin\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b180eae7-efc9-4217-a331-c633e665b65d-host\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322476 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-netns\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322477 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-var-lib-cni-multus\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b180eae7-efc9-4217-a331-c633e665b65d-host\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322497 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-systemd-units\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-run-netns\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322542 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-netns\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-modprobe-d\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-var-lib-kubelet\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-registration-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322623 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-modprobe-d\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322641 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-cni-bin\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322662 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-systemd-units\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-slash\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.324498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-node-log\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322725 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-slash\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-lib-modules\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-daemon-config\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322742 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-registration-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-tmp\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4cfde5c-d2bc-45aa-92c1-17715f3826d6-agent-certs\") pod \"konnectivity-agent-d848s\" (UID: \"f4cfde5c-d2bc-45aa-92c1-17715f3826d6\") " pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-cni-bin\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322804 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-var-lib-kubelet\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322822 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-lib-modules\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x76nm\" (UniqueName: \"kubernetes.io/projected/b180eae7-efc9-4217-a331-c633e665b65d-kube-api-access-x76nm\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-os-release\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-run-netns\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-multus-certs\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322930 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-cni-binary-copy\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.325355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322947 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovnkube-config\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.322996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-cni-netd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323010 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-os-release\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323014 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-node-log\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323060 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-cni-netd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323063 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-env-overrides\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-multus-certs\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-tuned\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-k8s-cni-cncf-io\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-env-overrides\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323552 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-host-run-k8s-cni-cncf-io\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323586 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.326098 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27e0fd5f-894c-48ad-96f5-ef88c5936523-kubelet-config\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-system-cni-dir\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323726 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/625a886c-f29c-4007-b699-837c76793696-iptables-alerter-script\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzbk\" (UniqueName: \"kubernetes.io/projected/992d6246-04a4-4894-ab05-ae47ffc61b23-kube-api-access-bxzbk\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323832 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-system-cni-dir\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-host\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zmp7\" (UniqueName: \"kubernetes.io/projected/625a886c-f29c-4007-b699-837c76793696-kube-api-access-5zmp7\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-socket-dir-parent\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-os-release\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-var-lib-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.323964 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-host\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4cfde5c-d2bc-45aa-92c1-17715f3826d6-konnectivity-ca\") pod \"konnectivity-agent-d848s\" (UID: \"f4cfde5c-d2bc-45aa-92c1-17715f3826d6\") " pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-device-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/706bd165-ead0-4400-9c90-bbd6e7045e67-multus-socket-dir-parent\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.326858 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/706bd165-ead0-4400-9c90-bbd6e7045e67-cni-binary-copy\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324170 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-hosts-file\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzv6s\" (UniqueName: \"kubernetes.io/projected/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-kube-api-access-xzv6s\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324297 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/992d6246-04a4-4894-ab05-ae47ffc61b23-os-release\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324320 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324358 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-var-lib-openvswitch\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324443 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/770055d7-3c63-4c3c-8617-2e63d3e5214c-device-dir\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-sys\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kz7j\" (UniqueName: \"kubernetes.io/projected/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-kube-api-access-7kz7j\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd97z\" (UniqueName: \"kubernetes.io/projected/2590fb43-7081-41d3-9e62-13443bac9092-kube-api-access-vd97z\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27e0fd5f-894c-48ad-96f5-ef88c5936523-dbus\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.327628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-log-socket\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysconfig\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324765 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4cfde5c-d2bc-45aa-92c1-17715f3826d6-konnectivity-ca\") pod \"konnectivity-agent-d848s\" (UID: \"f4cfde5c-d2bc-45aa-92c1-17715f3826d6\") " pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-sys\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovnkube-script-lib\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324923 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/625a886c-f29c-4007-b699-837c76793696-host-slash\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324968 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/625a886c-f29c-4007-b699-837c76793696-host-slash\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.324982 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/706bd165-ead0-4400-9c90-bbd6e7045e67-cni-binary-copy\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.325003 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-log-socket\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.325052 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-sysconfig\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.325307 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/992d6246-04a4-4894-ab05-ae47ffc61b23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.328390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.325591 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovnkube-script-lib\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.329090 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.326193 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-tmp\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.329090 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.326259 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-ovn-node-metrics-cert\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.329090 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.326868 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4cfde5c-d2bc-45aa-92c1-17715f3826d6-agent-certs\") pod \"konnectivity-agent-d848s\" (UID: \"f4cfde5c-d2bc-45aa-92c1-17715f3826d6\") " pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.329090 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.328285 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-etc-tuned\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.337364 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.337301 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9clr\" (UniqueName: \"kubernetes.io/projected/770055d7-3c63-4c3c-8617-2e63d3e5214c-kube-api-access-r9clr\") pod \"aws-ebs-csi-driver-node-zpwc4\" (UID: \"770055d7-3c63-4c3c-8617-2e63d3e5214c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.338929 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.338906 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:27.339036 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.338933 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:27.339036 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.338947 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:27.339179 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.339050 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:27.839016408 +0000 UTC m=+3.022227954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:27.339715 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.339684 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd4kd\" (UniqueName: \"kubernetes.io/projected/eec6a56b-27f4-47d7-9c31-a70bdfbb7997-kube-api-access-xd4kd\") pod \"ovnkube-node-4mw9j\" (UID: \"eec6a56b-27f4-47d7-9c31-a70bdfbb7997\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.340308 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.340284 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76nm\" (UniqueName: \"kubernetes.io/projected/b180eae7-efc9-4217-a331-c633e665b65d-kube-api-access-x76nm\") pod \"node-ca-cdk94\" (UID: \"b180eae7-efc9-4217-a331-c633e665b65d\") " pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.340515 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.340494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kz7j\" (UniqueName: \"kubernetes.io/projected/dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff-kube-api-access-7kz7j\") pod \"tuned-gqb68\" (UID: \"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff\") " pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.340820 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.340792 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzbk\" (UniqueName: \"kubernetes.io/projected/992d6246-04a4-4894-ab05-ae47ffc61b23-kube-api-access-bxzbk\") pod \"multus-additional-cni-plugins-j26pj\" (UID: \"992d6246-04a4-4894-ab05-ae47ffc61b23\") " pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.341975 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.341949 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zmp7\" (UniqueName: \"kubernetes.io/projected/625a886c-f29c-4007-b699-837c76793696-kube-api-access-5zmp7\") pod \"iptables-alerter-w9884\" (UID: \"625a886c-f29c-4007-b699-837c76793696\") " pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.342680 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.342652 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4hz4\" (UniqueName: \"kubernetes.io/projected/706bd165-ead0-4400-9c90-bbd6e7045e67-kube-api-access-j4hz4\") pod \"multus-v6hmb\" (UID: \"706bd165-ead0-4400-9c90-bbd6e7045e67\") " pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.393282 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.393225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" event={"ID":"e58dd0cdc0f5405fc8099a4667ba370b","Type":"ContainerStarted","Data":"72e9268d9f4aeb749a9f677353109444fa610dca17dcb446bca84441d0dcdf00"} Jul 07 16:39:27.395037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.395006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" event={"ID":"72813280bf24126e5edcb5a3249c241c","Type":"ContainerStarted","Data":"8d312184adbd94fcb83740a00f3a5d022badd10199ffb463f74f164c360b862c"} Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27e0fd5f-894c-48ad-96f5-ef88c5936523-kubelet-config\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425716 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-hosts-file\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzv6s\" (UniqueName: \"kubernetes.io/projected/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-kube-api-access-xzv6s\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd97z\" (UniqueName: \"kubernetes.io/projected/2590fb43-7081-41d3-9e62-13443bac9092-kube-api-access-vd97z\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425796 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27e0fd5f-894c-48ad-96f5-ef88c5936523-dbus\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425855 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-tmp-dir\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425987 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27e0fd5f-894c-48ad-96f5-ef88c5936523-dbus\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27e0fd5f-894c-48ad-96f5-ef88c5936523-kubelet-config\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.425990 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-hosts-file\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.426099 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.426175 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:27.926149885 +0000 UTC m=+3.109361436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.426207 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:27.426294 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.426244 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-tmp-dir\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.427212 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.426276 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:27.926259506 +0000 UTC m=+3.109471060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:27.458488 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.458465 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzv6s\" (UniqueName: \"kubernetes.io/projected/0e3cdf6b-551c-47a4-82bc-7cf707bb6276-kube-api-access-xzv6s\") pod \"node-resolver-wtbc6\" (UID: \"0e3cdf6b-551c-47a4-82bc-7cf707bb6276\") " pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.459043 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.459017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd97z\" (UniqueName: \"kubernetes.io/projected/2590fb43-7081-41d3-9e62-13443bac9092-kube-api-access-vd97z\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.506658 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.506600 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j26pj" Jul 07 16:39:27.515901 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.515877 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w9884" Jul 07 16:39:27.518961 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.518929 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992d6246_04a4_4894_ab05_ae47ffc61b23.slice/crio-c350777bd14c1bf0b23f83488a49d8a342c943366411f847cac9ab8b22c7569a WatchSource:0}: Error finding container c350777bd14c1bf0b23f83488a49d8a342c943366411f847cac9ab8b22c7569a: Status 404 returned error can't find the container with id c350777bd14c1bf0b23f83488a49d8a342c943366411f847cac9ab8b22c7569a Jul 07 16:39:27.524335 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.524312 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:27.526259 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.526235 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625a886c_f29c_4007_b699_837c76793696.slice/crio-67655a56ceabb4a41ccdf91824706ecb48ffbb5012676169af60ef0e18f3ecb2 WatchSource:0}: Error finding container 67655a56ceabb4a41ccdf91824706ecb48ffbb5012676169af60ef0e18f3ecb2: Status 404 returned error can't find the container with id 67655a56ceabb4a41ccdf91824706ecb48ffbb5012676169af60ef0e18f3ecb2 Jul 07 16:39:27.527850 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.527769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" Jul 07 16:39:27.532998 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.532978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cdk94" Jul 07 16:39:27.538765 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.538738 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec6a56b_27f4_47d7_9c31_a70bdfbb7997.slice/crio-6eb84d0fcbb0d2da39fb9cde8300a1d21879636fe22836b2d4c9bd1f0d8dc730 WatchSource:0}: Error finding container 6eb84d0fcbb0d2da39fb9cde8300a1d21879636fe22836b2d4c9bd1f0d8dc730: Status 404 returned error can't find the container with id 6eb84d0fcbb0d2da39fb9cde8300a1d21879636fe22836b2d4c9bd1f0d8dc730 Jul 07 16:39:27.539470 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.539446 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v6hmb" Jul 07 16:39:27.546094 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.546073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gqb68" Jul 07 16:39:27.550817 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.550792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:27.551337 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.551308 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770055d7_3c63_4c3c_8617_2e63d3e5214c.slice/crio-9ba80f8753828f17893075566bd88b6aa69194e4e8f4480d263c5596015d4df9 WatchSource:0}: Error finding container 9ba80f8753828f17893075566bd88b6aa69194e4e8f4480d263c5596015d4df9: Status 404 returned error can't find the container with id 9ba80f8753828f17893075566bd88b6aa69194e4e8f4480d263c5596015d4df9 Jul 07 16:39:27.557183 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.556654 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wtbc6" Jul 07 16:39:27.565308 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.565279 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd5a7884_1fa8_4bd9_b3f0_c4f46d3ad0ff.slice/crio-380be4f3e68ac4110e7811ca4b010627bcea95aa884412f17a695b9dc868a34b WatchSource:0}: Error finding container 380be4f3e68ac4110e7811ca4b010627bcea95aa884412f17a695b9dc868a34b: Status 404 returned error can't find the container with id 380be4f3e68ac4110e7811ca4b010627bcea95aa884412f17a695b9dc868a34b Jul 07 16:39:27.575325 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.575300 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cfde5c_d2bc_45aa_92c1_17715f3826d6.slice/crio-45968badbeb04d3ed5965299950b2d2fee7222fbcc7325e99bc27a9c7a4cbab8 WatchSource:0}: Error finding container 45968badbeb04d3ed5965299950b2d2fee7222fbcc7325e99bc27a9c7a4cbab8: Status 404 returned error can't find the container with id 45968badbeb04d3ed5965299950b2d2fee7222fbcc7325e99bc27a9c7a4cbab8 Jul 07 16:39:27.576610 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:39:27.576583 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3cdf6b_551c_47a4_82bc_7cf707bb6276.slice/crio-d371de0c0e0fc5d1938fe82551605f3294d57d55ffd610c990aa788cd31fc53d WatchSource:0}: Error finding container d371de0c0e0fc5d1938fe82551605f3294d57d55ffd610c990aa788cd31fc53d: Status 404 returned error can't find the container with id d371de0c0e0fc5d1938fe82551605f3294d57d55ffd610c990aa788cd31fc53d Jul 07 16:39:27.928524 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.928437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:27.928524 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.928518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:27.928752 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:27.928543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:27.928752 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928631 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:27.928752 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928695 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:27.928752 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928715 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:28.928692141 +0000 UTC m=+4.111903707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:27.928752 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928720 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:27.928752 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928747 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:27.928997 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928803 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:27.928997 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928761 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:28.928741797 +0000 UTC m=+4.111953347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:27.928997 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:27.928873 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:28.928855521 +0000 UTC m=+4.112067079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:28.300355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.300237 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:34:27 +0000 UTC" deadline="2028-03-27 11:01:31.017834572 +0000 UTC" Jul 07 16:39:28.300355 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.300295 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15090h22m2.717543759s" Jul 07 16:39:28.398988 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.398946 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqb68" event={"ID":"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff","Type":"ContainerStarted","Data":"380be4f3e68ac4110e7811ca4b010627bcea95aa884412f17a695b9dc868a34b"} Jul 07 16:39:28.401183 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.401149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6hmb" event={"ID":"706bd165-ead0-4400-9c90-bbd6e7045e67","Type":"ContainerStarted","Data":"dd7aec16e5f36383ab818777e2b1307206f7afdcc94a8febff55cbdbff791a9f"} Jul 07 16:39:28.403318 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.403282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdk94" event={"ID":"b180eae7-efc9-4217-a331-c633e665b65d","Type":"ContainerStarted","Data":"04b06d4f1e6c38915317b89f5767c740aa6e5994807c95ad5cef0980b6ab721c"} Jul 07 16:39:28.404769 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.404741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" event={"ID":"770055d7-3c63-4c3c-8617-2e63d3e5214c","Type":"ContainerStarted","Data":"9ba80f8753828f17893075566bd88b6aa69194e4e8f4480d263c5596015d4df9"} Jul 07 16:39:28.406271 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.406241 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"6eb84d0fcbb0d2da39fb9cde8300a1d21879636fe22836b2d4c9bd1f0d8dc730"} Jul 07 16:39:28.407530 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.407497 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w9884" event={"ID":"625a886c-f29c-4007-b699-837c76793696","Type":"ContainerStarted","Data":"67655a56ceabb4a41ccdf91824706ecb48ffbb5012676169af60ef0e18f3ecb2"} Jul 07 16:39:28.408713 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.408687 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerStarted","Data":"c350777bd14c1bf0b23f83488a49d8a342c943366411f847cac9ab8b22c7569a"} Jul 07 16:39:28.410238 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.410210 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d848s" event={"ID":"f4cfde5c-d2bc-45aa-92c1-17715f3826d6","Type":"ContainerStarted","Data":"45968badbeb04d3ed5965299950b2d2fee7222fbcc7325e99bc27a9c7a4cbab8"} Jul 07 16:39:28.411735 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.411704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wtbc6" event={"ID":"0e3cdf6b-551c-47a4-82bc-7cf707bb6276","Type":"ContainerStarted","Data":"d371de0c0e0fc5d1938fe82551605f3294d57d55ffd610c990aa788cd31fc53d"} Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.938078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.938158 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:28.938226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.938376 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.938439 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:30.938419712 +0000 UTC m=+6.121631262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.938887 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.938909 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.938924 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.938984 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:30.938968409 +0000 UTC m=+6.122179969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.939057 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:28.939145 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:28.939109 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:30.939082833 +0000 UTC m=+6.122294382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:29.300696 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:29.300596 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:34:27 +0000 UTC" deadline="2027-12-12 06:45:15.514618374 +0000 UTC" Jul 07 16:39:29.300696 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:29.300643 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12542h5m46.213980092s" Jul 07 16:39:29.395303 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:29.394339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:29.395303 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:29.394495 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:29.395303 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:29.394956 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:29.395303 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:29.395066 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:29.395303 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:29.395167 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:29.395303 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:29.395250 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:30.958902 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:30.958865 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:30.958902 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:30.958924 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:30.958902 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:30.958990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:30.959670 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959234 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:30.959670 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959305 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:34.959284093 +0000 UTC m=+10.142495646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:30.959796 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959729 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:30.959796 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959747 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:30.959796 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959762 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:30.959955 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959811 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:34.959793759 +0000 UTC m=+10.143005525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:30.959955 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959872 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:30.959955 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:30.959910 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:34.95989804 +0000 UTC m=+10.143109589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:31.388879 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:31.388568 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:31.388879 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:31.388707 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:31.388879 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:31.388873 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:31.389196 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:31.388994 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:31.389196 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:31.389105 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:31.389304 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:31.389193 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:33.388870 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:33.388318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:33.388870 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:33.388434 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:33.388870 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:33.388325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:33.388870 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:33.388508 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:33.388870 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:33.388325 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:33.388870 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:33.388567 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:34.989342 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:34.989297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:34.989346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:34.989382 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989453 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989478 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989524 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:42.989503886 +0000 UTC m=+18.172715442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989543 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989571 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989584 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989546 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:42.989536106 +0000 UTC m=+18.172747650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:34.989736 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:34.989644 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:42.989627255 +0000 UTC m=+18.172838810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:35.388595 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:35.388522 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:35.388745 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:35.388616 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:35.388745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:35.388668 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:35.388857 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:35.388761 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:35.388857 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:35.388778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:35.388857 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:35.388837 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:37.387813 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:37.387722 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:37.387813 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:37.387752 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:37.388297 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:37.387850 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:37.388297 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:37.387856 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:37.388297 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:37.387954 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:37.388297 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:37.388043 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:39.388876 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:39.388594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:39.389411 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:39.388943 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:39.389411 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:39.388809 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:39.389411 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:39.388713 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:39.389411 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:39.389031 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:39.389411 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:39.389170 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:39.441994 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:39.441958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" event={"ID":"e58dd0cdc0f5405fc8099a4667ba370b","Type":"ContainerStarted","Data":"617e27f0efeeb0b4e9037a0dace54ff46c39d268cb340b3b41f27c24cae42f11"} Jul 07 16:39:39.444496 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:39.444437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gqb68" event={"ID":"dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff","Type":"ContainerStarted","Data":"06618c3bb81a50187a9547e98883423c683a17e54effef210322c505617e4658"} Jul 07 16:39:39.476275 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:39.475670 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-181.ec2.internal" podStartSLOduration=12.47551249 podStartE2EDuration="12.47551249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:39.457496651 +0000 UTC m=+14.640708215" watchObservedRunningTime="2026-07-07 16:39:39.47551249 +0000 UTC m=+14.658724055" Jul 07 16:39:40.448470 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.448373 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w9884" event={"ID":"625a886c-f29c-4007-b699-837c76793696","Type":"ContainerStarted","Data":"b99c00fb39524d7752124daf25116ae21cb632d39799e90c0cede192bc15851e"} Jul 07 16:39:40.450202 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.450172 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerStarted","Data":"4309bebd57a38e97512927c0520e8fa0902ba00be01cc6447f169f49cc1ef605"} Jul 07 16:39:40.451793 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.451756 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" event={"ID":"72813280bf24126e5edcb5a3249c241c","Type":"ContainerStarted","Data":"285c130ea9c7fcffcffee8c92175feb772749f4241412030755608a02538f814"} Jul 07 16:39:40.453518 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.453447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d848s" event={"ID":"f4cfde5c-d2bc-45aa-92c1-17715f3826d6","Type":"ContainerStarted","Data":"cd898b61679e9132155af978d567a910ba763baf7fa8138ca689604d60b2f710"} Jul 07 16:39:40.455126 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.455104 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wtbc6" event={"ID":"0e3cdf6b-551c-47a4-82bc-7cf707bb6276","Type":"ContainerStarted","Data":"a67137014e3a0d9e68c26e266a5ee969dcccf32fce5395174ae9187086590070"} Jul 07 16:39:40.456641 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.456616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cdk94" event={"ID":"b180eae7-efc9-4217-a331-c633e665b65d","Type":"ContainerStarted","Data":"13b178a9e4531968dc5d3ba1a838ad154f2250a059d8227ecc83f1929bffc5d5"} Jul 07 16:39:40.458133 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.458111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" event={"ID":"770055d7-3c63-4c3c-8617-2e63d3e5214c","Type":"ContainerStarted","Data":"f9d25e5180a9db7f649469a40cdea11fd2a648c626e6d41f34983520b97b3c33"} Jul 07 16:39:40.464540 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.464504 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gqb68" podStartSLOduration=4.543740392 podStartE2EDuration="15.464491592s" totalImagesPullingTime="10.9207512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:39.47630724 +0000 UTC m=+14.659518785" watchObservedRunningTime="2026-07-07 16:39:40.464491592 +0000 UTC m=+15.647703175" Jul 07 16:39:40.478476 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.478435 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w9884" podStartSLOduration=4.516360195 podStartE2EDuration="15.47841948s" totalImagesPullingTime="10.962059285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:40.464049017 +0000 UTC m=+15.647260652" watchObservedRunningTime="2026-07-07 16:39:40.47841948 +0000 UTC m=+15.661631047" Jul 07 16:39:40.478715 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.478684 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d848s" podStartSLOduration=4.618558881 podStartE2EDuration="15.478678106s" totalImagesPullingTime="10.860119225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:40.478353443 +0000 UTC m=+15.661565010" watchObservedRunningTime="2026-07-07 16:39:40.478678106 +0000 UTC m=+15.661889670" Jul 07 16:39:40.495438 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.495381 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wtbc6" podStartSLOduration=3.611152469 podStartE2EDuration="14.495367114s" totalImagesPullingTime="10.884214645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:40.494888647 +0000 UTC m=+15.678100212" watchObservedRunningTime="2026-07-07 16:39:40.495367114 +0000 UTC m=+15.678578680" Jul 07 16:39:40.530873 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:40.530824 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cdk94" podStartSLOduration=4.674111609 podStartE2EDuration="15.530810772s" totalImagesPullingTime="10.856699163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:40.530641552 +0000 UTC m=+15.713853118" watchObservedRunningTime="2026-07-07 16:39:40.530810772 +0000 UTC m=+15.714022336" Jul 07 16:39:41.388065 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:41.387821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:41.388243 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:41.387822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:41.388243 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:41.387882 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:41.388243 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:41.388182 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:41.388420 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:41.388344 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:41.388464 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:41.388435 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:43.052126 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.052052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.052148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.052185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052218 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052267 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052273 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052339 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052351 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052279 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:59.052262604 +0000 UTC m=+34.235474164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052388 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:59.052377709 +0000 UTC m=+34.235589252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:43.052534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.052398 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:39:59.052392858 +0000 UTC m=+34.235604400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:43.388299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.388273 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:43.388467 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.388407 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:43.388825 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.388803 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:43.388939 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.388911 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:43.389003 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.388966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:43.389113 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:43.389088 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:43.466678 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.466622 2556 generic.go:356] "Generic (PLEG): container finished" podID="992d6246-04a4-4894-ab05-ae47ffc61b23" containerID="4309bebd57a38e97512927c0520e8fa0902ba00be01cc6447f169f49cc1ef605" exitCode=0 Jul 07 16:39:43.466845 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.466708 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerDied","Data":"4309bebd57a38e97512927c0520e8fa0902ba00be01cc6447f169f49cc1ef605"} Jul 07 16:39:43.469104 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.469052 2556 generic.go:356] "Generic (PLEG): container finished" podID="72813280bf24126e5edcb5a3249c241c" containerID="285c130ea9c7fcffcffee8c92175feb772749f4241412030755608a02538f814" exitCode=0 Jul 07 16:39:43.469206 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:43.469119 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" event={"ID":"72813280bf24126e5edcb5a3249c241c","Type":"ContainerDied","Data":"285c130ea9c7fcffcffee8c92175feb772749f4241412030755608a02538f814"} Jul 07 16:39:44.822694 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:44.822587 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:44.823527 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:44.823194 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:45.388429 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:45.388400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:45.388612 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:45.388479 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:45.388612 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:45.388494 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:45.388612 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:45.388598 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:45.388776 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:45.388630 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:45.388776 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:45.388705 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:46.534251 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:46.534206 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:46.534782 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:46.534346 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 16:39:46.534912 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:46.534890 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d848s" Jul 07 16:39:47.388329 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:47.388296 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:47.388329 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:47.388313 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:47.388575 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:47.388419 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:47.388575 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:47.388464 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:47.388575 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:47.388517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:47.388721 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:47.388573 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:48.052962 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.052768 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:39:48.303551 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.303467 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:39:48.052946356Z","UUID":"708e215a-092d-4180-81c0-b2c4664b5f13","Handler":null,"Name":"","Endpoint":""} Jul 07 16:39:48.305139 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.305121 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:39:48.305261 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.305162 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:39:48.482654 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.481871 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" event={"ID":"72813280bf24126e5edcb5a3249c241c","Type":"ContainerStarted","Data":"289ecdeb7415b0c08fb1c403ec679a8262a26dba36bb25484e0d8df83ea61276"} Jul 07 16:39:48.484383 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.484291 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v6hmb" event={"ID":"706bd165-ead0-4400-9c90-bbd6e7045e67","Type":"ContainerStarted","Data":"2c4a040af6748ed16b6d272917695a3474d36772db7ab3753ee865946fd0e170"} Jul 07 16:39:48.486839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.486783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" event={"ID":"770055d7-3c63-4c3c-8617-2e63d3e5214c","Type":"ContainerStarted","Data":"f35846967c43bf0ebc390d2871b90f60b0e43ddb22941f7fef92ba2a84be99f4"} Jul 07 16:39:48.495133 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.495096 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"d4c39d1e35bec697fe6387019e5bd082260bcff488a49a66edc42c340c78f38a"} Jul 07 16:39:48.495267 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.495207 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"6905b4025cfcb7ffabb79a9dd7ab22520148bc3f94966d9f28bbf4cef468b494"} Jul 07 16:39:48.495267 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.495262 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"38594c10af64c4cfcc1e2c044dacc633a45ba3e85522f30bfbd8a951236a7eda"} Jul 07 16:39:48.495380 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.495311 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"79e1879c2efb52a268873d0c83270254aa5c8a01882a68548f27ec88f84ecee0"} Jul 07 16:39:48.495380 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.495359 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"eb6b433c004e26d9bce05c589f52f0f1f71e9e53e89561348a00430413f988ab"} Jul 07 16:39:48.495486 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.495407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"eb1fcb02e914e622db600c770216c11f659bfee724c038de0a458eb1c99d4969"} Jul 07 16:39:48.499781 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.499730 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-181.ec2.internal" podStartSLOduration=21.499713916 podStartE2EDuration="21.499713916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:48.498941014 +0000 UTC m=+23.682152578" watchObservedRunningTime="2026-07-07 16:39:48.499713916 +0000 UTC m=+23.682925483" Jul 07 16:39:48.522396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:48.522359 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v6hmb" podStartSLOduration=3.46039481 podStartE2EDuration="23.522345881s" totalImagesPullingTime="20.061951071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:48.521932462 +0000 UTC m=+23.705144028" watchObservedRunningTime="2026-07-07 16:39:48.522345881 +0000 UTC m=+23.705557445" Jul 07 16:39:49.387911 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:49.387876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:49.388396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:49.387925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:49.388396 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:49.388021 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:49.388396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:49.388053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:49.388396 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:49.388216 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:49.388396 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:49.388319 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:49.499466 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:49.499430 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" event={"ID":"770055d7-3c63-4c3c-8617-2e63d3e5214c","Type":"ContainerStarted","Data":"a17e278c7a6be894c96df9327b67de1893b4abe69ea8195cbb4673846008fb49"} Jul 07 16:39:49.530380 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:49.530339 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpwc4" podStartSLOduration=4.507428593 podStartE2EDuration="24.530325409s" totalImagesPullingTime="20.022896816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:49.530236063 +0000 UTC m=+24.713447627" watchObservedRunningTime="2026-07-07 16:39:49.530325409 +0000 UTC m=+24.713536972" Jul 07 16:39:51.387898 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:51.387865 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:51.388376 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:51.387865 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:51.388376 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:51.387989 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:51.388376 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:51.388081 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:51.388376 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:51.387865 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:51.388376 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:51.388210 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:51.508554 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:51.508514 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"26df842d944009f05b5b911ab6cf8a93e3ecdfda5e29d3196ec9cd82f8e8e426"} Jul 07 16:39:53.388497 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.388306 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:53.389288 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.388305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:53.389288 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:53.388568 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:53.389288 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.388350 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:53.389288 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:53.388655 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:53.389288 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:53.388738 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:53.517203 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.517169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" event={"ID":"eec6a56b-27f4-47d7-9c31-a70bdfbb7997","Type":"ContainerStarted","Data":"ee96ad6d425d06cd8575d202155d83e310dd50209eb54363d3a261c3ffad2091"} Jul 07 16:39:53.517440 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.517402 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:53.519029 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.519005 2556 generic.go:356] "Generic (PLEG): container finished" podID="992d6246-04a4-4894-ab05-ae47ffc61b23" containerID="2bd2e6566c59e5b2562d22d0757c926ecfe369330570953d144d6f63980793ad" exitCode=0 Jul 07 16:39:53.519029 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.519034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerDied","Data":"2bd2e6566c59e5b2562d22d0757c926ecfe369330570953d144d6f63980793ad"} Jul 07 16:39:53.533601 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.533583 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:53.546200 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:53.546163 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" podStartSLOduration=8.461615376 podStartE2EDuration="28.546150496s" totalImagesPullingTime="20.08453512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:39:53.544694376 +0000 UTC m=+28.727905964" watchObservedRunningTime="2026-07-07 16:39:53.546150496 +0000 UTC m=+28.729362060" Jul 07 16:39:54.524182 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.524154 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:54.524531 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.524282 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:54.541861 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.541838 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:39:54.753152 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.753011 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gt7s"] Jul 07 16:39:54.753332 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.753159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:54.753332 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:54.753271 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:54.755574 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.755541 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zq669"] Jul 07 16:39:54.755707 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.755650 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:54.755846 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:54.755810 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:54.756192 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.756174 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g6l75"] Jul 07 16:39:54.756267 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:54.756256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:54.756384 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:54.756367 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:55.527566 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:55.527534 2556 generic.go:356] "Generic (PLEG): container finished" podID="992d6246-04a4-4894-ab05-ae47ffc61b23" containerID="c07b881d0770a912faf11ff8d1f90dc713f916fbe76dacd04adb7163eed75013" exitCode=0 Jul 07 16:39:55.528100 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:55.527615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerDied","Data":"c07b881d0770a912faf11ff8d1f90dc713f916fbe76dacd04adb7163eed75013"} Jul 07 16:39:56.388524 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:56.388490 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:56.388714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:56.388499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:56.388714 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:56.388629 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:56.388837 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:56.388716 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:56.388837 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:56.388744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:56.388837 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:56.388792 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:57.534845 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:57.534672 2556 generic.go:356] "Generic (PLEG): container finished" podID="992d6246-04a4-4894-ab05-ae47ffc61b23" containerID="2e13d0b6c188a5f98e8161933910d2f7c6863444b279b2c82ae802b3ae163bfc" exitCode=0 Jul 07 16:39:57.534845 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:57.534741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerDied","Data":"2e13d0b6c188a5f98e8161933910d2f7c6863444b279b2c82ae802b3ae163bfc"} Jul 07 16:39:58.388358 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:58.388326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:58.388358 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:58.388361 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:58.388567 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:58.388361 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:58.388567 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:58.388462 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:39:58.388567 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:58.388546 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:39:58.388719 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:58.388631 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:39:59.074797 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:59.074753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:59.074806 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.074915 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.074933 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:39:59.074930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.074946 2556 projected.go:196] Error preparing data for projected volume kube-api-access-4mbx4 for pod openshift-network-diagnostics/network-check-target-g6l75: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.074996 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4 podName:caed1878-a100-4f89-8473-0745cb6c9918 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:31.074980288 +0000 UTC m=+66.258191833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4mbx4" (UniqueName: "kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4") pod "network-check-target-g6l75" (UID: "caed1878-a100-4f89-8473-0745cb6c9918") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.074914 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.075034 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.075058 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs podName:2590fb43-7081-41d3-9e62-13443bac9092 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:31.075047057 +0000 UTC m=+66.258258599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs") pod "network-metrics-daemon-8gt7s" (UID: "2590fb43-7081-41d3-9e62-13443bac9092") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:39:59.075225 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:39:59.075089 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret podName:27e0fd5f-894c-48ad-96f5-ef88c5936523 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:31.075063821 +0000 UTC m=+66.258275368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret") pod "global-pull-secret-syncer-zq669" (UID: "27e0fd5f-894c-48ad-96f5-ef88c5936523") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:40:00.387636 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:00.387597 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:40:00.387636 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:00.387622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:40:00.387636 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:00.387634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:40:00.388178 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:00.387741 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zq669" podUID="27e0fd5f-894c-48ad-96f5-ef88c5936523" Jul 07 16:40:00.388178 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:00.387804 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6l75" podUID="caed1878-a100-4f89-8473-0745cb6c9918" Jul 07 16:40:00.388178 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:00.387899 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gt7s" podUID="2590fb43-7081-41d3-9e62-13443bac9092" Jul 07 16:40:01.014605 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.014576 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wtbc6_0e3cdf6b-551c-47a4-82bc-7cf707bb6276/dns-node-resolver/0.log" Jul 07 16:40:01.488013 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.487987 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-181.ec2.internal" event="NodeReady" Jul 07 16:40:01.488533 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.488141 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:40:01.536317 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.536286 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2mfx4"] Jul 07 16:40:01.538720 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.538700 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nz6lv"] Jul 07 16:40:01.538846 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.538799 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.541041 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.541022 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.541814 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.541798 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z577\"" Jul 07 16:40:01.542306 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.542284 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:40:01.542621 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.542293 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:40:01.543801 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.543683 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:40:01.543801 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.543694 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:40:01.543801 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.543782 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:40:01.544360 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.544336 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:40:01.544360 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.544357 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-46nj6\"" Jul 07 16:40:01.551308 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.551287 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mfx4"] Jul 07 16:40:01.558971 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.558818 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nz6lv"] Jul 07 16:40:01.563961 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.563943 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j4gsn"] Jul 07 16:40:01.565957 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.565941 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.568782 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.568764 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:40:01.568888 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.568784 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jntjt\"" Jul 07 16:40:01.569152 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.569136 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:40:01.569338 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.569325 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:40:01.576697 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.576677 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4gsn"] Jul 07 16:40:01.693352 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.693554 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693362 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.693554 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-data-volume\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.693554 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.693554 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048b3d95-c797-4d69-99b5-cfb89762a7ae-config-volume\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.693554 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048b3d95-c797-4d69-99b5-cfb89762a7ae-tmp-dir\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.693764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-crio-socket\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.693764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902b1e0c-4944-40cd-9069-da577310c4e1-cert\") pod \"ingress-canary-j4gsn\" (UID: \"902b1e0c-4944-40cd-9069-da577310c4e1\") " pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.693764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfsdf\" (UniqueName: \"kubernetes.io/projected/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-api-access-tfsdf\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.693764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6jk\" (UniqueName: \"kubernetes.io/projected/048b3d95-c797-4d69-99b5-cfb89762a7ae-kube-api-access-jt6jk\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.693764 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.693704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxc9t\" (UniqueName: \"kubernetes.io/projected/902b1e0c-4944-40cd-9069-da577310c4e1-kube-api-access-zxc9t\") pod \"ingress-canary-j4gsn\" (UID: \"902b1e0c-4944-40cd-9069-da577310c4e1\") " pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.794599 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-crio-socket\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.794760 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902b1e0c-4944-40cd-9069-da577310c4e1-cert\") pod \"ingress-canary-j4gsn\" (UID: \"902b1e0c-4944-40cd-9069-da577310c4e1\") " pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.794760 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfsdf\" (UniqueName: \"kubernetes.io/projected/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-api-access-tfsdf\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.794760 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794663 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6jk\" (UniqueName: \"kubernetes.io/projected/048b3d95-c797-4d69-99b5-cfb89762a7ae-kube-api-access-jt6jk\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.794760 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxc9t\" (UniqueName: \"kubernetes.io/projected/902b1e0c-4944-40cd-9069-da577310c4e1-kube-api-access-zxc9t\") pod \"ingress-canary-j4gsn\" (UID: \"902b1e0c-4944-40cd-9069-da577310c4e1\") " pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.794760 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.795019 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794816 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-crio-socket\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.795019 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:01.794887 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:40:01.795019 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:01.794955 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:02.294935893 +0000 UTC m=+37.478147448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : secret "insights-runtime-extractor-tls" not found Jul 07 16:40:01.795019 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.794941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.795019 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-data-volume\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:01.795080 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:01.795163 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls podName:048b3d95-c797-4d69-99b5-cfb89762a7ae nodeName:}" failed. No retries permitted until 2026-07-07 16:40:02.295144801 +0000 UTC m=+37.478356343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls") pod "dns-default-2mfx4" (UID: "048b3d95-c797-4d69-99b5-cfb89762a7ae") : secret "dns-default-metrics-tls" not found Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048b3d95-c797-4d69-99b5-cfb89762a7ae-config-volume\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795204 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048b3d95-c797-4d69-99b5-cfb89762a7ae-tmp-dir\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:01.795160 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:40:01.795371 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:01.795299 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:02.29528722 +0000 UTC m=+37.478498763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : configmap "kube-rbac-proxy" not found Jul 07 16:40:01.795651 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795467 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-data-volume\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.795651 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795495 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/048b3d95-c797-4d69-99b5-cfb89762a7ae-tmp-dir\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.795651 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.795643 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/048b3d95-c797-4d69-99b5-cfb89762a7ae-config-volume\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.799064 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.799038 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdk94_b180eae7-efc9-4217-a331-c633e665b65d/node-ca/0.log" Jul 07 16:40:01.799912 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.799877 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/902b1e0c-4944-40cd-9069-da577310c4e1-cert\") pod \"ingress-canary-j4gsn\" (UID: \"902b1e0c-4944-40cd-9069-da577310c4e1\") " pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.809371 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.809341 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfsdf\" (UniqueName: \"kubernetes.io/projected/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-api-access-tfsdf\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:01.809903 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.809875 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxc9t\" (UniqueName: \"kubernetes.io/projected/902b1e0c-4944-40cd-9069-da577310c4e1-kube-api-access-zxc9t\") pod \"ingress-canary-j4gsn\" (UID: \"902b1e0c-4944-40cd-9069-da577310c4e1\") " pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:01.811295 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.811270 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6jk\" (UniqueName: \"kubernetes.io/projected/048b3d95-c797-4d69-99b5-cfb89762a7ae-kube-api-access-jt6jk\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:01.874818 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:01.874776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4gsn" Jul 07 16:40:02.299898 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.299867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:02.299898 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.299903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:02.300204 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.299938 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:02.300204 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:02.300039 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:40:02.300204 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:02.300044 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:40:02.300204 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:02.300102 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:40:02.300204 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:02.300112 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:03.300097172 +0000 UTC m=+38.483308715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : configmap "kube-rbac-proxy" not found Jul 07 16:40:02.300442 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:02.300251 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:03.300231949 +0000 UTC m=+38.483443491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : secret "insights-runtime-extractor-tls" not found Jul 07 16:40:02.300442 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:02.300279 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls podName:048b3d95-c797-4d69-99b5-cfb89762a7ae nodeName:}" failed. No retries permitted until 2026-07-07 16:40:03.300268472 +0000 UTC m=+38.483480015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls") pod "dns-default-2mfx4" (UID: "048b3d95-c797-4d69-99b5-cfb89762a7ae") : secret "dns-default-metrics-tls" not found Jul 07 16:40:02.388286 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.388224 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:40:02.388454 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.388348 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:40:02.388454 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.388385 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:40:02.393255 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.393222 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:40:02.393975 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.393955 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:40:02.394117 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.393993 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:40:02.394825 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.394805 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5w7gr\"" Jul 07 16:40:02.394908 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.394839 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ctnwh\"" Jul 07 16:40:02.394908 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:02.394848 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:40:03.110005 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:03.109771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4gsn"] Jul 07 16:40:03.113187 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:03.113162 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902b1e0c_4944_40cd_9069_da577310c4e1.slice/crio-efc2d00efe7c063f6500637930cdb7576f6a37718d2710aaaeb357c8fdc62aa1 WatchSource:0}: Error finding container efc2d00efe7c063f6500637930cdb7576f6a37718d2710aaaeb357c8fdc62aa1: Status 404 returned error can't find the container with id efc2d00efe7c063f6500637930cdb7576f6a37718d2710aaaeb357c8fdc62aa1 Jul 07 16:40:03.308575 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:03.308459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:03.308575 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:03.308565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:03.308575 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:03.308573 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:40:03.308840 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:03.308596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:03.308840 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:03.308639 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:05.30862353 +0000 UTC m=+40.491835073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : configmap "kube-rbac-proxy" not found Jul 07 16:40:03.308840 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:03.308761 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:40:03.308840 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:03.308775 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:40:03.308840 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:03.308810 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:05.308797878 +0000 UTC m=+40.492009420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : secret "insights-runtime-extractor-tls" not found Jul 07 16:40:03.308840 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:03.308841 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls podName:048b3d95-c797-4d69-99b5-cfb89762a7ae nodeName:}" failed. No retries permitted until 2026-07-07 16:40:05.308828748 +0000 UTC m=+40.492040289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls") pod "dns-default-2mfx4" (UID: "048b3d95-c797-4d69-99b5-cfb89762a7ae") : secret "dns-default-metrics-tls" not found Jul 07 16:40:03.551253 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:03.551198 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerStarted","Data":"a31da7f286e11e1911b4ca2eb549b0c3bd0ba0abab2e85024afe453940dd76e6"} Jul 07 16:40:03.552365 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:03.552331 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4gsn" event={"ID":"902b1e0c-4944-40cd-9069-da577310c4e1","Type":"ContainerStarted","Data":"efc2d00efe7c063f6500637930cdb7576f6a37718d2710aaaeb357c8fdc62aa1"} Jul 07 16:40:04.558436 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:04.558343 2556 generic.go:356] "Generic (PLEG): container finished" podID="992d6246-04a4-4894-ab05-ae47ffc61b23" containerID="a31da7f286e11e1911b4ca2eb549b0c3bd0ba0abab2e85024afe453940dd76e6" exitCode=0 Jul 07 16:40:04.558436 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:04.558400 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerDied","Data":"a31da7f286e11e1911b4ca2eb549b0c3bd0ba0abab2e85024afe453940dd76e6"} Jul 07 16:40:05.327442 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:05.327409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:05.327442 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:05.327450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:05.327487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:05.327572 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:05.327584 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:05.327626 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:09.327612592 +0000 UTC m=+44.510824134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : configmap "kube-rbac-proxy" not found Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:05.327643 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls podName:048b3d95-c797-4d69-99b5-cfb89762a7ae nodeName:}" failed. No retries permitted until 2026-07-07 16:40:09.327634037 +0000 UTC m=+44.510845582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls") pod "dns-default-2mfx4" (UID: "048b3d95-c797-4d69-99b5-cfb89762a7ae") : secret "dns-default-metrics-tls" not found Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:05.327572 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:40:05.327686 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:05.327674 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:09.327666478 +0000 UTC m=+44.510878019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : secret "insights-runtime-extractor-tls" not found Jul 07 16:40:05.565229 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:05.565187 2556 generic.go:356] "Generic (PLEG): container finished" podID="992d6246-04a4-4894-ab05-ae47ffc61b23" containerID="7391edcdc046d48bf4b46635e90d8d0bf2edf520d01ebc60d270ab7b97ad4d2a" exitCode=0 Jul 07 16:40:05.565229 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:05.565229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerDied","Data":"7391edcdc046d48bf4b46635e90d8d0bf2edf520d01ebc60d270ab7b97ad4d2a"} Jul 07 16:40:06.570838 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:06.570585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j26pj" event={"ID":"992d6246-04a4-4894-ab05-ae47ffc61b23","Type":"ContainerStarted","Data":"26abc7d9d28bd877e3553ec802bad23d80f7b46c6e13d262b4a17a38dba37d9f"} Jul 07 16:40:06.572064 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:06.572037 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4gsn" event={"ID":"902b1e0c-4944-40cd-9069-da577310c4e1","Type":"ContainerStarted","Data":"7741f2044bb673328b0888d881684ff98086d58af876d79981721638e9b68980"} Jul 07 16:40:06.617561 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:06.617514 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j26pj" podStartSLOduration=13.598834013 podStartE2EDuration="41.617497469s" totalImagesPullingTime="28.018663456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:06.615767847 +0000 UTC m=+41.798979411" watchObservedRunningTime="2026-07-07 16:40:06.617497469 +0000 UTC m=+41.800709030" Jul 07 16:40:06.634839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:06.634793 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j4gsn" podStartSLOduration=2.492711243 podStartE2EDuration="5.634778797s" totalImagesPullingTime="3.142067554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:06.634544298 +0000 UTC m=+41.817755861" watchObservedRunningTime="2026-07-07 16:40:06.634778797 +0000 UTC m=+41.817990361" Jul 07 16:40:09.355233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:09.355184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:09.355233 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:09.355230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:09.355749 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:09.355270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:09.355749 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:09.355336 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:40:09.355749 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:09.355376 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:40:09.355749 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:09.355406 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:17.355390794 +0000 UTC m=+52.538602336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : secret "insights-runtime-extractor-tls" not found Jul 07 16:40:09.355749 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:09.355427 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm podName:7732a0a0-fcf8-4af4-8c5b-52a3fac92dde nodeName:}" failed. No retries permitted until 2026-07-07 16:40:17.355411848 +0000 UTC m=+52.538623390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nz6lv" (UID: "7732a0a0-fcf8-4af4-8c5b-52a3fac92dde") : configmap "kube-rbac-proxy" not found Jul 07 16:40:09.359570 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:09.359547 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/048b3d95-c797-4d69-99b5-cfb89762a7ae-metrics-tls\") pod \"dns-default-2mfx4\" (UID: \"048b3d95-c797-4d69-99b5-cfb89762a7ae\") " pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:09.652061 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:09.652040 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:09.785709 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:09.785679 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mfx4"] Jul 07 16:40:09.790355 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:09.790326 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048b3d95_c797_4d69_99b5_cfb89762a7ae.slice/crio-1abbef94d6dbc285b575b01e40d517a46a105d1289096fd11b963f545f9b2957 WatchSource:0}: Error finding container 1abbef94d6dbc285b575b01e40d517a46a105d1289096fd11b963f545f9b2957: Status 404 returned error can't find the container with id 1abbef94d6dbc285b575b01e40d517a46a105d1289096fd11b963f545f9b2957 Jul 07 16:40:10.583058 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:10.583017 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mfx4" event={"ID":"048b3d95-c797-4d69-99b5-cfb89762a7ae","Type":"ContainerStarted","Data":"1abbef94d6dbc285b575b01e40d517a46a105d1289096fd11b963f545f9b2957"} Jul 07 16:40:12.591354 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:12.591320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mfx4" event={"ID":"048b3d95-c797-4d69-99b5-cfb89762a7ae","Type":"ContainerStarted","Data":"96108ba409b0fef3a5be8a1be27e55b4ddbbdefa9b59602d9f1d3a9fc91f304c"} Jul 07 16:40:12.591892 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:12.591378 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mfx4" event={"ID":"048b3d95-c797-4d69-99b5-cfb89762a7ae","Type":"ContainerStarted","Data":"ff77cb72d56274497ec52ae72d7b113a61af85518ca09d440b6be5718cd7fd12"} Jul 07 16:40:12.591892 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:12.591453 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:12.611016 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:12.610970 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2mfx4" podStartSLOduration=9.913575189 podStartE2EDuration="11.610956149s" totalImagesPullingTime="1.69738096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:12.610520947 +0000 UTC m=+47.793732514" watchObservedRunningTime="2026-07-07 16:40:12.610956149 +0000 UTC m=+47.794167756" Jul 07 16:40:17.403565 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:17.403522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:17.403565 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:17.403576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:17.404144 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:17.404121 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:17.406936 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:17.406916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7732a0a0-fcf8-4af4-8c5b-52a3fac92dde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nz6lv\" (UID: \"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde\") " pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:17.458564 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:17.458541 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nz6lv" Jul 07 16:40:17.599230 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:17.598359 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nz6lv"] Jul 07 16:40:18.610571 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:18.610528 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz6lv" event={"ID":"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde","Type":"ContainerStarted","Data":"e46aba9aaf69128effabd33acf5f8fd06cb36e9d56fd1f3361eb12990d61cb78"} Jul 07 16:40:21.619879 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:21.619845 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz6lv" event={"ID":"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde","Type":"ContainerStarted","Data":"5146cbfc79d593046c918065fba55b9f542aac1ff7e0b8072b6e1ae7e4a20e81"} Jul 07 16:40:22.096557 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.096520 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8"] Jul 07 16:40:22.098515 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.098494 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz"] Jul 07 16:40:22.098645 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.098627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.100482 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.100458 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7"] Jul 07 16:40:22.100608 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.100588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.101414 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.101396 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 16:40:22.102308 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.102290 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 16:40:22.102519 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.102503 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rbmpp\"" Jul 07 16:40:22.102638 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.102621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.102849 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.102769 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 16:40:22.102849 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.102793 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 16:40:22.103223 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.103205 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 16:40:22.106714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.106694 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 16:40:22.106714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.106715 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 16:40:22.109585 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.109564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 16:40:22.109677 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.109575 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 16:40:22.110849 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.110831 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz"] Jul 07 16:40:22.115444 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.115422 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8"] Jul 07 16:40:22.119182 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.119161 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7"] Jul 07 16:40:22.141797 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.141904 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7xf2\" (UniqueName: \"kubernetes.io/projected/c3c8cf23-c376-4278-a94d-375420c35bc5-kube-api-access-s7xf2\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.141904 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-ca\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.141904 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-hub\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.142088 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.142088 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c3c8cf23-c376-4278-a94d-375420c35bc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.142088 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.141976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mz8\" (UniqueName: \"kubernetes.io/projected/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-kube-api-access-58mz8\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.142088 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.142020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/122f5e27-8cc3-4441-8dc9-31e1e4d3d34f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-765fb858d4-pfgb8\" (UID: \"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.142088 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.142044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcdjm\" (UniqueName: \"kubernetes.io/projected/122f5e27-8cc3-4441-8dc9-31e1e4d3d34f-kube-api-access-jcdjm\") pod \"managed-serviceaccount-addon-agent-765fb858d4-pfgb8\" (UID: \"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.142328 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.142190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.142328 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.142238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c8cf23-c376-4278-a94d-375420c35bc5-tmp\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.242718 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.242679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c8cf23-c376-4278-a94d-375420c35bc5-tmp\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.242718 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.242719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.242907 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.242742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7xf2\" (UniqueName: \"kubernetes.io/projected/c3c8cf23-c376-4278-a94d-375420c35bc5-kube-api-access-s7xf2\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.242949 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.242925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-ca\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.242999 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.242957 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-hub\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.242999 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.242982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.243128 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c3c8cf23-c376-4278-a94d-375420c35bc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.243128 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mz8\" (UniqueName: \"kubernetes.io/projected/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-kube-api-access-58mz8\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.243128 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243047 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c8cf23-c376-4278-a94d-375420c35bc5-tmp\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.243128 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/122f5e27-8cc3-4441-8dc9-31e1e4d3d34f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-765fb858d4-pfgb8\" (UID: \"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.243334 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcdjm\" (UniqueName: \"kubernetes.io/projected/122f5e27-8cc3-4441-8dc9-31e1e4d3d34f-kube-api-access-jcdjm\") pod \"managed-serviceaccount-addon-agent-765fb858d4-pfgb8\" (UID: \"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.243334 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.243938 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.243893 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.245716 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.245689 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-hub\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.245906 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.245886 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-ca\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.245998 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.245932 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.245998 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.245966 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c3c8cf23-c376-4278-a94d-375420c35bc5-klusterlet-config\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.245998 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.245972 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.246184 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.246161 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/122f5e27-8cc3-4441-8dc9-31e1e4d3d34f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-765fb858d4-pfgb8\" (UID: \"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.259465 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.259441 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mz8\" (UniqueName: \"kubernetes.io/projected/4247ccb3-32bf-4379-bd00-e75b5eb8ef2c-kube-api-access-58mz8\") pod \"cluster-proxy-proxy-agent-6b7847c99f-pwqr7\" (UID: \"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.264672 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.264650 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcdjm\" (UniqueName: \"kubernetes.io/projected/122f5e27-8cc3-4441-8dc9-31e1e4d3d34f-kube-api-access-jcdjm\") pod \"managed-serviceaccount-addon-agent-765fb858d4-pfgb8\" (UID: \"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.265285 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.265270 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7xf2\" (UniqueName: \"kubernetes.io/projected/c3c8cf23-c376-4278-a94d-375420c35bc5-kube-api-access-s7xf2\") pod \"klusterlet-addon-workmgr-855d689895-5kqqz\" (UID: \"c3c8cf23-c376-4278-a94d-375420c35bc5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.418178 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.418159 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" Jul 07 16:40:22.429389 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.429362 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:22.458398 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.458193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" Jul 07 16:40:22.558940 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.558913 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8"] Jul 07 16:40:22.568815 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:22.568790 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod122f5e27_8cc3_4441_8dc9_31e1e4d3d34f.slice/crio-cf44629edf8c18c71a44644974ae47ee9b3b0e8fe3bb5309821c7449411fae8f WatchSource:0}: Error finding container cf44629edf8c18c71a44644974ae47ee9b3b0e8fe3bb5309821c7449411fae8f: Status 404 returned error can't find the container with id cf44629edf8c18c71a44644974ae47ee9b3b0e8fe3bb5309821c7449411fae8f Jul 07 16:40:22.585919 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.585886 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz"] Jul 07 16:40:22.588329 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:22.588285 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c8cf23_c376_4278_a94d_375420c35bc5.slice/crio-4709804ce6f4f3035b8ee4890bbb0a5de81caf3b1b54ba10cd7deb0e38ba4d07 WatchSource:0}: Error finding container 4709804ce6f4f3035b8ee4890bbb0a5de81caf3b1b54ba10cd7deb0e38ba4d07: Status 404 returned error can't find the container with id 4709804ce6f4f3035b8ee4890bbb0a5de81caf3b1b54ba10cd7deb0e38ba4d07 Jul 07 16:40:22.595162 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.595143 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2mfx4" Jul 07 16:40:22.605351 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.605329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7"] Jul 07 16:40:22.607525 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:22.607503 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4247ccb3_32bf_4379_bd00_e75b5eb8ef2c.slice/crio-5bd6f26693c8794b5bf10a869da04020b8d09f7e85809717e2638c2f6a65fdda WatchSource:0}: Error finding container 5bd6f26693c8794b5bf10a869da04020b8d09f7e85809717e2638c2f6a65fdda: Status 404 returned error can't find the container with id 5bd6f26693c8794b5bf10a869da04020b8d09f7e85809717e2638c2f6a65fdda Jul 07 16:40:22.624493 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.624467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" event={"ID":"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f","Type":"ContainerStarted","Data":"cf44629edf8c18c71a44644974ae47ee9b3b0e8fe3bb5309821c7449411fae8f"} Jul 07 16:40:22.625662 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.625637 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" event={"ID":"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c","Type":"ContainerStarted","Data":"5bd6f26693c8794b5bf10a869da04020b8d09f7e85809717e2638c2f6a65fdda"} Jul 07 16:40:22.627034 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.626998 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" event={"ID":"c3c8cf23-c376-4278-a94d-375420c35bc5","Type":"ContainerStarted","Data":"4709804ce6f4f3035b8ee4890bbb0a5de81caf3b1b54ba10cd7deb0e38ba4d07"} Jul 07 16:40:22.629189 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:22.629167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz6lv" event={"ID":"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde","Type":"ContainerStarted","Data":"032826a26c924833b29bda8202456c5ce0b3ac2ee68b39b8a639390fc1904834"} Jul 07 16:40:26.540383 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:26.540356 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mw9j" Jul 07 16:40:29.657688 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.657641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" event={"ID":"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c","Type":"ContainerStarted","Data":"e7269c1a9e4bbe5099ad79259aee0b1958858b2c82135a35813c3aa2239b6c9b"} Jul 07 16:40:29.658181 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.657698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" event={"ID":"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c","Type":"ContainerStarted","Data":"844ce34413ac05bb20998b8415580c0f48ef6a4d179e94201ca90c8883216e83"} Jul 07 16:40:29.658181 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.657719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" event={"ID":"4247ccb3-32bf-4379-bd00-e75b5eb8ef2c","Type":"ContainerStarted","Data":"32d8f11d660b3384507434a10dfc4032da7eb78c1fc5a15999b83fc39884c5a7"} Jul 07 16:40:29.659208 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.659185 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" event={"ID":"c3c8cf23-c376-4278-a94d-375420c35bc5","Type":"ContainerStarted","Data":"dad057d25df8a43a202688b570a87b90731a22751da49691a1eb0e7e520aec76"} Jul 07 16:40:29.659396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.659383 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:29.661226 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.661204 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" Jul 07 16:40:29.661460 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.661428 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nz6lv" event={"ID":"7732a0a0-fcf8-4af4-8c5b-52a3fac92dde","Type":"ContainerStarted","Data":"26948c56830792a1fa9801a9f81235d190f2ebf50f8ae7561aee0e96e04b5867"} Jul 07 16:40:29.662903 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.662884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" event={"ID":"122f5e27-8cc3-4441-8dc9-31e1e4d3d34f","Type":"ContainerStarted","Data":"a8feae170c7f0921705e7a876e28833c8d5d2054197b24b76b3bafea85878e5b"} Jul 07 16:40:29.679708 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.679667 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7847c99f-pwqr7" podStartSLOduration=1.121875231 podStartE2EDuration="7.67965554s" totalImagesPullingTime="6.557780309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:29.678194399 +0000 UTC m=+64.861405964" watchObservedRunningTime="2026-07-07 16:40:29.67965554 +0000 UTC m=+64.862867082" Jul 07 16:40:29.695562 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.695522 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-765fb858d4-pfgb8" podStartSLOduration=1.091031907 podStartE2EDuration="7.695508829s" totalImagesPullingTime="6.604476922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:29.694778672 +0000 UTC m=+64.877990231" watchObservedRunningTime="2026-07-07 16:40:29.695508829 +0000 UTC m=+64.878720411" Jul 07 16:40:29.714272 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.714222 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-855d689895-5kqqz" podStartSLOduration=1.137217241 podStartE2EDuration="7.714212014s" totalImagesPullingTime="6.576994773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:29.714127866 +0000 UTC m=+64.897339431" watchObservedRunningTime="2026-07-07 16:40:29.714212014 +0000 UTC m=+64.897423579" Jul 07 16:40:29.737787 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:29.737747 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nz6lv" podStartSLOduration=17.309474178 podStartE2EDuration="28.737735209s" totalImagesPullingTime="11.428261031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:40:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:29.73699318 +0000 UTC m=+64.920204745" watchObservedRunningTime="2026-07-07 16:40:29.737735209 +0000 UTC m=+64.920946813" Jul 07 16:40:31.118110 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.118050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:40:31.118110 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.118116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:40:31.118610 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.118149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:40:31.121254 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.121233 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:40:31.122560 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.122541 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:40:31.122619 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.122586 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:40:31.130860 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.130837 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2590fb43-7081-41d3-9e62-13443bac9092-metrics-certs\") pod \"network-metrics-daemon-8gt7s\" (UID: \"2590fb43-7081-41d3-9e62-13443bac9092\") " pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:40:31.130956 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.130865 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27e0fd5f-894c-48ad-96f5-ef88c5936523-original-pull-secret\") pod \"global-pull-secret-syncer-zq669\" (UID: \"27e0fd5f-894c-48ad-96f5-ef88c5936523\") " pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:40:31.131259 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.131233 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:40:31.140590 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.140571 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mbx4\" (UniqueName: \"kubernetes.io/projected/caed1878-a100-4f89-8473-0745cb6c9918-kube-api-access-4mbx4\") pod \"network-check-target-g6l75\" (UID: \"caed1878-a100-4f89-8473-0745cb6c9918\") " pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:40:31.200746 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.200717 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zq669" Jul 07 16:40:31.210565 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.210433 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ctnwh\"" Jul 07 16:40:31.216612 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.216588 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5w7gr\"" Jul 07 16:40:31.218692 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.218663 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:40:31.224901 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.224880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gt7s" Jul 07 16:40:31.346522 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.346487 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zq669"] Jul 07 16:40:31.353279 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:31.353234 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e0fd5f_894c_48ad_96f5_ef88c5936523.slice/crio-b3c9f3a756513299e9e1d3088e3b7210a3af0dc61c57737a8be52df37daef504 WatchSource:0}: Error finding container b3c9f3a756513299e9e1d3088e3b7210a3af0dc61c57737a8be52df37daef504: Status 404 returned error can't find the container with id b3c9f3a756513299e9e1d3088e3b7210a3af0dc61c57737a8be52df37daef504 Jul 07 16:40:31.372466 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.372441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g6l75"] Jul 07 16:40:31.374611 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:31.374587 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaed1878_a100_4f89_8473_0745cb6c9918.slice/crio-8ccbe97461a3e9798a7698c65297b29a459761e01f5695b308833f881389c729 WatchSource:0}: Error finding container 8ccbe97461a3e9798a7698c65297b29a459761e01f5695b308833f881389c729: Status 404 returned error can't find the container with id 8ccbe97461a3e9798a7698c65297b29a459761e01f5695b308833f881389c729 Jul 07 16:40:31.394979 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:31.394953 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2590fb43_7081_41d3_9e62_13443bac9092.slice/crio-26af37827a92081df0b254e5b5715ec554ec58fca9aaecf88cd2d32281e9e3cc WatchSource:0}: Error finding container 26af37827a92081df0b254e5b5715ec554ec58fca9aaecf88cd2d32281e9e3cc: Status 404 returned error can't find the container with id 26af37827a92081df0b254e5b5715ec554ec58fca9aaecf88cd2d32281e9e3cc Jul 07 16:40:31.395236 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.395220 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gt7s"] Jul 07 16:40:31.671032 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.670995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zq669" event={"ID":"27e0fd5f-894c-48ad-96f5-ef88c5936523","Type":"ContainerStarted","Data":"b3c9f3a756513299e9e1d3088e3b7210a3af0dc61c57737a8be52df37daef504"} Jul 07 16:40:31.672232 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.672198 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g6l75" event={"ID":"caed1878-a100-4f89-8473-0745cb6c9918","Type":"ContainerStarted","Data":"8ccbe97461a3e9798a7698c65297b29a459761e01f5695b308833f881389c729"} Jul 07 16:40:31.673366 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:31.673338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gt7s" event={"ID":"2590fb43-7081-41d3-9e62-13443bac9092","Type":"ContainerStarted","Data":"26af37827a92081df0b254e5b5715ec554ec58fca9aaecf88cd2d32281e9e3cc"} Jul 07 16:40:33.685635 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:33.685599 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gt7s" event={"ID":"2590fb43-7081-41d3-9e62-13443bac9092","Type":"ContainerStarted","Data":"506e0328683f33b5cd05a9e76d217c91320fd52909d2cf643640ee520bb8fdad"} Jul 07 16:40:33.686125 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:33.685663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gt7s" event={"ID":"2590fb43-7081-41d3-9e62-13443bac9092","Type":"ContainerStarted","Data":"e06ebfc57eaec22a1b92a28f5a8932011ec0c70c4972c4494371f1435f44f0de"} Jul 07 16:40:33.705732 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:33.705664 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8gt7s" podStartSLOduration=67.131948211 podStartE2EDuration="1m8.705641883s" totalImagesPullingTime="1.573693672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:33.704088423 +0000 UTC m=+68.887299982" watchObservedRunningTime="2026-07-07 16:40:33.705641883 +0000 UTC m=+68.888853454" Jul 07 16:40:36.696828 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:36.696789 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zq669" event={"ID":"27e0fd5f-894c-48ad-96f5-ef88c5936523","Type":"ContainerStarted","Data":"2330767accd530a295fb77c8f3c8b0f7bde9a673d33e093db95e1220de4a1c3b"} Jul 07 16:40:36.698304 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:36.698279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g6l75" event={"ID":"caed1878-a100-4f89-8473-0745cb6c9918","Type":"ContainerStarted","Data":"f848f0400ae2bbba9adcc26f820ce46fc715b5795fbd35ee6f95ebbbfd54eb0b"} Jul 07 16:40:36.698448 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:36.698414 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:40:36.718581 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:36.718538 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zq669" podStartSLOduration=66.02989262 podStartE2EDuration="1m10.718524565s" totalImagesPullingTime="4.688631945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:36.717374677 +0000 UTC m=+71.900586241" watchObservedRunningTime="2026-07-07 16:40:36.718524565 +0000 UTC m=+71.901736126" Jul 07 16:40:36.738447 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:36.738405 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g6l75" podStartSLOduration=67.071395288 podStartE2EDuration="1m11.738392104s" totalImagesPullingTime="4.666996816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:36.73683291 +0000 UTC m=+71.920044471" watchObservedRunningTime="2026-07-07 16:40:36.738392104 +0000 UTC m=+71.921603668" Jul 07 16:40:46.376643 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.376613 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8xz5w"] Jul 07 16:40:46.378832 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.378816 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.381642 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.381612 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:40:46.381772 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.381751 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:40:46.382202 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.382184 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:40:46.383103 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.383061 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:40:46.383207 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.383189 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:40:46.383280 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.383196 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:40:46.383335 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.383293 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-njbxr\"" Jul 07 16:40:46.423726 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-root\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.423839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-textfile\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.423839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.423839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngtlx\" (UniqueName: \"kubernetes.io/projected/19429615-c998-4b1f-9992-bca6f0d630b8-kube-api-access-ngtlx\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.423936 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.423936 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19429615-c998-4b1f-9992-bca6f0d630b8-metrics-client-ca\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.423936 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-sys\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.424026 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.424026 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.423956 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-wtmp\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525014 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.524984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-wtmp\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525014 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-root\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525049 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-textfile\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngtlx\" (UniqueName: \"kubernetes.io/projected/19429615-c998-4b1f-9992-bca6f0d630b8-kube-api-access-ngtlx\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525122 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-root\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19429615-c998-4b1f-9992-bca6f0d630b8-metrics-client-ca\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525189 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-wtmp\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-sys\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525299 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:46.525273 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:40:46.525748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525336 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19429615-c998-4b1f-9992-bca6f0d630b8-sys\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525748 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:46.525443 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls podName:19429615-c998-4b1f-9992-bca6f0d630b8 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:47.025421366 +0000 UTC m=+82.208632911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls") pod "node-exporter-8xz5w" (UID: "19429615-c998-4b1f-9992-bca6f0d630b8") : secret "node-exporter-tls" not found Jul 07 16:40:46.525748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525470 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-textfile\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525710 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.525748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.525728 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19429615-c998-4b1f-9992-bca6f0d630b8-metrics-client-ca\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.527631 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.527611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:46.534566 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:46.534545 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngtlx\" (UniqueName: \"kubernetes.io/projected/19429615-c998-4b1f-9992-bca6f0d630b8-kube-api-access-ngtlx\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:47.028773 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:47.028644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:47.028773 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:47.028774 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:40:47.028996 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:40:47.028836 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls podName:19429615-c998-4b1f-9992-bca6f0d630b8 nodeName:}" failed. No retries permitted until 2026-07-07 16:40:48.028821331 +0000 UTC m=+83.212032873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls") pod "node-exporter-8xz5w" (UID: "19429615-c998-4b1f-9992-bca6f0d630b8") : secret "node-exporter-tls" not found Jul 07 16:40:48.037791 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:48.037758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:48.039987 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:48.039955 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19429615-c998-4b1f-9992-bca6f0d630b8-node-exporter-tls\") pod \"node-exporter-8xz5w\" (UID: \"19429615-c998-4b1f-9992-bca6f0d630b8\") " pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:48.188151 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:48.188110 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8xz5w" Jul 07 16:40:48.200754 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:40:48.200727 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19429615_c998_4b1f_9992_bca6f0d630b8.slice/crio-48869555fe45b399bbc2690c93e9bb8818a7e35a4182229e28701a3b7ed29743 WatchSource:0}: Error finding container 48869555fe45b399bbc2690c93e9bb8818a7e35a4182229e28701a3b7ed29743: Status 404 returned error can't find the container with id 48869555fe45b399bbc2690c93e9bb8818a7e35a4182229e28701a3b7ed29743 Jul 07 16:40:48.741025 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:48.740988 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8xz5w" event={"ID":"19429615-c998-4b1f-9992-bca6f0d630b8","Type":"ContainerStarted","Data":"48869555fe45b399bbc2690c93e9bb8818a7e35a4182229e28701a3b7ed29743"} Jul 07 16:40:49.745828 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:49.745797 2556 generic.go:356] "Generic (PLEG): container finished" podID="19429615-c998-4b1f-9992-bca6f0d630b8" containerID="5b155d0b3e56ba36170135e4510a40fa1f8557847f9829b25f82499964a1a615" exitCode=0 Jul 07 16:40:49.746221 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:49.745858 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8xz5w" event={"ID":"19429615-c998-4b1f-9992-bca6f0d630b8","Type":"ContainerDied","Data":"5b155d0b3e56ba36170135e4510a40fa1f8557847f9829b25f82499964a1a615"} Jul 07 16:40:50.751862 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:50.751826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8xz5w" event={"ID":"19429615-c998-4b1f-9992-bca6f0d630b8","Type":"ContainerStarted","Data":"ae2ceffbd9bac86a5d29d7a47dcc2137146e864baa579f2cc103315f4129a07f"} Jul 07 16:40:50.752324 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:50.751883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8xz5w" event={"ID":"19429615-c998-4b1f-9992-bca6f0d630b8","Type":"ContainerStarted","Data":"31424d224c3a0983b6a325acf18c9a7130e5f8baa3fe543429816c100bd8b13c"} Jul 07 16:40:50.775396 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:40:50.775342 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8xz5w" podStartSLOduration=3.660402125 podStartE2EDuration="4.775326187s" totalImagesPullingTime="1.052692672s" totalInitContainerRuntime="62.23139ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:40:50.773902602 +0000 UTC m=+85.957114168" watchObservedRunningTime="2026-07-07 16:40:50.775326187 +0000 UTC m=+85.958537750" Jul 07 16:41:07.704360 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:41:07.704330 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g6l75" Jul 07 16:44:25.217946 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:44:25.217911 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:50:15.393490 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.393421 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-rbnlg"] Jul 07 16:50:15.395256 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.395235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:50:15.399500 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.399477 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-t6hpr\"" Jul 07 16:50:15.400798 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.400776 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 07 16:50:15.400892 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.400778 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 07 16:50:15.412878 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.412855 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rbnlg"] Jul 07 16:50:15.461404 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.461377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prgbn\" (UniqueName: \"kubernetes.io/projected/f8e5e4bc-b72f-4e3c-8829-973a9780cd88-kube-api-access-prgbn\") pod \"redis-69bbd798b6-rbnlg\" (UID: \"f8e5e4bc-b72f-4e3c-8829-973a9780cd88\") " pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:50:15.562358 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.562326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prgbn\" (UniqueName: \"kubernetes.io/projected/f8e5e4bc-b72f-4e3c-8829-973a9780cd88-kube-api-access-prgbn\") pod \"redis-69bbd798b6-rbnlg\" (UID: \"f8e5e4bc-b72f-4e3c-8829-973a9780cd88\") " pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:50:15.571402 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.571377 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prgbn\" (UniqueName: \"kubernetes.io/projected/f8e5e4bc-b72f-4e3c-8829-973a9780cd88-kube-api-access-prgbn\") pod \"redis-69bbd798b6-rbnlg\" (UID: \"f8e5e4bc-b72f-4e3c-8829-973a9780cd88\") " pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:50:15.703737 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.703653 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:50:15.822424 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.822395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rbnlg"] Jul 07 16:50:15.825724 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:50:15.825695 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8e5e4bc_b72f_4e3c_8829_973a9780cd88.slice/crio-c29ec2e10796457d252d8ab89390ab4d47ef0cf0a7391b1008400a78e3274063 WatchSource:0}: Error finding container c29ec2e10796457d252d8ab89390ab4d47ef0cf0a7391b1008400a78e3274063: Status 404 returned error can't find the container with id c29ec2e10796457d252d8ab89390ab4d47ef0cf0a7391b1008400a78e3274063 Jul 07 16:50:15.827402 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:15.827385 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:50:16.495895 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:16.495865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rbnlg" event={"ID":"f8e5e4bc-b72f-4e3c-8829-973a9780cd88","Type":"ContainerStarted","Data":"c29ec2e10796457d252d8ab89390ab4d47ef0cf0a7391b1008400a78e3274063"} Jul 07 16:50:17.499886 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:17.499799 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rbnlg" event={"ID":"f8e5e4bc-b72f-4e3c-8829-973a9780cd88","Type":"ContainerStarted","Data":"ca8d9ac5def6fd463b3c9a4aa2d2befab3dc4ddc54a34beef544bc6905e95fc7"} Jul 07 16:50:17.516390 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:50:17.516347 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-rbnlg" podStartSLOduration=1.126591789 podStartE2EDuration="2.5163317s" totalImagesPullingTime="1.389739911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:17.516137422 +0000 UTC m=+652.699348987" watchObservedRunningTime="2026-07-07 16:50:17.5163317 +0000 UTC m=+652.699543242" Jul 07 16:51:52.645211 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:52.645173 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rbnlg"] Jul 07 16:51:52.645648 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:52.645364 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-rbnlg" podUID="f8e5e4bc-b72f-4e3c-8829-973a9780cd88" containerName="redis" containerID="cri-o://ca8d9ac5def6fd463b3c9a4aa2d2befab3dc4ddc54a34beef544bc6905e95fc7" gracePeriod=30 Jul 07 16:51:52.790850 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:52.790820 2556 generic.go:356] "Generic (PLEG): container finished" podID="f8e5e4bc-b72f-4e3c-8829-973a9780cd88" containerID="ca8d9ac5def6fd463b3c9a4aa2d2befab3dc4ddc54a34beef544bc6905e95fc7" exitCode=0 Jul 07 16:51:52.790984 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:52.790865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rbnlg" event={"ID":"f8e5e4bc-b72f-4e3c-8829-973a9780cd88","Type":"ContainerDied","Data":"ca8d9ac5def6fd463b3c9a4aa2d2befab3dc4ddc54a34beef544bc6905e95fc7"} Jul 07 16:51:52.879814 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:52.879788 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:51:53.005646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.005552 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prgbn\" (UniqueName: \"kubernetes.io/projected/f8e5e4bc-b72f-4e3c-8829-973a9780cd88-kube-api-access-prgbn\") pod \"f8e5e4bc-b72f-4e3c-8829-973a9780cd88\" (UID: \"f8e5e4bc-b72f-4e3c-8829-973a9780cd88\") " Jul 07 16:51:53.007650 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.007614 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e5e4bc-b72f-4e3c-8829-973a9780cd88-kube-api-access-prgbn" (OuterVolumeSpecName: "kube-api-access-prgbn") pod "f8e5e4bc-b72f-4e3c-8829-973a9780cd88" (UID: "f8e5e4bc-b72f-4e3c-8829-973a9780cd88"). InnerVolumeSpecName "kube-api-access-prgbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:51:53.106120 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.106053 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prgbn\" (UniqueName: \"kubernetes.io/projected/f8e5e4bc-b72f-4e3c-8829-973a9780cd88-kube-api-access-prgbn\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:51:53.795295 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.795217 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rbnlg" Jul 07 16:51:53.795646 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.795217 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rbnlg" event={"ID":"f8e5e4bc-b72f-4e3c-8829-973a9780cd88","Type":"ContainerDied","Data":"c29ec2e10796457d252d8ab89390ab4d47ef0cf0a7391b1008400a78e3274063"} Jul 07 16:51:53.796131 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.796111 2556 scope.go:117] "RemoveContainer" containerID="ca8d9ac5def6fd463b3c9a4aa2d2befab3dc4ddc54a34beef544bc6905e95fc7" Jul 07 16:51:53.812476 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.812455 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rbnlg"] Jul 07 16:51:53.816383 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:53.816359 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rbnlg"] Jul 07 16:51:55.392985 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:51:55.392957 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e5e4bc-b72f-4e3c-8829-973a9780cd88" path="/var/lib/kubelet/pods/f8e5e4bc-b72f-4e3c-8829-973a9780cd88/volumes" Jul 07 16:57:19.882372 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.882296 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m"] Jul 07 16:57:19.882797 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.882583 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e5e4bc-b72f-4e3c-8829-973a9780cd88" containerName="redis" Jul 07 16:57:19.882797 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.882596 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e5e4bc-b72f-4e3c-8829-973a9780cd88" containerName="redis" Jul 07 16:57:19.882797 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.882635 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e5e4bc-b72f-4e3c-8829-973a9780cd88" containerName="redis" Jul 07 16:57:19.885271 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.885255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:19.888239 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.888213 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 07 16:57:19.889476 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.889459 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-flzp9\"" Jul 07 16:57:19.889605 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.889501 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 07 16:57:19.901391 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:19.901370 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m"] Jul 07 16:57:20.066386 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.066351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7gqd\" (UniqueName: \"kubernetes.io/projected/e566d3d9-2b65-4494-b663-93017d0f24db-kube-api-access-s7gqd\") pod \"feast-operator-controller-manager-7cb4c6bbd6-9767m\" (UID: \"e566d3d9-2b65-4494-b663-93017d0f24db\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:20.167447 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.167406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7gqd\" (UniqueName: \"kubernetes.io/projected/e566d3d9-2b65-4494-b663-93017d0f24db-kube-api-access-s7gqd\") pod \"feast-operator-controller-manager-7cb4c6bbd6-9767m\" (UID: \"e566d3d9-2b65-4494-b663-93017d0f24db\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:20.178995 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.178970 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7gqd\" (UniqueName: \"kubernetes.io/projected/e566d3d9-2b65-4494-b663-93017d0f24db-kube-api-access-s7gqd\") pod \"feast-operator-controller-manager-7cb4c6bbd6-9767m\" (UID: \"e566d3d9-2b65-4494-b663-93017d0f24db\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:20.194963 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.194940 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:20.317322 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.317294 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m"] Jul 07 16:57:20.320233 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:57:20.320208 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode566d3d9_2b65_4494_b663_93017d0f24db.slice/crio-494d1668315b56343b6646f2d56f114e6b24e522390ca11735d4130ba17f4c27 WatchSource:0}: Error finding container 494d1668315b56343b6646f2d56f114e6b24e522390ca11735d4130ba17f4c27: Status 404 returned error can't find the container with id 494d1668315b56343b6646f2d56f114e6b24e522390ca11735d4130ba17f4c27 Jul 07 16:57:20.322093 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.322062 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:57:20.797166 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:20.797136 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" event={"ID":"e566d3d9-2b65-4494-b663-93017d0f24db","Type":"ContainerStarted","Data":"494d1668315b56343b6646f2d56f114e6b24e522390ca11735d4130ba17f4c27"} Jul 07 16:57:22.805354 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:22.805273 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" event={"ID":"e566d3d9-2b65-4494-b663-93017d0f24db","Type":"ContainerStarted","Data":"a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d"} Jul 07 16:57:22.805354 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:22.805348 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:22.825849 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:22.825807 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" podStartSLOduration=1.7538062700000001 podStartE2EDuration="3.825793281s" totalImagesPullingTime="2.071987011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:57:22.82469794 +0000 UTC m=+1078.007909504" watchObservedRunningTime="2026-07-07 16:57:22.825793281 +0000 UTC m=+1078.009004844" Jul 07 16:57:33.810668 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:33.810636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 16:57:34.618634 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.618599 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447"] Jul 07 16:57:34.622545 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.622529 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.626628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.626606 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 07 16:57:34.626748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.626657 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 07 16:57:34.626748 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.626686 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 07 16:57:34.626842 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.626750 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-njvtw\"" Jul 07 16:57:34.627093 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.627061 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 07 16:57:34.627304 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.627291 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 07 16:57:34.628112 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.628092 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 07 16:57:34.637714 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.637691 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447"] Jul 07 16:57:34.761478 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.761452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.761593 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.761484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.761593 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.761516 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lt65\" (UniqueName: \"kubernetes.io/projected/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-kube-api-access-4lt65\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.761593 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.761540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.761745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.761609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.761745 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.761647 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.862679 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.862659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.862688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.862711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.862741 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lt65\" (UniqueName: \"kubernetes.io/projected/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-kube-api-access-4lt65\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:57:34.862796 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.862849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:57:34.862865 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls podName:6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3 nodeName:}" failed. No retries permitted until 2026-07-07 16:57:35.362845292 +0000 UTC m=+1090.546056838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls") pod "feast-simple-feast-setup-796bc5bb56-qg447" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3") : secret "feast-simple-feast-setup-offline-tls" not found Jul 07 16:57:34.863037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.862903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.863411 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.863244 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.865254 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.865228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.865353 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.865304 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.865424 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.865406 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:34.873605 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:34.873555 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lt65\" (UniqueName: \"kubernetes.io/projected/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-kube-api-access-4lt65\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:35.366042 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:35.366005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:35.368482 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:35.368458 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-qg447\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:35.531410 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:35.531381 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:57:35.658559 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:35.658534 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447"] Jul 07 16:57:35.659171 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:57:35.659148 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a9d1b61_2ad4_4eef_8249_f6b01bbbacc3.slice/crio-f8cbff9a4bdc20b954a3fe3e007fd60e98fb18a74f81029775fe16e8c8bbc32e WatchSource:0}: Error finding container f8cbff9a4bdc20b954a3fe3e007fd60e98fb18a74f81029775fe16e8c8bbc32e: Status 404 returned error can't find the container with id f8cbff9a4bdc20b954a3fe3e007fd60e98fb18a74f81029775fe16e8c8bbc32e Jul 07 16:57:35.847607 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:35.847573 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"f8cbff9a4bdc20b954a3fe3e007fd60e98fb18a74f81029775fe16e8c8bbc32e"} Jul 07 16:57:54.919252 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:54.919215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"8513569eccb3bd364f105cff7497c6a03f329d2ad4ba186dfdb77ce6a7be81d7"} Jul 07 16:57:59.938050 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:59.938020 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerID="8513569eccb3bd364f105cff7497c6a03f329d2ad4ba186dfdb77ce6a7be81d7" exitCode=0 Jul 07 16:57:59.938414 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:57:59.938092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"8513569eccb3bd364f105cff7497c6a03f329d2ad4ba186dfdb77ce6a7be81d7"} Jul 07 16:58:00.943145 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:00.943112 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"e5d552db2a6f1a14d93a99da897caf5cb109ee893f40b46590262a5854149ff9"} Jul 07 16:58:05.962135 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:05.962098 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerID="e5d552db2a6f1a14d93a99da897caf5cb109ee893f40b46590262a5854149ff9" exitCode=0 Jul 07 16:58:05.962513 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:05.962162 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"e5d552db2a6f1a14d93a99da897caf5cb109ee893f40b46590262a5854149ff9"} Jul 07 16:58:06.970859 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:06.970826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"b5a489ded204e34fd374a808fc6784e85e46fedf85c238f5dcafbca9490ce469"} Jul 07 16:58:06.971425 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:06.971387 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"63d93668daa7682d6394c70be596e6d13bc6209eb01e3bada15219dbb9ef3a12"} Jul 07 16:58:06.971425 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:06.971425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"ca76f8e8d8f50d4f348d0b7fd80b68f7bf7d0e67bf926966f5778e214436389f"} Jul 07 16:58:06.971610 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:06.971445 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerStarted","Data":"1efc4fe9ca1d0e01a61285b8770475246ab10e65beef3478b97b872da52cbef1"} Jul 07 16:58:07.003647 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:07.003583 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podStartSLOduration=13.902723891 podStartE2EDuration="33.003560115s" totalImagesPullingTime="19.100836224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:58:07.002057066 +0000 UTC m=+1122.185268631" watchObservedRunningTime="2026-07-07 16:58:07.003560115 +0000 UTC m=+1122.186771680" Jul 07 16:58:08.532621 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.532492 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:08.532621 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.532558 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:08.532621 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.532577 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:08.532621 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.532595 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:08.534417 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.534359 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 07 16:58:08.534539 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.534408 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 07 16:58:08.534539 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.534384 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.14:8816: connect: connection refused" Jul 07 16:58:08.534539 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:08.534420 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.14:6571: connect: connection refused" Jul 07 16:58:11.531887 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:11.531840 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 07 16:58:11.532498 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:11.531856 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 07 16:58:11.532640 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:11.531845 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.14:8816: connect: connection refused" Jul 07 16:58:11.532640 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:11.532039 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.14:6571: connect: connection refused" Jul 07 16:58:14.532419 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:14.532389 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:14.532984 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:14.532965 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:14.533037 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:14.533004 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:14.533211 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:14.533195 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:14.533311 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:14.533302 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:14.537800 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:14.537776 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:15.007839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:15.007741 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:15.007839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:15.007791 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:15.007839 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:15.007811 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:15.008239 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:15.008203 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:15.008332 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:15.008285 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:58:15.011640 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:58:15.011616 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:59:17.957111 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:17.956894 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447"] Jul 07 16:59:17.957628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:17.957319 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="registry" containerID="cri-o://1efc4fe9ca1d0e01a61285b8770475246ab10e65beef3478b97b872da52cbef1" gracePeriod=30 Jul 07 16:59:17.957628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:17.957381 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" containerID="cri-o://ca76f8e8d8f50d4f348d0b7fd80b68f7bf7d0e67bf926966f5778e214436389f" gracePeriod=30 Jul 07 16:59:17.957628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:17.957431 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" containerID="cri-o://b5a489ded204e34fd374a808fc6784e85e46fedf85c238f5dcafbca9490ce469" gracePeriod=30 Jul 07 16:59:17.957628 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:17.957383 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="offline" containerID="cri-o://63d93668daa7682d6394c70be596e6d13bc6209eb01e3bada15219dbb9ef3a12" gracePeriod=30 Jul 07 16:59:18.293944 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.293870 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2"] Jul 07 16:59:18.296393 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.296376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.301403 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.301374 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9z7kz\"" Jul 07 16:59:18.316414 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.316382 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2"] Jul 07 16:59:18.377266 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.377231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pkwc\" (UniqueName: \"kubernetes.io/projected/a205134e-88ef-455b-abe3-590af58074e9-kube-api-access-7pkwc\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.377475 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.377279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.377475 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.377322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.377475 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.377365 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a205134e-88ef-455b-abe3-590af58074e9-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.377475 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.377391 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.377475 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.377417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478107 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478193 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478237 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478219 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a205134e-88ef-455b-abe3-590af58074e9-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478280 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:59:18.478172 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 07 16:59:18.478280 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478380 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:59:18.478305 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls podName:a205134e-88ef-455b-abe3-590af58074e9 nodeName:}" failed. No retries permitted until 2026-07-07 16:59:18.978283003 +0000 UTC m=+1194.161494544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls") pod "feast-simple-feast-setup-796bc5bb56-p8jj2" (UID: "a205134e-88ef-455b-abe3-590af58074e9") : secret "feast-simple-feast-setup-offline-tls" not found Jul 07 16:59:18.478380 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478380 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:59:18.478332 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 07 16:59:18.478534 ip-10-0-140-181 kubenswrapper[2556]: E0707 16:59:18.478386 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls podName:a205134e-88ef-455b-abe3-590af58074e9 nodeName:}" failed. No retries permitted until 2026-07-07 16:59:18.978368869 +0000 UTC m=+1194.161580416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls") pod "feast-simple-feast-setup-796bc5bb56-p8jj2" (UID: "a205134e-88ef-455b-abe3-590af58074e9") : secret "feast-simple-feast-setup-registry-tls" not found Jul 07 16:59:18.478534 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkwc\" (UniqueName: \"kubernetes.io/projected/a205134e-88ef-455b-abe3-590af58074e9-kube-api-access-7pkwc\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.478643 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.478602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a205134e-88ef-455b-abe3-590af58074e9-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.480543 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.480517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.480636 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.480600 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.487528 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.487502 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pkwc\" (UniqueName: \"kubernetes.io/projected/a205134e-88ef-455b-abe3-590af58074e9-kube-api-access-7pkwc\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.983888 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.983849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.984261 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.983897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.986280 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.986259 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:18.986280 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:18.986270 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-p8jj2\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:19.205863 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:19.205829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:19.225591 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:19.225562 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerID="b5a489ded204e34fd374a808fc6784e85e46fedf85c238f5dcafbca9490ce469" exitCode=0 Jul 07 16:59:19.225591 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:19.225588 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerID="ca76f8e8d8f50d4f348d0b7fd80b68f7bf7d0e67bf926966f5778e214436389f" exitCode=0 Jul 07 16:59:19.225729 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:19.225635 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"b5a489ded204e34fd374a808fc6784e85e46fedf85c238f5dcafbca9490ce469"} Jul 07 16:59:19.225729 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:19.225696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"ca76f8e8d8f50d4f348d0b7fd80b68f7bf7d0e67bf926966f5778e214436389f"} Jul 07 16:59:19.330011 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:19.329987 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2"] Jul 07 16:59:19.330849 ip-10-0-140-181 kubenswrapper[2556]: W0707 16:59:19.330822 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda205134e_88ef_455b_abe3_590af58074e9.slice/crio-78c9705271ac503d14b31bc67db041e0f71c679f23e05cc1a514e7e1c48a9c5c WatchSource:0}: Error finding container 78c9705271ac503d14b31bc67db041e0f71c679f23e05cc1a514e7e1c48a9c5c: Status 404 returned error can't find the container with id 78c9705271ac503d14b31bc67db041e0f71c679f23e05cc1a514e7e1c48a9c5c Jul 07 16:59:20.231497 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:20.231453 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"bc5aa041dea4502ef6d4f488158992b3bbcff3577bcbe880f522eed6d7695a23"} Jul 07 16:59:20.231965 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:20.231512 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"78c9705271ac503d14b31bc67db041e0f71c679f23e05cc1a514e7e1c48a9c5c"} Jul 07 16:59:24.246950 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:24.246862 2556 generic.go:356] "Generic (PLEG): container finished" podID="a205134e-88ef-455b-abe3-590af58074e9" containerID="bc5aa041dea4502ef6d4f488158992b3bbcff3577bcbe880f522eed6d7695a23" exitCode=0 Jul 07 16:59:24.246950 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:24.246925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"bc5aa041dea4502ef6d4f488158992b3bbcff3577bcbe880f522eed6d7695a23"} Jul 07 16:59:24.534127 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:24.533593 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 07 16:59:25.008028 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:25.007988 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 07 16:59:25.253451 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:25.253406 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"fca39158e1be48835609fa9d5a642c91b2b902f3d3df0b9fa7491fee1da85ea7"} Jul 07 16:59:30.274203 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:30.274164 2556 generic.go:356] "Generic (PLEG): container finished" podID="a205134e-88ef-455b-abe3-590af58074e9" containerID="fca39158e1be48835609fa9d5a642c91b2b902f3d3df0b9fa7491fee1da85ea7" exitCode=0 Jul 07 16:59:30.274635 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:30.274218 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"fca39158e1be48835609fa9d5a642c91b2b902f3d3df0b9fa7491fee1da85ea7"} Jul 07 16:59:31.283435 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:31.283393 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"bc6927f1dda0caee18a4a8e9f65396667870a3e16a8474f70dd78bfd29fb494b"} Jul 07 16:59:31.283897 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:31.283455 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"a91b42f8b692806cb939629787e9b4dc5fc6b728d48eb4bf87222147cd53a948"} Jul 07 16:59:31.283897 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:31.283476 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"20f096fccad90af2a6b0e901a53cdae67efa755766908e61ee63d32f1a43ad11"} Jul 07 16:59:31.283897 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:31.283494 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerStarted","Data":"51271cbfe82d273e6bc4c5f749425e45a6e914f4a854ae8a38b63594292da00b"} Jul 07 16:59:31.318030 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:31.317964 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podStartSLOduration=13.31793834 podStartE2EDuration="13.31793834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:59:31.315315424 +0000 UTC m=+1206.498526989" watchObservedRunningTime="2026-07-07 16:59:31.31793834 +0000 UTC m=+1206.501149907" Jul 07 16:59:34.206821 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.206769 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:34.207310 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.206837 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:34.207310 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.206857 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:34.207310 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.206873 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:34.208837 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.208802 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.15:6571: connect: connection refused" Jul 07 16:59:34.208970 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.208827 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 07 16:59:34.208970 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.208836 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.15:8816: connect: connection refused" Jul 07 16:59:34.208970 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.208924 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 07 16:59:34.534232 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:34.533734 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 07 16:59:35.008736 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:35.008305 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 07 16:59:37.207792 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.207760 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208203 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.207864 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208203 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208135 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208558 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208510 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208558 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208549 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208772 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208568 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208772 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208709 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.208963 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208950 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.209008 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.208996 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.212715 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.212700 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.312003 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.311980 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:37.314970 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:37.314950 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 16:59:44.533171 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:44.533129 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.14:8443: connect: connection refused" Jul 07 16:59:44.533574 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:44.533237 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:59:45.008479 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:45.008434 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.14:6567/health\": dial tcp 10.134.0.14:6567: connect: connection refused" Jul 07 16:59:45.008668 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:45.008577 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:59:48.357627 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.357547 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerID="63d93668daa7682d6394c70be596e6d13bc6209eb01e3bada15219dbb9ef3a12" exitCode=137 Jul 07 16:59:48.357627 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.357576 2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerID="1efc4fe9ca1d0e01a61285b8770475246ab10e65beef3478b97b872da52cbef1" exitCode=137 Jul 07 16:59:48.357627 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.357595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"63d93668daa7682d6394c70be596e6d13bc6209eb01e3bada15219dbb9ef3a12"} Jul 07 16:59:48.357627 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.357628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"1efc4fe9ca1d0e01a61285b8770475246ab10e65beef3478b97b872da52cbef1"} Jul 07 16:59:48.602876 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.602850 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:59:48.703213 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703182 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-ui-tls\") pod \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " Jul 07 16:59:48.703213 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703217 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-online-tls\") pod \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " Jul 07 16:59:48.703570 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703235 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-feast-data\") pod \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " Jul 07 16:59:48.703570 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703275 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-registry-tls\") pod \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " Jul 07 16:59:48.703570 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703408 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lt65\" (UniqueName: \"kubernetes.io/projected/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-kube-api-access-4lt65\") pod \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " Jul 07 16:59:48.703570 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703479 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls\") pod \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\" (UID: \"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3\") " Jul 07 16:59:48.703897 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.703839 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-feast-data" (OuterVolumeSpecName: "feast-data") pod "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:59:48.705577 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.705549 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:59:48.705681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.705592 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-kube-api-access-4lt65" (OuterVolumeSpecName: "kube-api-access-4lt65") pod "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3"). InnerVolumeSpecName "kube-api-access-4lt65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:59:48.705681 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.705656 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-online-tls" (OuterVolumeSpecName: "online-tls") pod "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:59:48.705757 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.705691 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:59:48.705866 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.705843 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" (UID: "6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:59:48.804081 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.804056 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-ui-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:59:48.804180 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.804095 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-online-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:59:48.804180 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.804109 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-feast-data\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:59:48.804180 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.804121 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-registry-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:59:48.804180 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.804132 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lt65\" (UniqueName: \"kubernetes.io/projected/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-kube-api-access-4lt65\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:59:48.804180 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:48.804144 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3-offline-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 16:59:49.363616 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.363583 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" event={"ID":"6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3","Type":"ContainerDied","Data":"f8cbff9a4bdc20b954a3fe3e007fd60e98fb18a74f81029775fe16e8c8bbc32e"} Jul 07 16:59:49.363616 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.363606 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447" Jul 07 16:59:49.364084 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.363642 2556 scope.go:117] "RemoveContainer" containerID="b5a489ded204e34fd374a808fc6784e85e46fedf85c238f5dcafbca9490ce469" Jul 07 16:59:49.371692 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.371669 2556 scope.go:117] "RemoveContainer" containerID="63d93668daa7682d6394c70be596e6d13bc6209eb01e3bada15219dbb9ef3a12" Jul 07 16:59:49.378593 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.378576 2556 scope.go:117] "RemoveContainer" containerID="ca76f8e8d8f50d4f348d0b7fd80b68f7bf7d0e67bf926966f5778e214436389f" Jul 07 16:59:49.385404 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.385384 2556 scope.go:117] "RemoveContainer" containerID="1efc4fe9ca1d0e01a61285b8770475246ab10e65beef3478b97b872da52cbef1" Jul 07 16:59:49.386638 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.386615 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447"] Jul 07 16:59:49.392259 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.392238 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-qg447"] Jul 07 16:59:49.393332 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.393316 2556 scope.go:117] "RemoveContainer" containerID="e5d552db2a6f1a14d93a99da897caf5cb109ee893f40b46590262a5854149ff9" Jul 07 16:59:49.399913 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:49.399887 2556 scope.go:117] "RemoveContainer" containerID="8513569eccb3bd364f105cff7497c6a03f329d2ad4ba186dfdb77ce6a7be81d7" Jul 07 16:59:51.392684 ip-10-0-140-181 kubenswrapper[2556]: I0707 16:59:51.392650 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" path="/var/lib/kubelet/pods/6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3/volumes" Jul 07 17:00:40.148144 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148109 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz"] Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148365 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148377 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148386 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="offline" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148392 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="offline" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148406 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="feast-init" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148413 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="feast-init" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148421 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148425 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148437 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="feast-apply" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148442 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="feast-apply" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148448 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="registry" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148453 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="registry" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148491 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="online" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148497 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="offline" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148503 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="ui" Jul 07 17:00:40.148542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.148511 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9d1b61-2ad4-4eef-8249-f6b01bbbacc3" containerName="registry" Jul 07 17:00:40.151040 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.151023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.154217 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.154196 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 07 17:00:40.154423 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.154408 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 07 17:00:40.154494 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.154469 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 07 17:00:40.154641 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.154622 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 07 17:00:40.155638 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.155624 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 07 17:00:40.155715 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.155667 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mnvdc\"" Jul 07 17:00:40.155756 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.155726 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 07 17:00:40.162126 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.162108 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz"] Jul 07 17:00:40.262817 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.262781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.263001 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.262824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.263001 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.262890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.263001 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.262927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.263001 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.262948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.263001 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.262983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2srw\" (UniqueName: \"kubernetes.io/projected/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-kube-api-access-q2srw\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.363726 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.363697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.363726 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.363728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.363907 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.363753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.363907 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.363775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.363907 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.363791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.363907 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.363820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2srw\" (UniqueName: \"kubernetes.io/projected/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-kube-api-access-q2srw\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.364334 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.364297 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.364600 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.364579 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.366290 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.366271 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.366446 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.366425 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.366489 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.366433 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.372566 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.372544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2srw\" (UniqueName: \"kubernetes.io/projected/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-kube-api-access-q2srw\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.459660 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.459579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:40.587721 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:40.587697 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz"] Jul 07 17:00:40.589562 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:00:40.589532 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc5d60a_4101_4a52_bf3c_dbba12d0b9ce.slice/crio-d9eba7a657f5c4b2d773642cb81c7777ef0c233291783ef77d27ce7e4f9b0184 WatchSource:0}: Error finding container d9eba7a657f5c4b2d773642cb81c7777ef0c233291783ef77d27ce7e4f9b0184: Status 404 returned error can't find the container with id d9eba7a657f5c4b2d773642cb81c7777ef0c233291783ef77d27ce7e4f9b0184 Jul 07 17:00:41.542056 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:41.542017 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerStarted","Data":"796100569a739f94971eb7f59d36a09124acadb11209f07d88654345025aaf72"} Jul 07 17:00:41.542449 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:41.542084 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerStarted","Data":"d9eba7a657f5c4b2d773642cb81c7777ef0c233291783ef77d27ce7e4f9b0184"} Jul 07 17:00:45.555907 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:45.555821 2556 generic.go:356] "Generic (PLEG): container finished" podID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerID="796100569a739f94971eb7f59d36a09124acadb11209f07d88654345025aaf72" exitCode=0 Jul 07 17:00:45.555907 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:45.555893 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerDied","Data":"796100569a739f94971eb7f59d36a09124acadb11209f07d88654345025aaf72"} Jul 07 17:00:46.561203 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:46.561170 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerStarted","Data":"f95f76e667420086d406064a9ecca22f0adf4d1cf2f66ab4cb9006ce263b1d87"} Jul 07 17:00:51.578885 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:51.578852 2556 generic.go:356] "Generic (PLEG): container finished" podID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerID="f95f76e667420086d406064a9ecca22f0adf4d1cf2f66ab4cb9006ce263b1d87" exitCode=0 Jul 07 17:00:51.579382 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:51.578895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerDied","Data":"f95f76e667420086d406064a9ecca22f0adf4d1cf2f66ab4cb9006ce263b1d87"} Jul 07 17:00:52.586598 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:52.586564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerStarted","Data":"5bc917a9f51592313be157d96865fa9df23ef52c8291176568bc9edb648333fc"} Jul 07 17:00:52.586955 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:52.586621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerStarted","Data":"d8b8ca9729acdc0bffd47d22fb236d43d00e5d9dc82c86391c5929b8b8a4504b"} Jul 07 17:00:52.586955 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:52.586641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerStarted","Data":"f5c6f3460cffe65a3fdd1c9f19f3ab266d65aa7c514ad3aded0d39638d25ced8"} Jul 07 17:00:52.612880 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:52.612818 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podStartSLOduration=12.612797091000001 podStartE2EDuration="12.612797091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:00:52.610933295 +0000 UTC m=+1287.794144859" watchObservedRunningTime="2026-07-07 17:00:52.612797091 +0000 UTC m=+1287.796008655" Jul 07 17:00:55.460180 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:55.460137 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:55.460684 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:55.460195 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:55.460684 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:55.460211 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:55.461797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:55.461756 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 07 17:00:55.461797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:55.461772 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.16:8816: connect: connection refused" Jul 07 17:00:55.461962 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:55.461825 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 07 17:00:58.461305 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.461270 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.461871 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.461406 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.461871 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.461830 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.461871 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.461866 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.462218 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.462200 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.462319 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.462250 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.468162 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.468142 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.611380 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.611347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:00:58.615962 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:00:58.615934 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:02:01.509156 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.509062 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz"] Jul 07 17:02:01.509706 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.509407 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" containerID="cri-o://5bc917a9f51592313be157d96865fa9df23ef52c8291176568bc9edb648333fc" gracePeriod=30 Jul 07 17:02:01.509706 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.509410 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="offline" containerID="cri-o://d8b8ca9729acdc0bffd47d22fb236d43d00e5d9dc82c86391c5929b8b8a4504b" gracePeriod=30 Jul 07 17:02:01.509706 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.509416 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" containerID="cri-o://f5c6f3460cffe65a3fdd1c9f19f3ab266d65aa7c514ad3aded0d39638d25ced8" gracePeriod=30 Jul 07 17:02:01.670742 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.670711 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2"] Jul 07 17:02:01.671038 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.670962 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="registry" containerID="cri-o://51271cbfe82d273e6bc4c5f749425e45a6e914f4a854ae8a38b63594292da00b" gracePeriod=30 Jul 07 17:02:01.671038 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.670998 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="offline" containerID="cri-o://a91b42f8b692806cb939629787e9b4dc5fc6b728d48eb4bf87222147cd53a948" gracePeriod=30 Jul 07 17:02:01.671251 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.671016 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" containerID="cri-o://20f096fccad90af2a6b0e901a53cdae67efa755766908e61ee63d32f1a43ad11" gracePeriod=30 Jul 07 17:02:01.671251 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:01.671014 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" containerID="cri-o://bc6927f1dda0caee18a4a8e9f65396667870a3e16a8474f70dd78bfd29fb494b" gracePeriod=30 Jul 07 17:02:02.828749 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.828709 2556 generic.go:356] "Generic (PLEG): container finished" podID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerID="5bc917a9f51592313be157d96865fa9df23ef52c8291176568bc9edb648333fc" exitCode=0 Jul 07 17:02:02.828749 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.828740 2556 generic.go:356] "Generic (PLEG): container finished" podID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerID="f5c6f3460cffe65a3fdd1c9f19f3ab266d65aa7c514ad3aded0d39638d25ced8" exitCode=0 Jul 07 17:02:02.829257 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.828782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerDied","Data":"5bc917a9f51592313be157d96865fa9df23ef52c8291176568bc9edb648333fc"} Jul 07 17:02:02.829257 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.828828 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerDied","Data":"f5c6f3460cffe65a3fdd1c9f19f3ab266d65aa7c514ad3aded0d39638d25ced8"} Jul 07 17:02:02.831560 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.831538 2556 generic.go:356] "Generic (PLEG): container finished" podID="a205134e-88ef-455b-abe3-590af58074e9" containerID="bc6927f1dda0caee18a4a8e9f65396667870a3e16a8474f70dd78bfd29fb494b" exitCode=0 Jul 07 17:02:02.831560 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.831555 2556 generic.go:356] "Generic (PLEG): container finished" podID="a205134e-88ef-455b-abe3-590af58074e9" containerID="20f096fccad90af2a6b0e901a53cdae67efa755766908e61ee63d32f1a43ad11" exitCode=0 Jul 07 17:02:02.831699 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.831592 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"bc6927f1dda0caee18a4a8e9f65396667870a3e16a8474f70dd78bfd29fb494b"} Jul 07 17:02:02.831699 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:02.831621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"20f096fccad90af2a6b0e901a53cdae67efa755766908e61ee63d32f1a43ad11"} Jul 07 17:02:07.208875 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:07.208812 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 07 17:02:07.312705 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:07.312662 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 07 17:02:08.462193 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:08.462149 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 07 17:02:08.612005 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:08.611966 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 07 17:02:17.208895 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:17.208842 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 07 17:02:17.312226 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:17.312180 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 07 17:02:18.462486 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:18.462435 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 07 17:02:18.611865 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:18.611830 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 07 17:02:27.208724 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:27.208678 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.15:8443: connect: connection refused" Jul 07 17:02:27.209198 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:27.208841 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 17:02:27.312347 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:27.312303 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.15:6567/health\": dial tcp 10.134.0.15:6567: connect: connection refused" Jul 07 17:02:27.312507 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:27.312441 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 17:02:28.462418 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:28.462379 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.16:8443: connect: connection refused" Jul 07 17:02:28.462817 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:28.462515 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:02:28.612028 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:28.611990 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" probeResult="failure" output="Get \"https://10.134.0.16:6567/health\": dial tcp 10.134.0.16:6567: connect: connection refused" Jul 07 17:02:28.612209 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:28.612134 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:02:31.932724 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:31.932694 2556 generic.go:356] "Generic (PLEG): container finished" podID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerID="d8b8ca9729acdc0bffd47d22fb236d43d00e5d9dc82c86391c5929b8b8a4504b" exitCode=137 Jul 07 17:02:31.933115 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:31.932765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerDied","Data":"d8b8ca9729acdc0bffd47d22fb236d43d00e5d9dc82c86391c5929b8b8a4504b"} Jul 07 17:02:31.935533 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:31.935510 2556 generic.go:356] "Generic (PLEG): container finished" podID="a205134e-88ef-455b-abe3-590af58074e9" containerID="a91b42f8b692806cb939629787e9b4dc5fc6b728d48eb4bf87222147cd53a948" exitCode=137 Jul 07 17:02:31.935533 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:31.935530 2556 generic.go:356] "Generic (PLEG): container finished" podID="a205134e-88ef-455b-abe3-590af58074e9" containerID="51271cbfe82d273e6bc4c5f749425e45a6e914f4a854ae8a38b63594292da00b" exitCode=137 Jul 07 17:02:31.935666 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:31.935560 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"a91b42f8b692806cb939629787e9b4dc5fc6b728d48eb4bf87222147cd53a948"} Jul 07 17:02:31.935666 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:31.935590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"51271cbfe82d273e6bc4c5f749425e45a6e914f4a854ae8a38b63594292da00b"} Jul 07 17:02:32.153945 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.153922 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:02:32.238382 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238349 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-online-tls\") pod \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " Jul 07 17:02:32.238520 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238413 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-offline-tls\") pod \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " Jul 07 17:02:32.238520 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238456 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2srw\" (UniqueName: \"kubernetes.io/projected/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-kube-api-access-q2srw\") pod \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " Jul 07 17:02:32.238520 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238501 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-feast-data\") pod \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " Jul 07 17:02:32.238676 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238523 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-registry-tls\") pod \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " Jul 07 17:02:32.238676 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238544 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-ui-tls\") pod \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\" (UID: \"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce\") " Jul 07 17:02:32.239030 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.238990 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" (UID: "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:02:32.239030 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.239015 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-feast-data" (OuterVolumeSpecName: "feast-data") pod "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" (UID: "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:02:32.241243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.241121 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" (UID: "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.241328 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.241281 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" (UID: "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.241523 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.241491 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-kube-api-access-q2srw" (OuterVolumeSpecName: "kube-api-access-q2srw") pod "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" (UID: "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce"). InnerVolumeSpecName "kube-api-access-q2srw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:02:32.241614 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.241569 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-online-tls" (OuterVolumeSpecName: "online-tls") pod "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" (UID: "5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.325264 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.325239 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 17:02:32.340029 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.340011 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-online-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.340029 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.340029 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-offline-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.340174 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.340039 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2srw\" (UniqueName: \"kubernetes.io/projected/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-kube-api-access-q2srw\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.340174 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.340047 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-feast-data\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.340174 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.340056 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-registry-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.340174 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.340065 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce-ui-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.441034 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.440952 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pkwc\" (UniqueName: \"kubernetes.io/projected/a205134e-88ef-455b-abe3-590af58074e9-kube-api-access-7pkwc\") pod \"a205134e-88ef-455b-abe3-590af58074e9\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " Jul 07 17:02:32.441034 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.440988 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-ui-tls\") pod \"a205134e-88ef-455b-abe3-590af58074e9\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " Jul 07 17:02:32.441034 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.441013 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls\") pod \"a205134e-88ef-455b-abe3-590af58074e9\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " Jul 07 17:02:32.441310 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.441042 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-online-tls\") pod \"a205134e-88ef-455b-abe3-590af58074e9\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " Jul 07 17:02:32.441310 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.441089 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a205134e-88ef-455b-abe3-590af58074e9-feast-data\") pod \"a205134e-88ef-455b-abe3-590af58074e9\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " Jul 07 17:02:32.441310 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.441156 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls\") pod \"a205134e-88ef-455b-abe3-590af58074e9\" (UID: \"a205134e-88ef-455b-abe3-590af58074e9\") " Jul 07 17:02:32.441790 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.441748 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a205134e-88ef-455b-abe3-590af58074e9-feast-data" (OuterVolumeSpecName: "feast-data") pod "a205134e-88ef-455b-abe3-590af58074e9" (UID: "a205134e-88ef-455b-abe3-590af58074e9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:02:32.443268 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.443235 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a205134e-88ef-455b-abe3-590af58074e9-kube-api-access-7pkwc" (OuterVolumeSpecName: "kube-api-access-7pkwc") pod "a205134e-88ef-455b-abe3-590af58074e9" (UID: "a205134e-88ef-455b-abe3-590af58074e9"). InnerVolumeSpecName "kube-api-access-7pkwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:02:32.443268 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.443248 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a205134e-88ef-455b-abe3-590af58074e9" (UID: "a205134e-88ef-455b-abe3-590af58074e9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.443420 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.443273 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a205134e-88ef-455b-abe3-590af58074e9" (UID: "a205134e-88ef-455b-abe3-590af58074e9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.443562 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.443533 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-online-tls" (OuterVolumeSpecName: "online-tls") pod "a205134e-88ef-455b-abe3-590af58074e9" (UID: "a205134e-88ef-455b-abe3-590af58074e9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.443660 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.443596 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a205134e-88ef-455b-abe3-590af58074e9" (UID: "a205134e-88ef-455b-abe3-590af58074e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:02:32.542448 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.542419 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pkwc\" (UniqueName: \"kubernetes.io/projected/a205134e-88ef-455b-abe3-590af58074e9-kube-api-access-7pkwc\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.542448 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.542441 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-ui-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.542448 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.542450 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-offline-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.542655 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.542459 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-online-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.542655 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.542467 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a205134e-88ef-455b-abe3-590af58074e9-feast-data\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.542655 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.542474 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a205134e-88ef-455b-abe3-590af58074e9-registry-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:32.941407 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.941372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" event={"ID":"5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce","Type":"ContainerDied","Data":"d9eba7a657f5c4b2d773642cb81c7777ef0c233291783ef77d27ce7e4f9b0184"} Jul 07 17:02:32.941843 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.941385 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz" Jul 07 17:02:32.941843 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.941431 2556 scope.go:117] "RemoveContainer" containerID="5bc917a9f51592313be157d96865fa9df23ef52c8291176568bc9edb648333fc" Jul 07 17:02:32.944590 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.944569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" event={"ID":"a205134e-88ef-455b-abe3-590af58074e9","Type":"ContainerDied","Data":"78c9705271ac503d14b31bc67db041e0f71c679f23e05cc1a514e7e1c48a9c5c"} Jul 07 17:02:32.944704 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.944619 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2" Jul 07 17:02:32.950384 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.950372 2556 scope.go:117] "RemoveContainer" containerID="d8b8ca9729acdc0bffd47d22fb236d43d00e5d9dc82c86391c5929b8b8a4504b" Jul 07 17:02:32.959894 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.959873 2556 scope.go:117] "RemoveContainer" containerID="f5c6f3460cffe65a3fdd1c9f19f3ab266d65aa7c514ad3aded0d39638d25ced8" Jul 07 17:02:32.966954 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.966927 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz"] Jul 07 17:02:32.969197 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.969179 2556 scope.go:117] "RemoveContainer" containerID="f95f76e667420086d406064a9ecca22f0adf4d1cf2f66ab4cb9006ce263b1d87" Jul 07 17:02:32.969876 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.969856 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-w5rzz"] Jul 07 17:02:32.976106 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.976063 2556 scope.go:117] "RemoveContainer" containerID="796100569a739f94971eb7f59d36a09124acadb11209f07d88654345025aaf72" Jul 07 17:02:32.981516 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.981497 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2"] Jul 07 17:02:32.983047 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.983028 2556 scope.go:117] "RemoveContainer" containerID="bc6927f1dda0caee18a4a8e9f65396667870a3e16a8474f70dd78bfd29fb494b" Jul 07 17:02:32.984976 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.984960 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-p8jj2"] Jul 07 17:02:32.990416 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.990402 2556 scope.go:117] "RemoveContainer" containerID="a91b42f8b692806cb939629787e9b4dc5fc6b728d48eb4bf87222147cd53a948" Jul 07 17:02:32.997261 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:32.997247 2556 scope.go:117] "RemoveContainer" containerID="20f096fccad90af2a6b0e901a53cdae67efa755766908e61ee63d32f1a43ad11" Jul 07 17:02:33.003772 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:33.003755 2556 scope.go:117] "RemoveContainer" containerID="51271cbfe82d273e6bc4c5f749425e45a6e914f4a854ae8a38b63594292da00b" Jul 07 17:02:33.010412 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:33.010396 2556 scope.go:117] "RemoveContainer" containerID="fca39158e1be48835609fa9d5a642c91b2b902f3d3df0b9fa7491fee1da85ea7" Jul 07 17:02:33.016580 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:33.016559 2556 scope.go:117] "RemoveContainer" containerID="bc5aa041dea4502ef6d4f488158992b3bbcff3577bcbe880f522eed6d7695a23" Jul 07 17:02:33.391946 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:33.391911 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" path="/var/lib/kubelet/pods/5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce/volumes" Jul 07 17:02:33.392473 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:33.392458 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a205134e-88ef-455b-abe3-590af58074e9" path="/var/lib/kubelet/pods/a205134e-88ef-455b-abe3-590af58074e9/volumes" Jul 07 17:02:50.415374 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:50.415340 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m"] Jul 07 17:02:50.415789 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:50.415522 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" podUID="e566d3d9-2b65-4494-b663-93017d0f24db" containerName="manager" containerID="cri-o://a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d" gracePeriod=10 Jul 07 17:02:50.649867 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:50.649842 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 17:02:50.760353 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:50.760267 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7gqd\" (UniqueName: \"kubernetes.io/projected/e566d3d9-2b65-4494-b663-93017d0f24db-kube-api-access-s7gqd\") pod \"e566d3d9-2b65-4494-b663-93017d0f24db\" (UID: \"e566d3d9-2b65-4494-b663-93017d0f24db\") " Jul 07 17:02:50.762237 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:50.762212 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e566d3d9-2b65-4494-b663-93017d0f24db-kube-api-access-s7gqd" (OuterVolumeSpecName: "kube-api-access-s7gqd") pod "e566d3d9-2b65-4494-b663-93017d0f24db" (UID: "e566d3d9-2b65-4494-b663-93017d0f24db"). InnerVolumeSpecName "kube-api-access-s7gqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:02:50.860593 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:50.860568 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7gqd\" (UniqueName: \"kubernetes.io/projected/e566d3d9-2b65-4494-b663-93017d0f24db-kube-api-access-s7gqd\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:02:51.004393 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.004359 2556 generic.go:356] "Generic (PLEG): container finished" podID="e566d3d9-2b65-4494-b663-93017d0f24db" containerID="a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d" exitCode=0 Jul 07 17:02:51.004544 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.004399 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" Jul 07 17:02:51.004544 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.004443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" event={"ID":"e566d3d9-2b65-4494-b663-93017d0f24db","Type":"ContainerDied","Data":"a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d"} Jul 07 17:02:51.004544 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.004490 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m" event={"ID":"e566d3d9-2b65-4494-b663-93017d0f24db","Type":"ContainerDied","Data":"494d1668315b56343b6646f2d56f114e6b24e522390ca11735d4130ba17f4c27"} Jul 07 17:02:51.004544 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.004514 2556 scope.go:117] "RemoveContainer" containerID="a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d" Jul 07 17:02:51.012646 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.012629 2556 scope.go:117] "RemoveContainer" containerID="a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d" Jul 07 17:02:51.012916 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:02:51.012896 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d\": container with ID starting with a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d not found: ID does not exist" containerID="a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d" Jul 07 17:02:51.012971 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.012924 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d"} err="failed to get container status \"a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d\": rpc error: code = NotFound desc = could not find container \"a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d\": container with ID starting with a8bb475e979caa783e5d9af52f7a717602ea7fd290a42d1cba9529f4228c7a4d not found: ID does not exist" Jul 07 17:02:51.025622 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.025604 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m"] Jul 07 17:02:51.031647 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.031626 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-9767m"] Jul 07 17:02:51.391999 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:51.391958 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e566d3d9-2b65-4494-b663-93017d0f24db" path="/var/lib/kubelet/pods/e566d3d9-2b65-4494-b663-93017d0f24db/volumes" Jul 07 17:02:55.020316 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020284 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5"] Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020490 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020501 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020510 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e566d3d9-2b65-4494-b663-93017d0f24db" containerName="manager" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020516 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e566d3d9-2b65-4494-b663-93017d0f24db" containerName="manager" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020524 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="feast-apply" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020530 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="feast-apply" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020537 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="feast-init" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020542 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="feast-init" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020549 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020554 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020562 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="feast-apply" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020567 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="feast-apply" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020572 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="registry" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020577 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="registry" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020582 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020586 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020596 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="feast-init" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020601 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="feast-init" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020606 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="offline" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020611 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="offline" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020619 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="offline" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020625 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="offline" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020630 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020634 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020670 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="ui" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020677 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="ui" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020683 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e566d3d9-2b65-4494-b663-93017d0f24db" containerName="manager" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020688 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="offline" Jul 07 17:02:55.020678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020693 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cc5d60a-4101-4a52-bf3c-dbba12d0b9ce" containerName="online" Jul 07 17:02:55.021486 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020698 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="online" Jul 07 17:02:55.021486 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020704 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="registry" Jul 07 17:02:55.021486 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.020708 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a205134e-88ef-455b-abe3-590af58074e9" containerName="offline" Jul 07 17:02:55.023187 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.023172 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:02:55.025982 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.025960 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 07 17:02:55.026115 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.026025 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-flzp9\"" Jul 07 17:02:55.027217 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.027202 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 07 17:02:55.031151 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.031128 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5"] Jul 07 17:02:55.093066 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.093038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7lt\" (UniqueName: \"kubernetes.io/projected/942c937d-88a9-467c-96e4-ffee5b516a87-kube-api-access-9t7lt\") pod \"feast-operator-controller-manager-7cb4c6bbd6-fr8r5\" (UID: \"942c937d-88a9-467c-96e4-ffee5b516a87\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:02:55.194378 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.194344 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7lt\" (UniqueName: \"kubernetes.io/projected/942c937d-88a9-467c-96e4-ffee5b516a87-kube-api-access-9t7lt\") pod \"feast-operator-controller-manager-7cb4c6bbd6-fr8r5\" (UID: \"942c937d-88a9-467c-96e4-ffee5b516a87\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:02:55.204308 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.204282 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7lt\" (UniqueName: \"kubernetes.io/projected/942c937d-88a9-467c-96e4-ffee5b516a87-kube-api-access-9t7lt\") pod \"feast-operator-controller-manager-7cb4c6bbd6-fr8r5\" (UID: \"942c937d-88a9-467c-96e4-ffee5b516a87\") " pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:02:55.332540 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.332467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:02:55.461831 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:55.461807 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5"] Jul 07 17:02:55.464146 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:02:55.464119 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942c937d_88a9_467c_96e4_ffee5b516a87.slice/crio-c799e0bf0daced7d98b1406b235b47123a76ada446c91b7f7dff6afb974e4b63 WatchSource:0}: Error finding container c799e0bf0daced7d98b1406b235b47123a76ada446c91b7f7dff6afb974e4b63: Status 404 returned error can't find the container with id c799e0bf0daced7d98b1406b235b47123a76ada446c91b7f7dff6afb974e4b63 Jul 07 17:02:56.023355 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:56.023320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" event={"ID":"942c937d-88a9-467c-96e4-ffee5b516a87","Type":"ContainerStarted","Data":"599e057f60f1b6810795586ec64b436c4f4c5d541f49a6467f2a5779a4e86ce3"} Jul 07 17:02:56.023694 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:56.023382 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" event={"ID":"942c937d-88a9-467c-96e4-ffee5b516a87","Type":"ContainerStarted","Data":"c799e0bf0daced7d98b1406b235b47123a76ada446c91b7f7dff6afb974e4b63"} Jul 07 17:02:56.023694 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:56.023411 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:02:56.041492 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:02:56.041322 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" podStartSLOduration=1.041302999 podStartE2EDuration="1.041302999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:02:56.041034983 +0000 UTC m=+1411.224246548" watchObservedRunningTime="2026-07-07 17:02:56.041302999 +0000 UTC m=+1411.224514564" Jul 07 17:03:07.029521 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:07.029489 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7cb4c6bbd6-fr8r5" Jul 07 17:03:13.426330 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.426295 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t"] Jul 07 17:03:13.429865 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.429845 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.433000 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.432978 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 07 17:03:13.433177 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.433004 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 07 17:03:13.433177 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.433058 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 07 17:03:13.433177 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.433163 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 07 17:03:13.433391 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.433373 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6wm8j\"" Jul 07 17:03:13.433458 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.433394 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 07 17:03:13.433458 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.433421 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 07 17:03:13.442640 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.442619 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t"] Jul 07 17:03:13.509662 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.509627 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.509827 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.509695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.509827 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.509739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.509951 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.509824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87hd\" (UniqueName: \"kubernetes.io/projected/ce6521ad-6903-4888-b344-1f4d112ecbe7-kube-api-access-c87hd\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.509951 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.509867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6521ad-6903-4888-b344-1f4d112ecbe7-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.509951 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.509899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610795 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.610761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6521ad-6903-4888-b344-1f4d112ecbe7-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610987 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.610799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610987 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.610840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610987 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.610877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610987 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.610915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610987 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.610944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87hd\" (UniqueName: \"kubernetes.io/projected/ce6521ad-6903-4888-b344-1f4d112ecbe7-kube-api-access-c87hd\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.610987 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:03:13.610955 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 07 17:03:13.616488 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:03:13.611499 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 07 17:03:13.616488 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:03:13.611624 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls podName:ce6521ad-6903-4888-b344-1f4d112ecbe7 nodeName:}" failed. No retries permitted until 2026-07-07 17:03:14.111599863 +0000 UTC m=+1429.294811404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls") pod "feast-simple-feast-setup-796bc5bb56-lnr6t" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7") : secret "feast-simple-feast-setup-ui-tls" not found Jul 07 17:03:13.616488 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.611707 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6521ad-6903-4888-b344-1f4d112ecbe7-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.616488 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:03:13.611993 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls podName:ce6521ad-6903-4888-b344-1f4d112ecbe7 nodeName:}" failed. No retries permitted until 2026-07-07 17:03:14.111944369 +0000 UTC m=+1429.295155917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls") pod "feast-simple-feast-setup-796bc5bb56-lnr6t" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7") : secret "feast-simple-feast-setup-offline-tls" not found Jul 07 17:03:13.616488 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.614051 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.616488 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.614227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:13.623229 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:13.623208 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87hd\" (UniqueName: \"kubernetes.io/projected/ce6521ad-6903-4888-b344-1f4d112ecbe7-kube-api-access-c87hd\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:14.114651 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:14.114622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:14.114819 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:14.114677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:14.116965 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:14.116939 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:14.117147 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:14.117130 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-lnr6t\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:14.338811 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:14.338781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:14.463287 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:14.463260 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t"] Jul 07 17:03:14.464744 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:03:14.464713 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6521ad_6903_4888_b344_1f4d112ecbe7.slice/crio-9c739eb6a63a8b53fb46fb32b4ac8ac05f52711c6198d39402a877700598e6a0 WatchSource:0}: Error finding container 9c739eb6a63a8b53fb46fb32b4ac8ac05f52711c6198d39402a877700598e6a0: Status 404 returned error can't find the container with id 9c739eb6a63a8b53fb46fb32b4ac8ac05f52711c6198d39402a877700598e6a0 Jul 07 17:03:15.085384 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:15.085351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"6c2b198dbc8ec28299a8a20be696c3288e13b8f96801e21ef38364e54b72c736"} Jul 07 17:03:15.085584 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:15.085396 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"9c739eb6a63a8b53fb46fb32b4ac8ac05f52711c6198d39402a877700598e6a0"} Jul 07 17:03:20.102748 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:20.102713 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerID="6c2b198dbc8ec28299a8a20be696c3288e13b8f96801e21ef38364e54b72c736" exitCode=0 Jul 07 17:03:20.103153 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:20.102785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"6c2b198dbc8ec28299a8a20be696c3288e13b8f96801e21ef38364e54b72c736"} Jul 07 17:03:21.108920 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:21.108888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"2a78e944e70718778633f842c6995a796a33c1a6d3a474fa51a5cb130b46881a"} Jul 07 17:03:26.127023 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:26.126985 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerID="2a78e944e70718778633f842c6995a796a33c1a6d3a474fa51a5cb130b46881a" exitCode=0 Jul 07 17:03:26.127408 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:26.127044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"2a78e944e70718778633f842c6995a796a33c1a6d3a474fa51a5cb130b46881a"} Jul 07 17:03:27.136978 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:27.136942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"ec6759716e3bcb11f200a7296c5c1852908e08e5972d28152efd3b99e4ab3c56"} Jul 07 17:03:27.137462 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:27.136998 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"dfcb90a0d6458e898bf0d659278cb29695b47a384f3cd0656af37be9518ff4d9"} Jul 07 17:03:27.137462 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:27.137018 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"fcc1e0d13af34af22dfd945ddf35e308cf16b9cf8038e6ebd1c1cce57b865e02"} Jul 07 17:03:27.137462 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:27.137036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerStarted","Data":"88b6b8334394210a687f98fb6cf4863c934c87b51038376513f0904ebe6c0472"} Jul 07 17:03:27.165438 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:27.165364 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podStartSLOduration=14.165343489 podStartE2EDuration="14.165343489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:03:27.162949387 +0000 UTC m=+1442.346160952" watchObservedRunningTime="2026-07-07 17:03:27.165343489 +0000 UTC m=+1442.348555053" Jul 07 17:03:29.339934 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.339894 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:29.340416 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.339958 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:29.340416 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.339978 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:29.340416 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.339996 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:29.342111 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.342081 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 07 17:03:29.342310 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.342114 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.18:6571: connect: connection refused" Jul 07 17:03:29.342385 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.342125 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.18:8816: connect: connection refused" Jul 07 17:03:29.342385 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:29.342194 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 07 17:03:32.339609 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:32.339312 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 07 17:03:32.340118 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:32.340026 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:32.340320 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:32.340298 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:32.340569 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:32.340551 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:32.340928 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:32.340909 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:32.345187 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:32.345169 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:33.161754 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:33.161726 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:33.161960 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:33.161770 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:33.165974 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:33.165950 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:34.165486 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:34.165460 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:34.338959 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:34.338925 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:35.339862 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:35.339835 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:03:36.172229 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:03:36.172195 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:04:37.166893 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.166857 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t"] Jul 07 17:04:37.167884 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.167851 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="registry" containerID="cri-o://88b6b8334394210a687f98fb6cf4863c934c87b51038376513f0904ebe6c0472" gracePeriod=30 Jul 07 17:04:37.168042 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.168009 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" containerID="cri-o://fcc1e0d13af34af22dfd945ddf35e308cf16b9cf8038e6ebd1c1cce57b865e02" gracePeriod=30 Jul 07 17:04:37.168138 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.168024 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" containerID="cri-o://ec6759716e3bcb11f200a7296c5c1852908e08e5972d28152efd3b99e4ab3c56" gracePeriod=30 Jul 07 17:04:37.168195 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.167944 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="offline" containerID="cri-o://dfcb90a0d6458e898bf0d659278cb29695b47a384f3cd0656af37be9518ff4d9" gracePeriod=30 Jul 07 17:04:37.561360 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.561282 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b"] Jul 07 17:04:37.564819 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.564800 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.567647 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.567631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ds7cf\"" Jul 07 17:04:37.579134 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.579107 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b"] Jul 07 17:04:37.671230 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.671193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/14d5f815-6a41-4ed1-8b16-13eb851513fe-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.671230 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.671231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.671525 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.671264 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.671525 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.671305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.671525 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.671322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xmf\" (UniqueName: \"kubernetes.io/projected/14d5f815-6a41-4ed1-8b16-13eb851513fe-kube-api-access-b2xmf\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.671525 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.671359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772106 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/14d5f815-6a41-4ed1-8b16-13eb851513fe-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772294 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772294 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772294 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772175 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772294 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772204 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xmf\" (UniqueName: \"kubernetes.io/projected/14d5f815-6a41-4ed1-8b16-13eb851513fe-kube-api-access-b2xmf\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772294 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.772557 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:04:37.772299 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 07 17:04:37.772557 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:04:37.772372 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 07 17:04:37.772557 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:04:37.772383 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls podName:14d5f815-6a41-4ed1-8b16-13eb851513fe nodeName:}" failed. No retries permitted until 2026-07-07 17:04:38.272361902 +0000 UTC m=+1513.455573447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls") pod "feast-simple-feast-setup-796bc5bb56-gb79b" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe") : secret "feast-simple-feast-setup-offline-tls" not found Jul 07 17:04:37.772557 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:04:37.772423 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls podName:14d5f815-6a41-4ed1-8b16-13eb851513fe nodeName:}" failed. No retries permitted until 2026-07-07 17:04:38.272406677 +0000 UTC m=+1513.455618233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls") pod "feast-simple-feast-setup-796bc5bb56-gb79b" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe") : secret "feast-simple-feast-setup-registry-tls" not found Jul 07 17:04:37.772557 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.772495 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/14d5f815-6a41-4ed1-8b16-13eb851513fe-feast-data\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.774530 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.774503 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-ui-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.774686 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.774666 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-online-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:37.784249 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:37.784212 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xmf\" (UniqueName: \"kubernetes.io/projected/14d5f815-6a41-4ed1-8b16-13eb851513fe-kube-api-access-b2xmf\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:38.276678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.276591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:38.276678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.276655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:38.279108 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.279064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:38.279180 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.279064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls\") pod \"feast-simple-feast-setup-796bc5bb56-gb79b\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:38.376279 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.376247 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerID="ec6759716e3bcb11f200a7296c5c1852908e08e5972d28152efd3b99e4ab3c56" exitCode=0 Jul 07 17:04:38.376279 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.376273 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerID="fcc1e0d13af34af22dfd945ddf35e308cf16b9cf8038e6ebd1c1cce57b865e02" exitCode=0 Jul 07 17:04:38.376483 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.376306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"ec6759716e3bcb11f200a7296c5c1852908e08e5972d28152efd3b99e4ab3c56"} Jul 07 17:04:38.376483 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.376336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"fcc1e0d13af34af22dfd945ddf35e308cf16b9cf8038e6ebd1c1cce57b865e02"} Jul 07 17:04:38.473820 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.473791 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:38.603815 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:38.603789 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b"] Jul 07 17:04:38.605766 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:04:38.605746 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14d5f815_6a41_4ed1_8b16_13eb851513fe.slice/crio-27e5bd7311cc84047e41077d48312c10dc78f694576517853e508273e5bc9747 WatchSource:0}: Error finding container 27e5bd7311cc84047e41077d48312c10dc78f694576517853e508273e5bc9747: Status 404 returned error can't find the container with id 27e5bd7311cc84047e41077d48312c10dc78f694576517853e508273e5bc9747 Jul 07 17:04:39.381572 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:39.381529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2"} Jul 07 17:04:39.381938 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:39.381589 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"27e5bd7311cc84047e41077d48312c10dc78f694576517853e508273e5bc9747"} Jul 07 17:04:43.162250 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:43.162209 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 07 17:04:44.400328 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:44.400295 2556 generic.go:356] "Generic (PLEG): container finished" podID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerID="173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2" exitCode=0 Jul 07 17:04:44.400328 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:44.400331 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2"} Jul 07 17:04:45.405684 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:45.405649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7"} Jul 07 17:04:46.171904 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:46.171855 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 07 17:04:50.426704 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:50.426664 2556 generic.go:356] "Generic (PLEG): container finished" podID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerID="7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7" exitCode=0 Jul 07 17:04:50.427088 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:50.426722 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7"} Jul 07 17:04:51.436865 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:51.436824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1"} Jul 07 17:04:51.437372 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:51.436891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475"} Jul 07 17:04:51.437372 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:51.436916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95"} Jul 07 17:04:51.437372 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:51.436937 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerStarted","Data":"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e"} Jul 07 17:04:51.463732 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:51.463658 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podStartSLOduration=14.463634951 podStartE2EDuration="14.463634951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:04:51.46105563 +0000 UTC m=+1526.644267210" watchObservedRunningTime="2026-07-07 17:04:51.463634951 +0000 UTC m=+1526.646846515" Jul 07 17:04:53.162373 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.162323 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 07 17:04:53.475115 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.475004 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:53.475115 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.475087 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:53.475115 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.475109 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:53.475384 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.475126 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:53.477015 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.476978 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 07 17:04:53.477189 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.477029 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.19:6571: connect: connection refused" Jul 07 17:04:53.477189 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.476979 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.19:8816: connect: connection refused" Jul 07 17:04:53.477189 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:53.476975 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 07 17:04:56.172673 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.172624 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 07 17:04:56.474316 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.474219 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 07 17:04:56.475049 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.475024 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:56.475199 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.475154 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:56.475582 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.475555 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:56.475678 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.475598 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:56.475735 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.475682 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:56.475969 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.475954 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:56.479924 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:56.479907 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:57.464289 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:57.464259 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:57.467614 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:57.467593 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:58.474222 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:58.474184 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:04:59.475327 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:04:59.475299 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:05:00.475189 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:00.475160 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:05:03.162597 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:03.162547 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Jul 07 17:05:03.163035 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:03.162712 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:05:06.172028 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:06.171986 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Jul 07 17:05:06.172483 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:06.172145 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:05:07.500161 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.500065 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerID="dfcb90a0d6458e898bf0d659278cb29695b47a384f3cd0656af37be9518ff4d9" exitCode=137 Jul 07 17:05:07.500161 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.500108 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerID="88b6b8334394210a687f98fb6cf4863c934c87b51038376513f0904ebe6c0472" exitCode=137 Jul 07 17:05:07.500161 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.500137 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"dfcb90a0d6458e898bf0d659278cb29695b47a384f3cd0656af37be9518ff4d9"} Jul 07 17:05:07.500547 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.500176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"88b6b8334394210a687f98fb6cf4863c934c87b51038376513f0904ebe6c0472"} Jul 07 17:05:07.809988 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.809966 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:05:07.914708 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.914681 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-online-tls\") pod \"ce6521ad-6903-4888-b344-1f4d112ecbe7\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " Jul 07 17:05:07.914840 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.914726 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls\") pod \"ce6521ad-6903-4888-b344-1f4d112ecbe7\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " Jul 07 17:05:07.914840 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.914756 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls\") pod \"ce6521ad-6903-4888-b344-1f4d112ecbe7\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " Jul 07 17:05:07.914840 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.914781 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c87hd\" (UniqueName: \"kubernetes.io/projected/ce6521ad-6903-4888-b344-1f4d112ecbe7-kube-api-access-c87hd\") pod \"ce6521ad-6903-4888-b344-1f4d112ecbe7\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " Jul 07 17:05:07.914840 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.914827 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6521ad-6903-4888-b344-1f4d112ecbe7-feast-data\") pod \"ce6521ad-6903-4888-b344-1f4d112ecbe7\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " Jul 07 17:05:07.915047 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.914861 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-registry-tls\") pod \"ce6521ad-6903-4888-b344-1f4d112ecbe7\" (UID: \"ce6521ad-6903-4888-b344-1f4d112ecbe7\") " Jul 07 17:05:07.915473 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.915419 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce6521ad-6903-4888-b344-1f4d112ecbe7-feast-data" (OuterVolumeSpecName: "feast-data") pod "ce6521ad-6903-4888-b344-1f4d112ecbe7" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:05:07.917041 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.917010 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ce6521ad-6903-4888-b344-1f4d112ecbe7" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:05:07.917173 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.917065 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6521ad-6903-4888-b344-1f4d112ecbe7-kube-api-access-c87hd" (OuterVolumeSpecName: "kube-api-access-c87hd") pod "ce6521ad-6903-4888-b344-1f4d112ecbe7" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7"). InnerVolumeSpecName "kube-api-access-c87hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:05:07.917173 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.917127 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce6521ad-6903-4888-b344-1f4d112ecbe7" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:05:07.917264 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.917219 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ce6521ad-6903-4888-b344-1f4d112ecbe7" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:05:07.917264 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:07.917247 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-online-tls" (OuterVolumeSpecName: "online-tls") pod "ce6521ad-6903-4888-b344-1f4d112ecbe7" (UID: "ce6521ad-6903-4888-b344-1f4d112ecbe7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:05:08.015733 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.015697 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-ui-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:05:08.015733 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.015731 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c87hd\" (UniqueName: \"kubernetes.io/projected/ce6521ad-6903-4888-b344-1f4d112ecbe7-kube-api-access-c87hd\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:05:08.015733 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.015742 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce6521ad-6903-4888-b344-1f4d112ecbe7-feast-data\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:05:08.015916 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.015750 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-registry-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:05:08.015916 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.015775 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-online-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:05:08.015916 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.015782 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce6521ad-6903-4888-b344-1f4d112ecbe7-offline-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:05:08.506569 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.506532 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" event={"ID":"ce6521ad-6903-4888-b344-1f4d112ecbe7","Type":"ContainerDied","Data":"9c739eb6a63a8b53fb46fb32b4ac8ac05f52711c6198d39402a877700598e6a0"} Jul 07 17:05:08.506569 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.506575 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t" Jul 07 17:05:08.507184 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.506593 2556 scope.go:117] "RemoveContainer" containerID="ec6759716e3bcb11f200a7296c5c1852908e08e5972d28152efd3b99e4ab3c56" Jul 07 17:05:08.515177 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.515161 2556 scope.go:117] "RemoveContainer" containerID="dfcb90a0d6458e898bf0d659278cb29695b47a384f3cd0656af37be9518ff4d9" Jul 07 17:05:08.522845 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.522828 2556 scope.go:117] "RemoveContainer" containerID="fcc1e0d13af34af22dfd945ddf35e308cf16b9cf8038e6ebd1c1cce57b865e02" Jul 07 17:05:08.528649 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.528629 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t"] Jul 07 17:05:08.530236 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.530203 2556 scope.go:117] "RemoveContainer" containerID="88b6b8334394210a687f98fb6cf4863c934c87b51038376513f0904ebe6c0472" Jul 07 17:05:08.533332 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.533309 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-lnr6t"] Jul 07 17:05:08.537926 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.537911 2556 scope.go:117] "RemoveContainer" containerID="2a78e944e70718778633f842c6995a796a33c1a6d3a474fa51a5cb130b46881a" Jul 07 17:05:08.544434 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:08.544409 2556 scope.go:117] "RemoveContainer" containerID="6c2b198dbc8ec28299a8a20be696c3288e13b8f96801e21ef38364e54b72c736" Jul 07 17:05:09.396930 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:05:09.396894 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" path="/var/lib/kubelet/pods/ce6521ad-6903-4888-b344-1f4d112ecbe7/volumes" Jul 07 17:06:02.854765 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.854732 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj"] Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.854960 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="registry" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.854970 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="registry" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.854981 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="feast-apply" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.854987 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="feast-apply" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.854994 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855000 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855007 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="offline" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855012 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="offline" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855022 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="feast-init" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855027 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="feast-init" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855035 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855039 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855096 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="online" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855104 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="registry" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855111 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="offline" Jul 07 17:06:02.855243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.855117 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6521ad-6903-4888-b344-1f4d112ecbe7" containerName="ui" Jul 07 17:06:02.858136 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.858117 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.861511 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.861490 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 07 17:06:02.861696 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.861679 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 07 17:06:02.861797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.861780 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 07 17:06:02.862051 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.862036 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 07 17:06:02.862354 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.862338 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 07 17:06:02.862449 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.862344 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-kbgzj\"" Jul 07 17:06:02.862798 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.862785 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 07 17:06:02.870863 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.870841 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj"] Jul 07 17:06:02.892964 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.892941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.893049 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.892969 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.893049 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.892993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/6260db14-5fd8-40b1-a714-671f5c534d43-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.893160 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.893045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.893160 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.893092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w464\" (UniqueName: \"kubernetes.io/projected/6260db14-5fd8-40b1-a714-671f5c534d43-kube-api-access-6w464\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.893160 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.893139 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6260db14-5fd8-40b1-a714-671f5c534d43-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.993788 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.993760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6260db14-5fd8-40b1-a714-671f5c534d43-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.993788 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.993792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.993988 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.993813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.993988 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.993835 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/6260db14-5fd8-40b1-a714-671f5c534d43-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.993988 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:06:02.993926 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 07 17:06:02.993988 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.993946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.994263 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:06:02.993923 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Jul 07 17:06:02.994263 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:06:02.993994 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls podName:6260db14-5fd8-40b1-a714-671f5c534d43 nodeName:}" failed. No retries permitted until 2026-07-07 17:06:03.49397229 +0000 UTC m=+1598.677183840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 07 17:06:02.994263 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.994065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w464\" (UniqueName: \"kubernetes.io/projected/6260db14-5fd8-40b1-a714-671f5c534d43-kube-api-access-6w464\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.994263 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:06:02.994174 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls podName:6260db14-5fd8-40b1-a714-671f5c534d43 nodeName:}" failed. No retries permitted until 2026-07-07 17:06:03.494156393 +0000 UTC m=+1598.677367946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls") pod "feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43") : secret "feast-simple-feast-remote-setup-online-tls" not found Jul 07 17:06:02.994263 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.994236 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6260db14-5fd8-40b1-a714-671f5c534d43-feast-data\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.994542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.994520 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/6260db14-5fd8-40b1-a714-671f5c534d43-registry-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:02.996383 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:02.996366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-offline-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.003151 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.003132 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w464\" (UniqueName: \"kubernetes.io/projected/6260db14-5fd8-40b1-a714-671f5c534d43-kube-api-access-6w464\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.497230 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.497193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.497230 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.497231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.499568 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.499543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.499708 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.499601 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls\") pod \"feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.767621 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.767526 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:03.892775 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:03.892736 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj"] Jul 07 17:06:03.893421 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:06:03.893378 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6260db14_5fd8_40b1_a714_671f5c534d43.slice/crio-d3a21afef3f38c70ee74c02cb872ff66c6ae2196740d8f1f83fbd2f10dda690b WatchSource:0}: Error finding container d3a21afef3f38c70ee74c02cb872ff66c6ae2196740d8f1f83fbd2f10dda690b: Status 404 returned error can't find the container with id d3a21afef3f38c70ee74c02cb872ff66c6ae2196740d8f1f83fbd2f10dda690b Jul 07 17:06:04.695723 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:04.695684 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerStarted","Data":"18c6e4019506e96fed4429a73726e083607400a81ab4d7d119272bd90490d6cf"} Jul 07 17:06:04.695881 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:04.695735 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerStarted","Data":"d3a21afef3f38c70ee74c02cb872ff66c6ae2196740d8f1f83fbd2f10dda690b"} Jul 07 17:06:08.710149 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:08.710117 2556 generic.go:356] "Generic (PLEG): container finished" podID="6260db14-5fd8-40b1-a714-671f5c534d43" containerID="18c6e4019506e96fed4429a73726e083607400a81ab4d7d119272bd90490d6cf" exitCode=0 Jul 07 17:06:08.710482 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:08.710193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerDied","Data":"18c6e4019506e96fed4429a73726e083607400a81ab4d7d119272bd90490d6cf"} Jul 07 17:06:09.715430 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:09.715399 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerStarted","Data":"36bf5c54a156718c8b100c04c3d6b0a4daa0a34e5308d23d219e5df9663bd2ad"} Jul 07 17:06:14.735490 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:14.735403 2556 generic.go:356] "Generic (PLEG): container finished" podID="6260db14-5fd8-40b1-a714-671f5c534d43" containerID="36bf5c54a156718c8b100c04c3d6b0a4daa0a34e5308d23d219e5df9663bd2ad" exitCode=0 Jul 07 17:06:14.735490 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:14.735463 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerDied","Data":"36bf5c54a156718c8b100c04c3d6b0a4daa0a34e5308d23d219e5df9663bd2ad"} Jul 07 17:06:15.744203 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.744165 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerStarted","Data":"bc43c59f67d46ebea3d7bd2ec239feccd2f111453e8dd8dcfb30fe0dcd061c4b"} Jul 07 17:06:15.744688 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.744215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerStarted","Data":"b7fc6a1eeb677068e8cdf2c22c1817a647bf85bb74f898ea607d812b213efdde"} Jul 07 17:06:15.744688 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.744229 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerStarted","Data":"2b09ece6ef65485d7c6ba04a1a75bdbf4b7cb5167147c92b915ef957f1866b6d"} Jul 07 17:06:15.767750 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.767719 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:15.767940 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.767771 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:15.767940 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.767792 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:15.769811 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.769738 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 07 17:06:15.769811 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.769789 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Jul 07 17:06:15.770020 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.769813 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 07 17:06:15.770689 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:15.770634 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podStartSLOduration=13.770617417 podStartE2EDuration="13.770617417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:06:15.767733722 +0000 UTC m=+1610.950945287" watchObservedRunningTime="2026-07-07 17:06:15.770617417 +0000 UTC m=+1610.953828983" Jul 07 17:06:18.768403 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:18.768298 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 07 17:06:18.768403 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:18.768330 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 07 17:06:18.768403 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:18.768302 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Jul 07 17:06:21.768928 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:21.768893 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:21.769437 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:21.769417 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:21.769518 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:21.769456 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:21.769726 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:21.769710 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:21.775568 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:21.775548 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:22.770771 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:22.770713 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:22.771232 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:22.770783 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:22.771280 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:22.771229 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:06:22.775587 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:06:22.775562 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:07:23.910218 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:23.910185 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj"] Jul 07 17:07:23.910770 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:23.910706 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" containerID="cri-o://2b09ece6ef65485d7c6ba04a1a75bdbf4b7cb5167147c92b915ef957f1866b6d" gracePeriod=30 Jul 07 17:07:23.910861 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:23.910798 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="offline" containerID="cri-o://b7fc6a1eeb677068e8cdf2c22c1817a647bf85bb74f898ea607d812b213efdde" gracePeriod=30 Jul 07 17:07:23.910975 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:23.910797 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" containerID="cri-o://bc43c59f67d46ebea3d7bd2ec239feccd2f111453e8dd8dcfb30fe0dcd061c4b" gracePeriod=30 Jul 07 17:07:24.061156 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.061121 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b"] Jul 07 17:07:24.061427 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.061397 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="registry" containerID="cri-o://5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e" gracePeriod=30 Jul 07 17:07:24.061667 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.061463 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" containerID="cri-o://eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1" gracePeriod=30 Jul 07 17:07:24.061782 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.061478 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" containerID="cri-o://dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95" gracePeriod=30 Jul 07 17:07:24.061854 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.061513 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="offline" containerID="cri-o://68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475" gracePeriod=30 Jul 07 17:07:24.982758 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.982663 2556 generic.go:356] "Generic (PLEG): container finished" podID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerID="eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1" exitCode=0 Jul 07 17:07:24.982758 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.982690 2556 generic.go:356] "Generic (PLEG): container finished" podID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerID="dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95" exitCode=0 Jul 07 17:07:24.983179 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.982752 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1"} Jul 07 17:07:24.983179 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.982797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95"} Jul 07 17:07:24.985311 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.985293 2556 generic.go:356] "Generic (PLEG): container finished" podID="6260db14-5fd8-40b1-a714-671f5c534d43" containerID="bc43c59f67d46ebea3d7bd2ec239feccd2f111453e8dd8dcfb30fe0dcd061c4b" exitCode=0 Jul 07 17:07:24.985311 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.985308 2556 generic.go:356] "Generic (PLEG): container finished" podID="6260db14-5fd8-40b1-a714-671f5c534d43" containerID="2b09ece6ef65485d7c6ba04a1a75bdbf4b7cb5167147c92b915ef957f1866b6d" exitCode=0 Jul 07 17:07:24.985459 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.985367 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerDied","Data":"bc43c59f67d46ebea3d7bd2ec239feccd2f111453e8dd8dcfb30fe0dcd061c4b"} Jul 07 17:07:24.985459 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:24.985396 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerDied","Data":"2b09ece6ef65485d7c6ba04a1a75bdbf4b7cb5167147c92b915ef957f1866b6d"} Jul 07 17:07:27.464752 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:27.464718 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 07 17:07:30.474649 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:30.474608 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 07 17:07:31.769564 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:31.769523 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 07 17:07:32.771038 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:32.770992 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 07 17:07:37.464780 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:37.464744 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 07 17:07:40.474657 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:40.474619 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 07 17:07:41.770184 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:41.770134 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 07 17:07:42.771468 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:42.771425 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 07 17:07:47.465238 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:47.465153 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Jul 07 17:07:47.465657 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:47.465287 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:07:50.475365 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:50.475320 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Jul 07 17:07:50.475836 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:50.475448 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:07:51.770155 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:51.770116 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 07 17:07:51.770544 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:51.770248 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:07:52.771578 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:52.771532 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 07 17:07:52.772016 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:52.771688 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:07:54.082769 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.082731 2556 generic.go:356] "Generic (PLEG): container finished" podID="6260db14-5fd8-40b1-a714-671f5c534d43" containerID="b7fc6a1eeb677068e8cdf2c22c1817a647bf85bb74f898ea607d812b213efdde" exitCode=137 Jul 07 17:07:54.083144 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.082801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerDied","Data":"b7fc6a1eeb677068e8cdf2c22c1817a647bf85bb74f898ea607d812b213efdde"} Jul 07 17:07:54.563263 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.563239 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:07:54.604629 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.604599 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w464\" (UniqueName: \"kubernetes.io/projected/6260db14-5fd8-40b1-a714-671f5c534d43-kube-api-access-6w464\") pod \"6260db14-5fd8-40b1-a714-671f5c534d43\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " Jul 07 17:07:54.604797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.604643 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/6260db14-5fd8-40b1-a714-671f5c534d43-registry-tls\") pod \"6260db14-5fd8-40b1-a714-671f5c534d43\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " Jul 07 17:07:54.604797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.604678 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls\") pod \"6260db14-5fd8-40b1-a714-671f5c534d43\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " Jul 07 17:07:54.604797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.604696 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls\") pod \"6260db14-5fd8-40b1-a714-671f5c534d43\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " Jul 07 17:07:54.604797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.604724 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-offline-tls\") pod \"6260db14-5fd8-40b1-a714-671f5c534d43\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " Jul 07 17:07:54.604797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.604762 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6260db14-5fd8-40b1-a714-671f5c534d43-feast-data\") pod \"6260db14-5fd8-40b1-a714-671f5c534d43\" (UID: \"6260db14-5fd8-40b1-a714-671f5c534d43\") " Jul 07 17:07:54.605385 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.605332 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6260db14-5fd8-40b1-a714-671f5c534d43-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6260db14-5fd8-40b1-a714-671f5c534d43" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:07:54.605569 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.605536 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6260db14-5fd8-40b1-a714-671f5c534d43-feast-data" (OuterVolumeSpecName: "feast-data") pod "6260db14-5fd8-40b1-a714-671f5c534d43" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:07:54.607157 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.607122 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6260db14-5fd8-40b1-a714-671f5c534d43-kube-api-access-6w464" (OuterVolumeSpecName: "kube-api-access-6w464") pod "6260db14-5fd8-40b1-a714-671f5c534d43" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43"). InnerVolumeSpecName "kube-api-access-6w464". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:07:54.607284 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.607220 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6260db14-5fd8-40b1-a714-671f5c534d43" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.607338 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.607315 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls" (OuterVolumeSpecName: "online-tls") pod "6260db14-5fd8-40b1-a714-671f5c534d43" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.607374 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.607331 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6260db14-5fd8-40b1-a714-671f5c534d43" (UID: "6260db14-5fd8-40b1-a714-671f5c534d43"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.705034 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705009 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:07:54.705335 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705317 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w464\" (UniqueName: \"kubernetes.io/projected/6260db14-5fd8-40b1-a714-671f5c534d43-kube-api-access-6w464\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.705380 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705339 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/6260db14-5fd8-40b1-a714-671f5c534d43-registry-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.705380 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705367 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-online-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.705380 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705375 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-ui-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.705468 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705383 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6260db14-5fd8-40b1-a714-671f5c534d43-offline-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.705468 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.705390 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6260db14-5fd8-40b1-a714-671f5c534d43-feast-data\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.806025 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.805993 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2xmf\" (UniqueName: \"kubernetes.io/projected/14d5f815-6a41-4ed1-8b16-13eb851513fe-kube-api-access-b2xmf\") pod \"14d5f815-6a41-4ed1-8b16-13eb851513fe\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " Jul 07 17:07:54.806206 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.806033 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-online-tls\") pod \"14d5f815-6a41-4ed1-8b16-13eb851513fe\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " Jul 07 17:07:54.806206 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.806059 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls\") pod \"14d5f815-6a41-4ed1-8b16-13eb851513fe\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " Jul 07 17:07:54.806206 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.806121 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-ui-tls\") pod \"14d5f815-6a41-4ed1-8b16-13eb851513fe\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " Jul 07 17:07:54.806206 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.806140 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls\") pod \"14d5f815-6a41-4ed1-8b16-13eb851513fe\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " Jul 07 17:07:54.806206 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.806167 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/14d5f815-6a41-4ed1-8b16-13eb851513fe-feast-data\") pod \"14d5f815-6a41-4ed1-8b16-13eb851513fe\" (UID: \"14d5f815-6a41-4ed1-8b16-13eb851513fe\") " Jul 07 17:07:54.806860 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.806826 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14d5f815-6a41-4ed1-8b16-13eb851513fe-feast-data" (OuterVolumeSpecName: "feast-data") pod "14d5f815-6a41-4ed1-8b16-13eb851513fe" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:07:54.808311 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.808281 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14d5f815-6a41-4ed1-8b16-13eb851513fe-kube-api-access-b2xmf" (OuterVolumeSpecName: "kube-api-access-b2xmf") pod "14d5f815-6a41-4ed1-8b16-13eb851513fe" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe"). InnerVolumeSpecName "kube-api-access-b2xmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:07:54.808405 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.808317 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "14d5f815-6a41-4ed1-8b16-13eb851513fe" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.808405 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.808341 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "14d5f815-6a41-4ed1-8b16-13eb851513fe" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.808603 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.808585 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-online-tls" (OuterVolumeSpecName: "online-tls") pod "14d5f815-6a41-4ed1-8b16-13eb851513fe" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.808660 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.808608 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "14d5f815-6a41-4ed1-8b16-13eb851513fe" (UID: "14d5f815-6a41-4ed1-8b16-13eb851513fe"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:07:54.907259 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.907223 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/14d5f815-6a41-4ed1-8b16-13eb851513fe-feast-data\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.907259 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.907254 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2xmf\" (UniqueName: \"kubernetes.io/projected/14d5f815-6a41-4ed1-8b16-13eb851513fe-kube-api-access-b2xmf\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.907259 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.907264 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-online-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.907472 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.907273 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-offline-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.907472 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.907282 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-ui-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:54.907472 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:54.907289 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/14d5f815-6a41-4ed1-8b16-13eb851513fe-registry-tls\") on node \"ip-10-0-140-181.ec2.internal\" DevicePath \"\"" Jul 07 17:07:55.089408 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089320 2556 generic.go:356] "Generic (PLEG): container finished" podID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerID="68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475" exitCode=137 Jul 07 17:07:55.089408 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089348 2556 generic.go:356] "Generic (PLEG): container finished" podID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerID="5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e" exitCode=137 Jul 07 17:07:55.089408 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089397 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" Jul 07 17:07:55.090125 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089415 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475"} Jul 07 17:07:55.090125 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e"} Jul 07 17:07:55.090125 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089508 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b" event={"ID":"14d5f815-6a41-4ed1-8b16-13eb851513fe","Type":"ContainerDied","Data":"27e5bd7311cc84047e41077d48312c10dc78f694576517853e508273e5bc9747"} Jul 07 17:07:55.090125 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.089532 2556 scope.go:117] "RemoveContainer" containerID="eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1" Jul 07 17:07:55.092292 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.092266 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" event={"ID":"6260db14-5fd8-40b1-a714-671f5c534d43","Type":"ContainerDied","Data":"d3a21afef3f38c70ee74c02cb872ff66c6ae2196740d8f1f83fbd2f10dda690b"} Jul 07 17:07:55.092292 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.092290 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj" Jul 07 17:07:55.097753 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.097740 2556 scope.go:117] "RemoveContainer" containerID="68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475" Jul 07 17:07:55.105793 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.105778 2556 scope.go:117] "RemoveContainer" containerID="dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95" Jul 07 17:07:55.113329 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.113170 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b"] Jul 07 17:07:55.113329 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.113217 2556 scope.go:117] "RemoveContainer" containerID="5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e" Jul 07 17:07:55.117709 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.117690 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-796bc5bb56-gb79b"] Jul 07 17:07:55.120957 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.120939 2556 scope.go:117] "RemoveContainer" containerID="7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7" Jul 07 17:07:55.127728 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.127711 2556 scope.go:117] "RemoveContainer" containerID="173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2" Jul 07 17:07:55.129902 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.129881 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj"] Jul 07 17:07:55.133666 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.133643 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-74bdf4fbf8-zxfwj"] Jul 07 17:07:55.135927 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.135909 2556 scope.go:117] "RemoveContainer" containerID="eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1" Jul 07 17:07:55.136188 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:07:55.136170 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1\": container with ID starting with eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1 not found: ID does not exist" containerID="eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1" Jul 07 17:07:55.136243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136197 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1"} err="failed to get container status \"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1\": rpc error: code = NotFound desc = could not find container \"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1\": container with ID starting with eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1 not found: ID does not exist" Jul 07 17:07:55.136243 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136217 2556 scope.go:117] "RemoveContainer" containerID="68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475" Jul 07 17:07:55.136434 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:07:55.136420 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475\": container with ID starting with 68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475 not found: ID does not exist" containerID="68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475" Jul 07 17:07:55.136474 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136436 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475"} err="failed to get container status \"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475\": rpc error: code = NotFound desc = could not find container \"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475\": container with ID starting with 68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475 not found: ID does not exist" Jul 07 17:07:55.136474 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136448 2556 scope.go:117] "RemoveContainer" containerID="dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95" Jul 07 17:07:55.136660 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:07:55.136643 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95\": container with ID starting with dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95 not found: ID does not exist" containerID="dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95" Jul 07 17:07:55.136700 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136666 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95"} err="failed to get container status \"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95\": rpc error: code = NotFound desc = could not find container \"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95\": container with ID starting with dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95 not found: ID does not exist" Jul 07 17:07:55.136700 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136681 2556 scope.go:117] "RemoveContainer" containerID="5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e" Jul 07 17:07:55.136908 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:07:55.136891 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e\": container with ID starting with 5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e not found: ID does not exist" containerID="5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e" Jul 07 17:07:55.136955 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136913 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e"} err="failed to get container status \"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e\": rpc error: code = NotFound desc = could not find container \"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e\": container with ID starting with 5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e not found: ID does not exist" Jul 07 17:07:55.136955 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.136927 2556 scope.go:117] "RemoveContainer" containerID="7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7" Jul 07 17:07:55.137219 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:07:55.137200 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7\": container with ID starting with 7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7 not found: ID does not exist" containerID="7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7" Jul 07 17:07:55.137285 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137221 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7"} err="failed to get container status \"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7\": rpc error: code = NotFound desc = could not find container \"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7\": container with ID starting with 7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7 not found: ID does not exist" Jul 07 17:07:55.137285 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137234 2556 scope.go:117] "RemoveContainer" containerID="173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2" Jul 07 17:07:55.137433 ip-10-0-140-181 kubenswrapper[2556]: E0707 17:07:55.137418 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2\": container with ID starting with 173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2 not found: ID does not exist" containerID="173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2" Jul 07 17:07:55.137469 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137436 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2"} err="failed to get container status \"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2\": rpc error: code = NotFound desc = could not find container \"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2\": container with ID starting with 173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2 not found: ID does not exist" Jul 07 17:07:55.137469 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137448 2556 scope.go:117] "RemoveContainer" containerID="eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1" Jul 07 17:07:55.137695 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137677 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1"} err="failed to get container status \"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1\": rpc error: code = NotFound desc = could not find container \"eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1\": container with ID starting with eb3266ba0a06aad9db5b422d20ac8fbdc9fb3058ca97063a6800abf1b14a58e1 not found: ID does not exist" Jul 07 17:07:55.137734 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137696 2556 scope.go:117] "RemoveContainer" containerID="68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475" Jul 07 17:07:55.137914 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137896 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475"} err="failed to get container status \"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475\": rpc error: code = NotFound desc = could not find container \"68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475\": container with ID starting with 68434fcba2475978fa4b4785c72e2f2d85ad1e7c9c379de7ec5b5e883089c475 not found: ID does not exist" Jul 07 17:07:55.137969 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.137915 2556 scope.go:117] "RemoveContainer" containerID="dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95" Jul 07 17:07:55.138169 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138152 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95"} err="failed to get container status \"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95\": rpc error: code = NotFound desc = could not find container \"dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95\": container with ID starting with dd8c40cedb814a00b23873ee580c794049254394fa2b10f99e1b47895dddaa95 not found: ID does not exist" Jul 07 17:07:55.138169 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138169 2556 scope.go:117] "RemoveContainer" containerID="5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e" Jul 07 17:07:55.138400 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138386 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e"} err="failed to get container status \"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e\": rpc error: code = NotFound desc = could not find container \"5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e\": container with ID starting with 5d9947a964d44951dd70ec9c2aa09bd6f97bac24d554e9027680d977d5df567e not found: ID does not exist" Jul 07 17:07:55.138400 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138400 2556 scope.go:117] "RemoveContainer" containerID="7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7" Jul 07 17:07:55.138600 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138584 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7"} err="failed to get container status \"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7\": rpc error: code = NotFound desc = could not find container \"7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7\": container with ID starting with 7112b9e727118f14f637607a17f5f2a278742036b1aa1c0a013c94656bf4adc7 not found: ID does not exist" Jul 07 17:07:55.138643 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138602 2556 scope.go:117] "RemoveContainer" containerID="173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2" Jul 07 17:07:55.138827 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138812 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2"} err="failed to get container status \"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2\": rpc error: code = NotFound desc = could not find container \"173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2\": container with ID starting with 173774d8c2928de8232f56969eef3fa0b37bcfb2cc58babe894cec8dd672a6d2 not found: ID does not exist" Jul 07 17:07:55.138872 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.138828 2556 scope.go:117] "RemoveContainer" containerID="bc43c59f67d46ebea3d7bd2ec239feccd2f111453e8dd8dcfb30fe0dcd061c4b" Jul 07 17:07:55.145772 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.145756 2556 scope.go:117] "RemoveContainer" containerID="b7fc6a1eeb677068e8cdf2c22c1817a647bf85bb74f898ea607d812b213efdde" Jul 07 17:07:55.152454 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.152437 2556 scope.go:117] "RemoveContainer" containerID="2b09ece6ef65485d7c6ba04a1a75bdbf4b7cb5167147c92b915ef957f1866b6d" Jul 07 17:07:55.158920 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.158904 2556 scope.go:117] "RemoveContainer" containerID="36bf5c54a156718c8b100c04c3d6b0a4daa0a34e5308d23d219e5df9663bd2ad" Jul 07 17:07:55.165567 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.165550 2556 scope.go:117] "RemoveContainer" containerID="18c6e4019506e96fed4429a73726e083607400a81ab4d7d119272bd90490d6cf" Jul 07 17:07:55.392176 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.392143 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" path="/var/lib/kubelet/pods/14d5f815-6a41-4ed1-8b16-13eb851513fe/volumes" Jul 07 17:07:55.392736 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:07:55.392723 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" path="/var/lib/kubelet/pods/6260db14-5fd8-40b1-a714-671f5c534d43/volumes" Jul 07 17:08:31.344188 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344152 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xbt6x/must-gather-gjrpf"] Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344367 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="offline" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344377 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="offline" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344393 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="registry" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344399 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="registry" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344405 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="feast-init" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344411 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="feast-init" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344416 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="feast-apply" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344420 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="feast-apply" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344431 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="feast-apply" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344436 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="feast-apply" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344444 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344449 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344456 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344461 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344467 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="feast-init" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344472 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="feast-init" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344478 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="offline" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344483 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="offline" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344489 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344494 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344500 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344504 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344543 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="ui" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344550 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="registry" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344556 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="offline" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344562 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="ui" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344567 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="online" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344572 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="14d5f815-6a41-4ed1-8b16-13eb851513fe" containerName="offline" Jul 07 17:08:31.344624 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.344577 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6260db14-5fd8-40b1-a714-671f5c534d43" containerName="online" Jul 07 17:08:31.347270 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.347254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.354582 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.354555 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbt6x\"/\"kube-root-ca.crt\"" Jul 07 17:08:31.354582 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.354569 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xbt6x\"/\"default-dockercfg-4fl5h\"" Jul 07 17:08:31.354783 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.354613 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbt6x\"/\"openshift-service-ca.crt\"" Jul 07 17:08:31.358812 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.358787 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbt6x/must-gather-gjrpf"] Jul 07 17:08:31.459515 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.459478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3218e78d-f6ed-412b-b6bc-96602a640fbf-must-gather-output\") pod \"must-gather-gjrpf\" (UID: \"3218e78d-f6ed-412b-b6bc-96602a640fbf\") " pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.459675 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.459534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk828\" (UniqueName: \"kubernetes.io/projected/3218e78d-f6ed-412b-b6bc-96602a640fbf-kube-api-access-mk828\") pod \"must-gather-gjrpf\" (UID: \"3218e78d-f6ed-412b-b6bc-96602a640fbf\") " pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.560815 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.560783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3218e78d-f6ed-412b-b6bc-96602a640fbf-must-gather-output\") pod \"must-gather-gjrpf\" (UID: \"3218e78d-f6ed-412b-b6bc-96602a640fbf\") " pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.560937 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.560829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk828\" (UniqueName: \"kubernetes.io/projected/3218e78d-f6ed-412b-b6bc-96602a640fbf-kube-api-access-mk828\") pod \"must-gather-gjrpf\" (UID: \"3218e78d-f6ed-412b-b6bc-96602a640fbf\") " pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.561166 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.561145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3218e78d-f6ed-412b-b6bc-96602a640fbf-must-gather-output\") pod \"must-gather-gjrpf\" (UID: \"3218e78d-f6ed-412b-b6bc-96602a640fbf\") " pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.570888 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.570866 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk828\" (UniqueName: \"kubernetes.io/projected/3218e78d-f6ed-412b-b6bc-96602a640fbf-kube-api-access-mk828\") pod \"must-gather-gjrpf\" (UID: \"3218e78d-f6ed-412b-b6bc-96602a640fbf\") " pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.658829 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.658787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbt6x/must-gather-gjrpf" Jul 07 17:08:31.780795 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.780715 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbt6x/must-gather-gjrpf"] Jul 07 17:08:31.783293 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:08:31.783265 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3218e78d_f6ed_412b_b6bc_96602a640fbf.slice/crio-daf23c08402761a41189ecd5660b93717d4077d36899a07885f618613dd14499 WatchSource:0}: Error finding container daf23c08402761a41189ecd5660b93717d4077d36899a07885f618613dd14499: Status 404 returned error can't find the container with id daf23c08402761a41189ecd5660b93717d4077d36899a07885f618613dd14499 Jul 07 17:08:31.785115 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:31.785096 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:08:32.215609 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:32.215577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/must-gather-gjrpf" event={"ID":"3218e78d-f6ed-412b-b6bc-96602a640fbf","Type":"ContainerStarted","Data":"daf23c08402761a41189ecd5660b93717d4077d36899a07885f618613dd14499"} Jul 07 17:08:33.221358 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:33.221315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/must-gather-gjrpf" event={"ID":"3218e78d-f6ed-412b-b6bc-96602a640fbf","Type":"ContainerStarted","Data":"8f31ff67bcaaee95ed029d7ad5ce39fe3530a62d3289d98b8ecc76c6d1ad5ec1"} Jul 07 17:08:33.221813 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:33.221366 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/must-gather-gjrpf" event={"ID":"3218e78d-f6ed-412b-b6bc-96602a640fbf","Type":"ContainerStarted","Data":"9288fb09aa9761e7c501f3d82caa2ef42fa6886e215dc0a35e24163f3269e9d9"} Jul 07 17:08:33.239123 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:33.239035 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xbt6x/must-gather-gjrpf" podStartSLOduration=1.203781944 podStartE2EDuration="2.239019197s" totalImagesPullingTime="1.035237253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:33.237036459 +0000 UTC m=+1748.420248024" watchObservedRunningTime="2026-07-07 17:08:33.239019197 +0000 UTC m=+1748.422230761" Jul 07 17:08:34.284343 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:34.284313 2556 ???:1] "http: TLS handshake error from 10.0.140.181:49442: EOF" Jul 07 17:08:34.288303 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:34.288278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zq669_27e0fd5f-894c-48ad-96f5-ef88c5936523/global-pull-secret-syncer/0.log" Jul 07 17:08:34.366395 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:34.366367 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d848s_f4cfde5c-d2bc-45aa-92c1-17715f3826d6/konnectivity-agent/0.log" Jul 07 17:08:34.472308 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:34.472276 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-181.ec2.internal_e58dd0cdc0f5405fc8099a4667ba370b/haproxy/0.log" Jul 07 17:08:38.327279 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:38.327207 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8xz5w_19429615-c998-4b1f-9992-bca6f0d630b8/node-exporter/0.log" Jul 07 17:08:38.356222 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:38.356179 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8xz5w_19429615-c998-4b1f-9992-bca6f0d630b8/kube-rbac-proxy/0.log" Jul 07 17:08:38.385280 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:38.385245 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8xz5w_19429615-c998-4b1f-9992-bca6f0d630b8/init-textfile/0.log" Jul 07 17:08:41.527208 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.527156 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w"] Jul 07 17:08:41.530421 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.530392 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.542836 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.541615 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w"] Jul 07 17:08:41.652205 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.652169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbs8b\" (UniqueName: \"kubernetes.io/projected/8e1477ec-fb77-4ca8-8b68-805589df1ceb-kube-api-access-vbs8b\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.652466 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.652444 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-proc\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.652664 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.652635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-lib-modules\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.652753 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.652681 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-podres\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.652816 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.652784 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-sys\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753309 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-sys\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753452 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbs8b\" (UniqueName: \"kubernetes.io/projected/8e1477ec-fb77-4ca8-8b68-805589df1ceb-kube-api-access-vbs8b\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753452 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-proc\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753452 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-lib-modules\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753452 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753394 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-sys\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753591 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-podres\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753591 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753463 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-proc\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753591 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-lib-modules\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.753591 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.753552 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8e1477ec-fb77-4ca8-8b68-805589df1ceb-podres\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.763179 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.763152 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbs8b\" (UniqueName: \"kubernetes.io/projected/8e1477ec-fb77-4ca8-8b68-805589df1ceb-kube-api-access-vbs8b\") pod \"perf-node-gather-daemonset-4qd2w\" (UID: \"8e1477ec-fb77-4ca8-8b68-805589df1ceb\") " pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.844793 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.844697 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:41.982789 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:41.982755 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w"] Jul 07 17:08:41.986792 ip-10-0-140-181 kubenswrapper[2556]: W0707 17:08:41.986739 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8e1477ec_fb77_4ca8_8b68_805589df1ceb.slice/crio-ac8226054404e944e08c425a34697650ef30b50c059ff9dc3dc62cb1fa04e551 WatchSource:0}: Error finding container ac8226054404e944e08c425a34697650ef30b50c059ff9dc3dc62cb1fa04e551: Status 404 returned error can't find the container with id ac8226054404e944e08c425a34697650ef30b50c059ff9dc3dc62cb1fa04e551 Jul 07 17:08:42.264279 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.264238 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" event={"ID":"8e1477ec-fb77-4ca8-8b68-805589df1ceb","Type":"ContainerStarted","Data":"3fd504e5d851b18162fed8849e9ab77972a8ed2618f6366ed955182a22df741e"} Jul 07 17:08:42.264473 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.264304 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" event={"ID":"8e1477ec-fb77-4ca8-8b68-805589df1ceb","Type":"ContainerStarted","Data":"ac8226054404e944e08c425a34697650ef30b50c059ff9dc3dc62cb1fa04e551"} Jul 07 17:08:42.264473 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.264430 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:42.281538 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.281479 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" podStartSLOduration=1.281458988 podStartE2EDuration="1.281458988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:42.279858138 +0000 UTC m=+1757.463069704" watchObservedRunningTime="2026-07-07 17:08:42.281458988 +0000 UTC m=+1757.464670554" Jul 07 17:08:42.529480 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.529455 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mfx4_048b3d95-c797-4d69-99b5-cfb89762a7ae/dns/0.log" Jul 07 17:08:42.552273 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.552252 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mfx4_048b3d95-c797-4d69-99b5-cfb89762a7ae/kube-rbac-proxy/0.log" Jul 07 17:08:42.741200 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:42.741174 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wtbc6_0e3cdf6b-551c-47a4-82bc-7cf707bb6276/dns-node-resolver/0.log" Jul 07 17:08:43.189264 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:43.189237 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cdk94_b180eae7-efc9-4217-a331-c633e665b65d/node-ca/0.log" Jul 07 17:08:44.236921 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:44.236891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4gsn_902b1e0c-4944-40cd-9069-da577310c4e1/serve-healthcheck-canary/0.log" Jul 07 17:08:44.692614 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:44.692583 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nz6lv_7732a0a0-fcf8-4af4-8c5b-52a3fac92dde/kube-rbac-proxy/0.log" Jul 07 17:08:44.715408 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:44.715380 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nz6lv_7732a0a0-fcf8-4af4-8c5b-52a3fac92dde/exporter/0.log" Jul 07 17:08:44.737635 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:44.737605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nz6lv_7732a0a0-fcf8-4af4-8c5b-52a3fac92dde/extractor/0.log" Jul 07 17:08:48.281305 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:48.281274 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xbt6x/perf-node-gather-daemonset-4qd2w" Jul 07 17:08:50.090783 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.090761 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/kube-multus-additional-cni-plugins/0.log" Jul 07 17:08:50.120007 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.119973 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/egress-router-binary-copy/0.log" Jul 07 17:08:50.145784 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.145761 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/cni-plugins/0.log" Jul 07 17:08:50.170538 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.170510 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/bond-cni-plugin/0.log" Jul 07 17:08:50.220356 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.220321 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/routeoverride-cni/0.log" Jul 07 17:08:50.260290 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.260245 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/whereabouts-cni-bincopy/0.log" Jul 07 17:08:50.285542 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.285515 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j26pj_992d6246-04a4-4894-ab05-ae47ffc61b23/whereabouts-cni/0.log" Jul 07 17:08:50.731345 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.731268 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v6hmb_706bd165-ead0-4400-9c90-bbd6e7045e67/kube-multus/0.log" Jul 07 17:08:50.784535 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.784505 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8gt7s_2590fb43-7081-41d3-9e62-13443bac9092/network-metrics-daemon/0.log" Jul 07 17:08:50.807244 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:50.807204 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8gt7s_2590fb43-7081-41d3-9e62-13443bac9092/kube-rbac-proxy/0.log" Jul 07 17:08:51.633705 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.633676 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/ovn-controller/0.log" Jul 07 17:08:51.654459 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.654431 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/ovn-acl-logging/0.log" Jul 07 17:08:51.678735 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.678710 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/kube-rbac-proxy-node/0.log" Jul 07 17:08:51.701947 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.701913 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 17:08:51.726687 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.726659 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/northd/0.log" Jul 07 17:08:51.749719 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.749694 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/nbdb/0.log" Jul 07 17:08:51.772269 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.772242 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/sbdb/0.log" Jul 07 17:08:51.817082 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:51.817043 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4mw9j_eec6a56b-27f4-47d7-9c31-a70bdfbb7997/ovnkube-controller/0.log" Jul 07 17:08:53.210091 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:53.210044 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-g6l75_caed1878-a100-4f89-8473-0745cb6c9918/network-check-target-container/0.log" Jul 07 17:08:54.164157 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:54.164130 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-w9884_625a886c-f29c-4007-b699-837c76793696/iptables-alerter/0.log" Jul 07 17:08:54.795797 ip-10-0-140-181 kubenswrapper[2556]: I0707 17:08:54.795769 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gqb68_dd5a7884-1fa8-4bd9-b3f0-c4f46d3ad0ff/tuned/0.log"