Sep 08 10:04:37.550319 ip-10-0-131-17 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 08 10:04:37.550333 ip-10-0-131-17 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 08 10:04:37.550341 ip-10-0-131-17 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 08 10:04:37.550714 ip-10-0-131-17 systemd[1]: Failed to start Kubernetes Kubelet. Sep 08 10:04:47.567074 ip-10-0-131-17 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 08 10:04:47.567090 ip-10-0-131-17 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aeabbd2622af4047861968b4ee31f3b9 -- Sep 08 10:06:38.489090 ip-10-0-131-17 systemd[1]: Starting Kubernetes Kubelet... Sep 08 10:06:38.857024 ip-10-0-131-17 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:06:38.857024 ip-10-0-131-17 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 10:06:38.857024 ip-10-0-131-17 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:06:38.857024 ip-10-0-131-17 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 10:06:38.857024 ip-10-0-131-17 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:06:38.857886 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.857141 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 10:06:38.860553 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860527 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:06:38.860553 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860548 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:06:38.860553 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860554 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:06:38.860553 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860558 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:06:38.860553 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860562 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860566 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860573 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860579 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860583 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860586 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860590 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860594 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860598 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860601 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860605 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860608 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860612 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860616 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860619 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860625 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860630 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860634 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860639 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:06:38.860879 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860642 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860658 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860663 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860667 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860671 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860675 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860679 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860683 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860687 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860692 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860696 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860700 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860704 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860708 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860713 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860718 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860722 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860745 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860750 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860754 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:06:38.861666 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860758 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860762 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860766 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860770 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860775 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860779 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860785 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860789 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860793 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860797 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860801 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860806 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860811 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860815 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860820 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860824 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860828 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860832 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860836 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:06:38.862525 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860840 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860844 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860848 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860853 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860857 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860861 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860867 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860871 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860878 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860882 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860887 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860891 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860895 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860901 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860907 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860911 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860916 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860920 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860926 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:06:38.863326 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860930 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860934 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860939 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860943 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860947 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860952 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860956 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860960 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860965 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860969 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860973 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860977 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860981 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860985 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860989 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860993 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.860997 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.861001 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862226 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862238 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:06:38.864206 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862244 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862249 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862255 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862260 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862264 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862269 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862273 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862278 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862282 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862286 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862290 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862295 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862301 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862305 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862309 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862313 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862317 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862322 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862326 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862331 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:06:38.865079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862335 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862339 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862343 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862347 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862351 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862355 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862359 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862363 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862367 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862372 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862375 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862379 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862384 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862389 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862393 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862397 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862401 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862405 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862409 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862413 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:06:38.865844 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862417 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862421 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862427 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862431 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862435 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862441 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862446 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862450 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862454 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862458 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862463 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862467 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862471 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862475 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862479 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862483 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862487 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862491 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862496 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862500 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:06:38.866369 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862504 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862508 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862513 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862517 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862521 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862525 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862529 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862532 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862536 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862540 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862547 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862552 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862557 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862566 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862572 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862577 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862583 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862588 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862594 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:06:38.866933 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862599 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862603 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862609 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862615 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862621 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862626 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862630 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862635 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862639 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862644 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862648 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862652 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862657 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862660 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862665 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862669 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862674 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.862678 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863334 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:06:38.867583 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863342 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863349 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863355 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863361 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863366 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863370 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863375 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863379 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863384 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863388 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863392 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863396 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863401 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863408 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863414 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863418 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863423 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863426 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863430 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:06:38.868170 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863435 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863439 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863443 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863447 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863451 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863455 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863459 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863463 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863467 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863472 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863476 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863479 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863486 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863490 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863495 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863499 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863503 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863507 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863511 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863515 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:06:38.868719 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863520 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863525 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863529 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863533 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863537 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863541 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863546 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863550 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863554 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863558 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863562 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863566 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863570 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863574 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863579 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863583 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863587 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863591 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863595 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863599 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:06:38.869250 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863603 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863607 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863611 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863615 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863621 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863625 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863630 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863634 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863638 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863642 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863646 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863649 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863653 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863657 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863663 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863667 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863671 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863678 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863683 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:06:38.869786 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863689 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863693 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863697 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863701 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863705 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863709 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863713 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863717 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863721 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863748 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863753 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863756 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863760 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863765 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863769 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863773 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863777 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863783 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863788 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.863792 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:06:38.870293 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863902 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863958 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863967 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863974 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863980 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863986 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.863992 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864000 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864006 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864012 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864018 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864023 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864028 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864034 2577 flags.go:64] FLAG: --cgroup-root="" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864039 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864044 2577 flags.go:64] FLAG: --client-ca-file="" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864049 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864054 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864061 2577 flags.go:64] FLAG: --cluster-domain="" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864065 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864070 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864075 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864080 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864086 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 10:06:38.870797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864091 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864096 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864102 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864107 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864112 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864118 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864124 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864129 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864135 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864140 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864145 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864150 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864155 2577 flags.go:64] FLAG: --enable-server="true" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864159 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864166 2577 flags.go:64] FLAG: --event-burst="100" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864170 2577 flags.go:64] FLAG: --event-qps="50" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864175 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864180 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864187 2577 flags.go:64] FLAG: --eviction-hard="" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864193 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864198 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864203 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864208 2577 flags.go:64] FLAG: --eviction-soft="" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864213 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864218 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 10:06:38.871374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864222 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864227 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864231 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864236 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864240 2577 flags.go:64] FLAG: --feature-gates="" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864247 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864252 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864257 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864262 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864267 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864271 2577 flags.go:64] FLAG: --help="false" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864276 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-17.ec2.internal" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864281 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864286 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864290 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864296 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864301 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864306 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864310 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864315 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864319 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864324 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864329 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864333 2577 flags.go:64] FLAG: --kube-reserved="" Sep 08 10:06:38.872113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864338 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864345 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864350 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864354 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864359 2577 flags.go:64] FLAG: --lock-file="" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864363 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864369 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864374 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864383 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864387 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864392 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864397 2577 flags.go:64] FLAG: --logging-format="text" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864401 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864406 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864417 2577 flags.go:64] FLAG: --manifest-url="" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864422 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864429 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864433 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864439 2577 flags.go:64] FLAG: --max-pods="110" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864444 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864449 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864454 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864459 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864464 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864469 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 10:06:38.872713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864474 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864487 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864493 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864499 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864504 2577 flags.go:64] FLAG: --pod-cidr="" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864508 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864517 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864522 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864528 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864533 2577 flags.go:64] FLAG: --port="10250" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864538 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864543 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042ab8865ed6ddc43" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864548 2577 flags.go:64] FLAG: --qos-reserved="" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864553 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864558 2577 flags.go:64] FLAG: --register-node="true" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864563 2577 flags.go:64] FLAG: --register-with-taints="" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864569 2577 flags.go:64] FLAG: --registry-burst="10" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864574 2577 flags.go:64] FLAG: --registry-qps="5" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864579 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864583 2577 flags.go:64] FLAG: --reserved-memory="" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864589 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864594 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864599 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864603 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864608 2577 flags.go:64] FLAG: --runonce="false" Sep 08 10:06:38.873358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864613 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864618 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864624 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864628 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864633 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864638 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864643 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864648 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864652 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864657 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864661 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864666 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864670 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864675 2577 flags.go:64] FLAG: --system-cgroups="" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864679 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864690 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864695 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864699 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864710 2577 flags.go:64] FLAG: --tls-min-version="" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864714 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864719 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864724 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864749 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864755 2577 flags.go:64] FLAG: --v="2" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864761 2577 flags.go:64] FLAG: --version="false" Sep 08 10:06:38.874041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864767 2577 flags.go:64] FLAG: --vmodule="" Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864773 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.864778 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.864974 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.864980 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.864985 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.864989 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.864993 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.864997 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865001 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865005 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865010 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865014 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865018 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865022 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865026 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865030 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865033 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865038 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865042 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:06:38.874664 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865046 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865051 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865057 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865061 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865066 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865071 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865075 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865078 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865082 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865086 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865091 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865096 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865100 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865104 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865108 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865112 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865117 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865121 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865127 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865131 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:06:38.875187 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865135 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865139 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865143 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865148 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865152 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865156 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865160 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865167 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865173 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865178 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865182 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865186 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865191 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865195 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865201 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865206 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865210 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865214 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865218 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865222 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:06:38.875679 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865226 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865230 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865234 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865239 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865244 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865248 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865252 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865256 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865260 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865264 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865270 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865274 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865278 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865282 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865287 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865291 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865297 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865302 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865307 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:06:38.876194 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865311 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865315 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865319 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865325 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865331 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865336 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865340 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865346 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865350 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865355 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865359 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865363 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865367 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865371 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865375 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865379 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865384 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865388 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865404 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:06:38.876665 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865408 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865413 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865417 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.865421 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.865432 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.873304 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.873458 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.874865 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.874875 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874937 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874944 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874949 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874952 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874955 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874959 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:06:38.877205 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874961 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874964 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874967 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874970 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874972 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874975 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874978 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874980 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874983 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874985 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874988 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874991 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874993 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874995 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.874998 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875000 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875003 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875005 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875007 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875010 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:06:38.877628 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875012 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875015 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875017 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875021 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875024 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875027 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875030 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875032 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875034 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875037 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875039 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875042 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875044 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875047 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875049 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875052 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875054 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875057 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875059 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875061 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:06:38.878149 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875064 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875066 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875069 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875072 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875074 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875077 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875079 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875081 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875084 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875087 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875089 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875092 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875094 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875097 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875099 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875103 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875106 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875110 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875113 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:06:38.878639 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875116 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875119 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875122 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875124 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875127 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875129 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875132 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875134 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875137 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875139 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875142 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875144 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875147 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875149 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875152 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875154 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875157 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875159 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875162 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875164 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:06:38.879136 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875166 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875169 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875171 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875174 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875176 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875179 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875181 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875184 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875187 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875190 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875193 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875196 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875198 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875202 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.875208 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:06:38.879634 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875347 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875355 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875358 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875360 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875363 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875365 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875368 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875371 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875373 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875376 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875378 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875380 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875383 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875386 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875388 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875391 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875393 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875396 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875398 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:06:38.880035 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875400 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875403 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875405 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875408 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875410 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875413 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875415 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875418 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875421 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875424 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875426 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875429 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875431 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875435 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875437 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875440 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875442 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875445 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875447 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875450 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:06:38.880506 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875452 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875455 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875457 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875459 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875462 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875466 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875469 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875472 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875474 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875477 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875480 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875482 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875485 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875487 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875490 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875492 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875495 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875497 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875500 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:06:38.881015 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875503 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875505 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875508 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875514 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875517 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875520 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875523 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875525 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875528 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875531 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875533 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875535 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875538 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875540 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875543 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875546 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875548 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875551 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875553 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875555 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:06:38.881494 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875557 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875561 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875563 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875565 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875568 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875570 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875573 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875575 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875578 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875580 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875583 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875585 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875588 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875590 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875593 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875596 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875600 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875602 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875605 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875607 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:06:38.881993 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:38.875610 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.875614 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.875767 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.878139 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.879045 2577 server.go:1019] "Starting client certificate rotation" Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.879148 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.879219 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 10:06:38.882484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.881592 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 10:06:38.889747 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.889696 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 10:06:38.900253 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.900234 2577 log.go:25] "Validated CRI v1 runtime API" Sep 08 10:06:38.903436 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.903416 2577 log.go:25] "Validated CRI v1 image API" Sep 08 10:06:38.904403 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.904389 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 10:06:38.907382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.907362 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aec9e7a6-2e06-432b-8c3f-deb47a36a6f2:/dev/nvme0n1p3 d16241c3-492f-4816-b583-19daee94194c:/dev/nvme0n1p4] Sep 08 10:06:38.907442 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.907383 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 10:06:38.913303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.913187 2577 manager.go:216] Machine: {Timestamp:2026-09-08 10:06:38.911866311 +0000 UTC m=+0.316728751 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100424 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25d15fdd552a16704d0c45b80d51fa SystemUUID:ec25d15f-dd55-2a16-704d-0c45b80d51fa BootID:aeabbd26-22af-4047-8619-68b4ee31f3b9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b5:cc:7e:45:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b5:cc:7e:45:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:e3:23:e9:d2:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 10:06:38.913303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.913298 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 10:06:38.913471 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.913452 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 10:06:38.914303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.914287 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 10:06:38.916498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.916465 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 10:06:38.916649 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.916502 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 10:06:38.917267 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.917257 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 10:06:38.917303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.917270 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 10:06:38.917303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.917278 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 10:06:38.917957 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.917946 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 10:06:38.919615 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.919604 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 10:06:38.924768 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.924754 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 08 10:06:38.925074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925064 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 10:06:38.925109 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925101 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 08 10:06:38.925137 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925114 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 10:06:38.925137 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925130 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 10:06:38.925187 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925139 2577 kubelet.go:398] "Adding apiserver pod source" Sep 08 10:06:38.925187 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925148 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 10:06:38.925600 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925587 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 10:06:38.925669 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.925617 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 10:06:38.929657 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.929639 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 10:06:38.932304 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.932289 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 10:06:38.932363 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.932320 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 10:06:38.933127 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933116 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 10:06:38.933168 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933133 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 10:06:38.933168 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933139 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 10:06:38.933168 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933144 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 10:06:38.933168 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933153 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 10:06:38.933168 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933158 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 10:06:38.933298 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933171 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 10:06:38.933298 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933177 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 10:06:38.933298 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933183 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 10:06:38.933298 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933188 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 10:06:38.933298 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933196 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 10:06:38.933298 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933203 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 10:06:38.933867 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933856 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 10:06:38.933909 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.933868 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 10:06:38.938008 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.937787 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 10:06:38.938110 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.937753 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 10:06:38.938110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.938062 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 10:06:38.938831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.938818 2577 server.go:1268] "Started kubelet" Sep 08 10:06:38.938959 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.938906 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 10:06:38.938959 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.938920 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 10:06:38.939128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.939000 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 10:06:38.939862 ip-10-0-131-17 systemd[1]: Started Kubernetes Kubelet. Sep 08 10:06:38.940333 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.940316 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 10:06:38.940707 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.940579 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 08 10:06:38.944086 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.944059 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 10:06:38.945240 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.945226 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 10:06:38.945307 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.945289 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 10:06:38.945377 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.945352 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:38.946009 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.945989 2577 factory.go:55] Registering systemd factory Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946012 2577 factory.go:223] Registration of the systemd container factory successfully Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946045 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946062 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.945236 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-17.ec2.internal.18d350829ef0ed6d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-17.ec2.internal,UID:ip-10-0-131-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-17.ec2.internal,},FirstTimestamp:2026-09-08 10:06:38.938778989 +0000 UTC m=+0.343641426,LastTimestamp:2026-09-08 10:06:38.938778989 +0000 UTC m=+0.343641426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-17.ec2.internal,}" Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946038 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946157 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946166 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946252 2577 factory.go:153] Registering CRI-O factory Sep 08 10:06:38.946288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946263 2577 factory.go:223] Registration of the crio container factory successfully Sep 08 10:06:38.946718 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946312 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 10:06:38.946718 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946335 2577 factory.go:103] Registering Raw factory Sep 08 10:06:38.946718 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.946350 2577 manager.go:1196] Started watching for new ooms in manager Sep 08 10:06:38.947352 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.947337 2577 manager.go:349] Starting recovery of all containers Sep 08 10:06:38.954234 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.954202 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 10:06:38.954365 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.954274 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 10:06:38.958754 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.958715 2577 manager.go:354] Recovery completed Sep 08 10:06:38.964020 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.964001 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:38.966073 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966054 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:38.966139 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966090 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:38.966139 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966104 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:38.966765 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966725 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 10:06:38.966765 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966754 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:38.966765 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966759 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 10:06:38.966929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966780 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 08 10:06:38.966929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.966794 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wrxht" Sep 08 10:06:38.967486 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.967473 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:38.967540 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.967495 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:38.967540 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.967504 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:38.968274 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.968210 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-17.ec2.internal.18d35082a09169e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-17.ec2.internal,UID:ip-10-0-131-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-17.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-17.ec2.internal,},FirstTimestamp:2026-09-08 10:06:38.966073833 +0000 UTC m=+0.370936274,LastTimestamp:2026-09-08 10:06:38.966073833 +0000 UTC m=+0.370936274,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-17.ec2.internal,}" Sep 08 10:06:38.969016 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.969003 2577 policy_none.go:49] "None policy: Start" Sep 08 10:06:38.969076 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.969023 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 10:06:38.969076 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.969036 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 10:06:38.971009 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.970995 2577 policy_none.go:47] "Start" Sep 08 10:06:38.974449 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:38.974419 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wrxht" Sep 08 10:06:38.976083 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:38.976010 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-17.ec2.internal.18d35082a091c50d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-17.ec2.internal,UID:ip-10-0-131-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-17.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-17.ec2.internal,},FirstTimestamp:2026-09-08 10:06:38.966097165 +0000 UTC m=+0.370959602,LastTimestamp:2026-09-08 10:06:38.966097165 +0000 UTC m=+0.370959602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-17.ec2.internal,}" Sep 08 10:06:39.003418 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003398 2577 manager.go:337] "Starting Device Plugin manager" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.003443 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003453 2577 server.go:87] "Starting device plugin registration server" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003783 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003796 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003869 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003945 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.003953 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.004552 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 10:06:39.023128 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.004612 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.040562 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.040517 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 10:06:39.042020 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.041999 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 10:06:39.042086 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.042073 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 10:06:39.042134 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.042100 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 10:06:39.042180 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.042141 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 10:06:39.044678 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.044652 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:06:39.104704 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.104671 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:39.106706 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.106688 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:39.106801 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.106722 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:39.106801 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.106753 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:39.106801 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.106782 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.116705 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.116618 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.116705 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.116644 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-17.ec2.internal\": node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.143247 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.143200 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal"] Sep 08 10:06:39.143374 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.143307 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:39.144963 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.144940 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:39.145075 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.144969 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:39.145075 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.144980 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:39.147290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.147271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8afa0d9d4d65f4b1d07416e4f25389f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal\" (UID: \"e8afa0d9d4d65f4b1d07416e4f25389f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.147371 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.147296 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:39.147371 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.147306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8afa0d9d4d65f4b1d07416e4f25389f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal\" (UID: \"e8afa0d9d4d65f4b1d07416e4f25389f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.147476 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.147405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.147476 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.147432 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:39.148156 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.148140 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:39.148156 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.148152 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:39.148268 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.148166 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:39.148268 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.148175 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:39.148268 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.148175 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:39.148268 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.148262 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:39.150404 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.150391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.150451 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.150414 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:06:39.151151 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.151127 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:06:39.151222 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.151154 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:06:39.151222 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.151171 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:06:39.154325 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.154111 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.170360 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.170338 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-17.ec2.internal\" not found" node="ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.174570 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.174557 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-17.ec2.internal\" not found" node="ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.247776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.247743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8afa0d9d4d65f4b1d07416e4f25389f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal\" (UID: \"e8afa0d9d4d65f4b1d07416e4f25389f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.247776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.247779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8afa0d9d4d65f4b1d07416e4f25389f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal\" (UID: \"e8afa0d9d4d65f4b1d07416e4f25389f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.247929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.247799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6613c508e2f799827626149a2992482f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-17.ec2.internal\" (UID: \"6613c508e2f799827626149a2992482f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.247929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.247810 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e8afa0d9d4d65f4b1d07416e4f25389f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal\" (UID: \"e8afa0d9d4d65f4b1d07416e4f25389f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.247929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.247850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8afa0d9d4d65f4b1d07416e4f25389f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal\" (UID: \"e8afa0d9d4d65f4b1d07416e4f25389f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.254836 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.254822 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.347975 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.347940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6613c508e2f799827626149a2992482f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-17.ec2.internal\" (UID: \"6613c508e2f799827626149a2992482f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.348116 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.347986 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6613c508e2f799827626149a2992482f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-17.ec2.internal\" (UID: \"6613c508e2f799827626149a2992482f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.355058 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.355038 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.455917 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.455848 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.473025 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.473002 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.478212 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.478014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" Sep 08 10:06:39.556491 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.556437 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.657029 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.656991 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.757557 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.757471 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.858181 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.858148 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.879337 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.879306 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 10:06:39.879499 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.879481 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 10:06:39.959189 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:39.959161 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-17.ec2.internal\" not found" Sep 08 10:06:39.977347 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.977300 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 10:01:39 +0000 UTC" deadline="2028-06-03 21:09:54.687000116 +0000 UTC" Sep 08 10:06:39.977347 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:39.977342 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15227h3m14.709662314s" Sep 08 10:06:40.053722 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.053649 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:06:40.087019 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.086997 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:06:40.094010 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:40.093852 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6613c508e2f799827626149a2992482f.slice/crio-9dab9dc1d197d4bc7b72a352ab65d55bcfb597e6c0c25d303370bbf6968598e0 WatchSource:0}: Error finding container 9dab9dc1d197d4bc7b72a352ab65d55bcfb597e6c0c25d303370bbf6968598e0: Status 404 returned error can't find the container with id 9dab9dc1d197d4bc7b72a352ab65d55bcfb597e6c0c25d303370bbf6968598e0 Sep 08 10:06:40.094612 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:40.094592 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8afa0d9d4d65f4b1d07416e4f25389f.slice/crio-50340fa36a1027331a6db660232db712c1caa6c9726aad9d397272e34273f3ea WatchSource:0}: Error finding container 50340fa36a1027331a6db660232db712c1caa6c9726aad9d397272e34273f3ea: Status 404 returned error can't find the container with id 50340fa36a1027331a6db660232db712c1caa6c9726aad9d397272e34273f3ea Sep 08 10:06:40.100476 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.100455 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:06:40.145721 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.145681 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" Sep 08 10:06:40.158239 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.158218 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 10:06:40.159201 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.159188 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" Sep 08 10:06:40.167609 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.167591 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 10:06:40.466538 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.466442 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:06:40.842258 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.842174 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:06:40.925698 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.925668 2577 apiserver.go:52] "Watching apiserver" Sep 08 10:06:40.932674 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.932647 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 10:06:40.934074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.934045 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc","openshift-dns/node-resolver-2jczk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal","openshift-multus/multus-vwppv","openshift-ovn-kubernetes/ovnkube-node-2rmb7","kube-system/global-pull-secret-syncer-bvvg9","kube-system/konnectivity-agent-l5msj","openshift-cluster-node-tuning-operator/tuned-qn6nb","openshift-image-registry/node-ca-tthb7","openshift-multus/multus-additional-cni-plugins-2lnm4","openshift-multus/network-metrics-daemon-8s9q4","openshift-network-diagnostics/network-check-target-9rrz2","openshift-network-operator/iptables-alerter-nsj84","kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal"] Sep 08 10:06:40.936736 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.936711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:40.939020 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.938993 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:40.939122 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.939027 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 10:06:40.939122 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.939094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 10:06:40.939220 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.939143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c6228\"" Sep 08 10:06:40.941547 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.941519 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xngbl\"" Sep 08 10:06:40.941657 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.941632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.942037 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.942018 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.942140 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.942037 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.942140 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.942019 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 10:06:40.944035 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.943886 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.944035 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.943890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.944169 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.944143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dz8jq\"" Sep 08 10:06:40.944824 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.944807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.946062 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.946048 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 10:06:40.947098 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.947079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.947384 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.947365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 10:06:40.947492 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.947456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6b4qm\"" Sep 08 10:06:40.947603 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.947460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.947603 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.947594 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.947716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.947600 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.949923 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.949967 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.949995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d76qv\"" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:40.950010 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.950031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.949934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.950297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.950203 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 10:06:40.950733 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.950477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 10:06:40.950733 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.950488 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 10:06:40.952568 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.952545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.955993 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956012 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pxj5m\"" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.955997 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.955999 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-hostroot\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956273 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-kubelet\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55457d6c-5003-42bb-9783-3ae4b3207dd4-iptables-alerter-script\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-ovn\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-log-socket\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-cni-bin\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-run\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.956431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-conf-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-node-log\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2565da8-d702-4762-a544-bd4d712e6ac6-ovn-node-metrics-cert\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-modprobe-d\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-kubernetes\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956617 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c833253-97ce-42a6-a3aa-8e441495dfbf-konnectivity-ca\") pod \"konnectivity-agent-l5msj\" (UID: \"4c833253-97ce-42a6-a3aa-8e441495dfbf\") " pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-cni-multus\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-cni-bin\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-run-netns\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-var-lib-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-ovnkube-config\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c833253-97ce-42a6-a3aa-8e441495dfbf-agent-certs\") pod \"konnectivity-agent-l5msj\" (UID: \"4c833253-97ce-42a6-a3aa-8e441495dfbf\") " pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-system-cni-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-k8s-cni-cncf-io\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e122af9b-b02f-4e30-b8b2-da8a542d77c5-tmp\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r694\" (UniqueName: \"kubernetes.io/projected/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-kube-api-access-5r694\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.956982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysconfig\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysctl-conf\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-systemd\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-netns\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-etc-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-etc-kubernetes\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-systemd-units\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-systemd\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdh9x\" (UniqueName: \"kubernetes.io/projected/e2565da8-d702-4762-a544-bd4d712e6ac6-kube-api-access-fdh9x\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-sys\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-ovnkube-script-lib\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-var-lib-kubelet\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-tuned\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.957973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd9vr\" (UniqueName: \"kubernetes.io/projected/55457d6c-5003-42bb-9783-3ae4b3207dd4-kube-api-access-gd9vr\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysctl-d\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmlg7\" (UniqueName: \"kubernetes.io/projected/e122af9b-b02f-4e30-b8b2-da8a542d77c5-kube-api-access-cmlg7\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-cnibin\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-socket-dir-parent\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-multus-certs\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-env-overrides\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-lib-modules\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-daemon-config\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-cni-netd\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55457d6c-5003-42bb-9783-3ae4b3207dd4-host-slash\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-kubelet\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-host\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-slash\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957767 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-cni-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.958638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.957810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-cni-binary-copy\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:40.959277 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.958973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-88rln\"" Sep 08 10:06:40.959277 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.959036 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.959277 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.959154 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.959277 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.958973 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 10:06:40.959680 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.959655 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:40.962105 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.962083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nbxgx\"" Sep 08 10:06:40.962380 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.962359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 10:06:40.962707 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.962688 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:40.962836 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.962788 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 10:06:40.964851 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.964830 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 10:06:40.964944 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.964898 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wbk6l\"" Sep 08 10:06:40.964944 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.964904 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 10:06:40.965361 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.965345 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:40.965444 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:40.965424 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:40.967620 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.967598 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 10:06:40.968034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.968013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:40.968115 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:40.968071 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:40.995406 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:40.995349 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4qwxc" Sep 08 10:06:41.016630 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.016597 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4qwxc" Sep 08 10:06:41.047228 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.047205 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 10:06:41.047580 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.047541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" event={"ID":"6613c508e2f799827626149a2992482f","Type":"ContainerStarted","Data":"9dab9dc1d197d4bc7b72a352ab65d55bcfb597e6c0c25d303370bbf6968598e0"} Sep 08 10:06:41.048891 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.048867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" event={"ID":"e8afa0d9d4d65f4b1d07416e4f25389f","Type":"ContainerStarted","Data":"50340fa36a1027331a6db660232db712c1caa6c9726aad9d397272e34273f3ea"} Sep 08 10:06:41.058143 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-slash\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058228 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.058228 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-cni-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.058369 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058247 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-slash\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058369 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-cni-binary-copy\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.058369 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-hostroot\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.058369 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-kubelet\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058369 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31afbe58-732a-4cf8-81e9-9af79095b26e-kubelet-config\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-device-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058414 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-cni-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55457d6c-5003-42bb-9783-3ae4b3207dd4-iptables-alerter-script\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-ovn\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-kubelet\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-log-socket\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-ovn\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-cni-bin\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.058637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058619 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-hostroot\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-log-socket\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-cni-bin\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-run\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058799 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-run\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-conf-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-node-log\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058905 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-conf-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-run-ovn-kubernetes\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2565da8-d702-4762-a544-bd4d712e6ac6-ovn-node-metrics-cert\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.058995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31afbe58-732a-4cf8-81e9-9af79095b26e-dbus\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059001 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-node-log\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-modprobe-d\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-kubernetes\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059090 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55457d6c-5003-42bb-9783-3ae4b3207dd4-iptables-alerter-script\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c833253-97ce-42a6-a3aa-8e441495dfbf-konnectivity-ca\") pod \"konnectivity-agent-l5msj\" (UID: \"4c833253-97ce-42a6-a3aa-8e441495dfbf\") " pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:41.059138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059089 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-cni-binary-copy\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-kubernetes\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059201 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-modprobe-d\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-sys-fs\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz95z\" (UniqueName: \"kubernetes.io/projected/0564785d-36fe-474e-9eae-82d5797ed588-kube-api-access-zz95z\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rll28\" (UniqueName: \"kubernetes.io/projected/14b94402-8a66-4526-9a13-650d2187c4fd-kube-api-access-rll28\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-cni-multus\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xvf6\" (UniqueName: \"kubernetes.io/projected/e56543a3-5370-4bea-b3df-ca8bc18a21bb-kube-api-access-2xvf6\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-cni-bin\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-run-netns\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-var-lib-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059451 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-cni-bin\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-cni-multus\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-ovnkube-config\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d777bb5-e556-438f-8ae3-634f4f0e6879-host\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.059970 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059512 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-run-netns\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c833253-97ce-42a6-a3aa-8e441495dfbf-agent-certs\") pod \"konnectivity-agent-l5msj\" (UID: \"4c833253-97ce-42a6-a3aa-8e441495dfbf\") " pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-var-lib-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-system-cni-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c833253-97ce-42a6-a3aa-8e441495dfbf-konnectivity-ca\") pod \"konnectivity-agent-l5msj\" (UID: \"4c833253-97ce-42a6-a3aa-8e441495dfbf\") " pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-k8s-cni-cncf-io\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e122af9b-b02f-4e30-b8b2-da8a542d77c5-tmp\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r694\" (UniqueName: \"kubernetes.io/projected/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-kube-api-access-5r694\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nksq\" (UniqueName: \"kubernetes.io/projected/f888f945-1538-4b99-9cc4-fc69c518a469-kube-api-access-4nksq\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059640 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-system-cni-dir\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.059662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysconfig\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysctl-conf\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060431 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-ovnkube-config\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-systemd\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060448 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-systemd\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.060833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-netns\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-etc-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060873 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysconfig\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-netns\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060931 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-etc-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060982 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-k8s-cni-cncf-io\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.060987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-cnibin\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-etc-kubernetes\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-systemd-units\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-systemd-units\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061184 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-etc-kubernetes\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-systemd\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdh9x\" (UniqueName: \"kubernetes.io/projected/e2565da8-d702-4762-a544-bd4d712e6ac6-kube-api-access-fdh9x\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.061618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdjwd\" (UniqueName: \"kubernetes.io/projected/0d777bb5-e556-438f-8ae3-634f4f0e6879-kube-api-access-fdjwd\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.062185 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.062185 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061715 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0564785d-36fe-474e-9eae-82d5797ed588-tmp-dir\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.062185 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-sys\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.062185 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.062185 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.061983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-ovnkube-script-lib\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.062601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-openvswitch\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.062601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:41.062601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d777bb5-e556-438f-8ae3-634f4f0e6879-serviceca\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.062601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0564785d-36fe-474e-9eae-82d5797ed588-hosts-file\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.062601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062522 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-run-systemd\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.062929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-var-lib-kubelet\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.062929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-tuned\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.062929 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062768 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.063089 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.062969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd9vr\" (UniqueName: \"kubernetes.io/projected/55457d6c-5003-42bb-9783-3ae4b3207dd4-kube-api-access-gd9vr\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.063089 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysctl-d\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.063089 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmlg7\" (UniqueName: \"kubernetes.io/projected/e122af9b-b02f-4e30-b8b2-da8a542d77c5-kube-api-access-cmlg7\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.063261 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-cnibin\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.063261 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-socket-dir-parent\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.063261 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-multus-certs\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.063487 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063463 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-ovnkube-script-lib\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.063697 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-system-cni-dir\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.063697 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.063697 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-env-overrides\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.063697 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063637 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-socket-dir-parent\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-lib-modules\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063747 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysctl-d\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-daemon-config\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-cni-netd\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063800 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-run-multus-certs\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.064039 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.063835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55457d6c-5003-42bb-9783-3ae4b3207dd4-host-slash\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.064876 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.064074 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.064876 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.064487 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e2565da8-d702-4762-a544-bd4d712e6ac6-env-overrides\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.064876 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.064561 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-var-lib-kubelet\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.065216 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065196 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e122af9b-b02f-4e30-b8b2-da8a542d77c5-tmp\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.065313 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-sys\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.065480 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-socket-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.065551 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-registration-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.065613 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-kubelet\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.065670 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065614 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-host-var-lib-kubelet\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.065670 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065623 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-cnibin\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.065776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-host\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.065776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55457d6c-5003-42bb-9783-3ae4b3207dd4-host-slash\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.065919 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065828 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-host\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.065990 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.065967 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e2565da8-d702-4762-a544-bd4d712e6ac6-host-cni-netd\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.066082 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.066067 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-lib-modules\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.066388 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.066360 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-sysctl-conf\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.066388 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.066383 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-multus-daemon-config\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.066562 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.066494 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e122af9b-b02f-4e30-b8b2-da8a542d77c5-etc-tuned\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.069055 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.069021 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c833253-97ce-42a6-a3aa-8e441495dfbf-agent-certs\") pod \"konnectivity-agent-l5msj\" (UID: \"4c833253-97ce-42a6-a3aa-8e441495dfbf\") " pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:41.069608 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.069583 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdh9x\" (UniqueName: \"kubernetes.io/projected/e2565da8-d702-4762-a544-bd4d712e6ac6-kube-api-access-fdh9x\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.069775 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.069737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e2565da8-d702-4762-a544-bd4d712e6ac6-ovn-node-metrics-cert\") pod \"ovnkube-node-2rmb7\" (UID: \"e2565da8-d702-4762-a544-bd4d712e6ac6\") " pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.069890 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.069872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r694\" (UniqueName: \"kubernetes.io/projected/5bfdc435-5a0e-418e-93eb-020c0d5a2d6c-kube-api-access-5r694\") pod \"multus-vwppv\" (UID: \"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c\") " pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.074155 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.074135 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd9vr\" (UniqueName: \"kubernetes.io/projected/55457d6c-5003-42bb-9783-3ae4b3207dd4-kube-api-access-gd9vr\") pod \"iptables-alerter-nsj84\" (UID: \"55457d6c-5003-42bb-9783-3ae4b3207dd4\") " pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.075032 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.075014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmlg7\" (UniqueName: \"kubernetes.io/projected/e122af9b-b02f-4e30-b8b2-da8a542d77c5-kube-api-access-cmlg7\") pod \"tuned-qn6nb\" (UID: \"e122af9b-b02f-4e30-b8b2-da8a542d77c5\") " pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.166388 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nksq\" (UniqueName: \"kubernetes.io/projected/f888f945-1538-4b99-9cc4-fc69c518a469-kube-api-access-4nksq\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:41.166388 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-cnibin\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.166388 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdjwd\" (UniqueName: \"kubernetes.io/projected/0d777bb5-e556-438f-8ae3-634f4f0e6879-kube-api-access-fdjwd\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0564785d-36fe-474e-9eae-82d5797ed588-tmp-dir\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166446 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-cnibin\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d777bb5-e556-438f-8ae3-634f4f0e6879-serviceca\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0564785d-36fe-474e-9eae-82d5797ed588-hosts-file\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166539 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-system-cni-dir\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.166641 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-socket-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0564785d-36fe-474e-9eae-82d5797ed588-hosts-file\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-registration-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.166720 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.166719 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:06:41.666696311 +0000 UTC m=+3.071558761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166751 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-registration-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0564785d-36fe-474e-9eae-82d5797ed588-tmp-dir\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31afbe58-732a-4cf8-81e9-9af79095b26e-kubelet-config\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.166997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-device-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167022 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-socket-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31afbe58-732a-4cf8-81e9-9af79095b26e-dbus\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167058 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31afbe58-732a-4cf8-81e9-9af79095b26e-kubelet-config\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-sys-fs\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz95z\" (UniqueName: \"kubernetes.io/projected/0564785d-36fe-474e-9eae-82d5797ed588-kube-api-access-zz95z\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rll28\" (UniqueName: \"kubernetes.io/projected/14b94402-8a66-4526-9a13-650d2187c4fd-kube-api-access-rll28\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167149 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.167509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xvf6\" (UniqueName: \"kubernetes.io/projected/e56543a3-5370-4bea-b3df-ca8bc18a21bb-kube-api-access-2xvf6\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167182 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14b94402-8a66-4526-9a13-650d2187c4fd-system-cni-dir\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d777bb5-e556-438f-8ae3-634f4f0e6879-host\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167242 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0d777bb5-e556-438f-8ae3-634f4f0e6879-serviceca\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d777bb5-e556-438f-8ae3-634f4f0e6879-host\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-sys-fs\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-device-dir\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e56543a3-5370-4bea-b3df-ca8bc18a21bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.167488 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167525 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31afbe58-732a-4cf8-81e9-9af79095b26e-dbus\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.167538 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:06:41.667520619 +0000 UTC m=+3.072383046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:41.168104 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.167752 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14b94402-8a66-4526-9a13-650d2187c4fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.173188 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.173164 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:06:41.173188 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.173191 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:06:41.173385 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.173206 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:41.173385 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.173272 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:06:41.67325448 +0000 UTC m=+3.078116924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:41.175682 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.175661 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nksq\" (UniqueName: \"kubernetes.io/projected/f888f945-1538-4b99-9cc4-fc69c518a469-kube-api-access-4nksq\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:41.176179 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.176147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdjwd\" (UniqueName: \"kubernetes.io/projected/0d777bb5-e556-438f-8ae3-634f4f0e6879-kube-api-access-fdjwd\") pod \"node-ca-tthb7\" (UID: \"0d777bb5-e556-438f-8ae3-634f4f0e6879\") " pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.177395 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.177373 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xvf6\" (UniqueName: \"kubernetes.io/projected/e56543a3-5370-4bea-b3df-ca8bc18a21bb-kube-api-access-2xvf6\") pod \"aws-ebs-csi-driver-node-b7qkc\" (UID: \"e56543a3-5370-4bea-b3df-ca8bc18a21bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.179032 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.179010 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rll28\" (UniqueName: \"kubernetes.io/projected/14b94402-8a66-4526-9a13-650d2187c4fd-kube-api-access-rll28\") pod \"multus-additional-cni-plugins-2lnm4\" (UID: \"14b94402-8a66-4526-9a13-650d2187c4fd\") " pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.185088 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.185066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz95z\" (UniqueName: \"kubernetes.io/projected/0564785d-36fe-474e-9eae-82d5797ed588-kube-api-access-zz95z\") pod \"node-resolver-2jczk\" (UID: \"0564785d-36fe-474e-9eae-82d5797ed588\") " pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.247574 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.247530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:06:41.256739 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.256709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nsj84" Sep 08 10:06:41.265899 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.265868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" Sep 08 10:06:41.271016 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.270993 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vwppv" Sep 08 10:06:41.278086 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.278063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:06:41.284957 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.284935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tthb7" Sep 08 10:06:41.292106 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.292082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" Sep 08 10:06:41.293944 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.293924 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2565da8_d702_4762_a544_bd4d712e6ac6.slice/crio-9a7a04eda54becbcc510ff6a9b59937b49b6d1352e43eaa61e8bcaeb7c6a03b7 WatchSource:0}: Error finding container 9a7a04eda54becbcc510ff6a9b59937b49b6d1352e43eaa61e8bcaeb7c6a03b7: Status 404 returned error can't find the container with id 9a7a04eda54becbcc510ff6a9b59937b49b6d1352e43eaa61e8bcaeb7c6a03b7 Sep 08 10:06:41.294482 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.294457 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode122af9b_b02f_4e30_b8b2_da8a542d77c5.slice/crio-f283b66d7ff653c902bb77c3a726490db9583046efb46c159209a24207e67814 WatchSource:0}: Error finding container f283b66d7ff653c902bb77c3a726490db9583046efb46c159209a24207e67814: Status 404 returned error can't find the container with id f283b66d7ff653c902bb77c3a726490db9583046efb46c159209a24207e67814 Sep 08 10:06:41.295566 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.295499 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfdc435_5a0e_418e_93eb_020c0d5a2d6c.slice/crio-86ebbcbfbec0025e537370ef127078d6761eefe6187ab369590b2b8c9da25cf7 WatchSource:0}: Error finding container 86ebbcbfbec0025e537370ef127078d6761eefe6187ab369590b2b8c9da25cf7: Status 404 returned error can't find the container with id 86ebbcbfbec0025e537370ef127078d6761eefe6187ab369590b2b8c9da25cf7 Sep 08 10:06:41.297637 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.297558 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55457d6c_5003_42bb_9783_3ae4b3207dd4.slice/crio-fc28dc08d22ce70c476e4467cd4e29a5dd866276233fe3cce27c1372c394b75f WatchSource:0}: Error finding container fc28dc08d22ce70c476e4467cd4e29a5dd866276233fe3cce27c1372c394b75f: Status 404 returned error can't find the container with id fc28dc08d22ce70c476e4467cd4e29a5dd866276233fe3cce27c1372c394b75f Sep 08 10:06:41.298284 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.298257 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c833253_97ce_42a6_a3aa_8e441495dfbf.slice/crio-293c66cf789345ec6fbaae29aa01a64f4098bbaf61b4be9f614bdf3e49120e51 WatchSource:0}: Error finding container 293c66cf789345ec6fbaae29aa01a64f4098bbaf61b4be9f614bdf3e49120e51: Status 404 returned error can't find the container with id 293c66cf789345ec6fbaae29aa01a64f4098bbaf61b4be9f614bdf3e49120e51 Sep 08 10:06:41.298379 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.298320 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jczk" Sep 08 10:06:41.303402 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.302648 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d777bb5_e556_438f_8ae3_634f4f0e6879.slice/crio-a5c8a0f59a73fdf09c65186ec0575ac76047ba8f039b8e23abb8358e5fda381c WatchSource:0}: Error finding container a5c8a0f59a73fdf09c65186ec0575ac76047ba8f039b8e23abb8358e5fda381c: Status 404 returned error can't find the container with id a5c8a0f59a73fdf09c65186ec0575ac76047ba8f039b8e23abb8358e5fda381c Sep 08 10:06:41.303982 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.303963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" Sep 08 10:06:41.329970 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.328850 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56543a3_5370_4bea_b3df_ca8bc18a21bb.slice/crio-ea9bf3939f1364c03b5366356e19c45501ee2afe35710e2eb742d0825c0d68f0 WatchSource:0}: Error finding container ea9bf3939f1364c03b5366356e19c45501ee2afe35710e2eb742d0825c0d68f0: Status 404 returned error can't find the container with id ea9bf3939f1364c03b5366356e19c45501ee2afe35710e2eb742d0825c0d68f0 Sep 08 10:06:41.335022 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.335000 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0564785d_36fe_474e_9eae_82d5797ed588.slice/crio-50e1835ff13a82b6aab030b634eb1734cd386b4bc9699fabf361e1e3f2fcf58e WatchSource:0}: Error finding container 50e1835ff13a82b6aab030b634eb1734cd386b4bc9699fabf361e1e3f2fcf58e: Status 404 returned error can't find the container with id 50e1835ff13a82b6aab030b634eb1734cd386b4bc9699fabf361e1e3f2fcf58e Sep 08 10:06:41.338417 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:06:41.338302 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b94402_8a66_4526_9a13_650d2187c4fd.slice/crio-ad2391bcef461de53a3179081436fc5af32b29dccb43abb801b1a3c0043df705 WatchSource:0}: Error finding container ad2391bcef461de53a3179081436fc5af32b29dccb43abb801b1a3c0043df705: Status 404 returned error can't find the container with id ad2391bcef461de53a3179081436fc5af32b29dccb43abb801b1a3c0043df705 Sep 08 10:06:41.672056 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.672026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:41.672199 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.672090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:41.672199 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.672187 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:41.672308 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.672214 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:41.672308 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.672257 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:06:42.672242238 +0000 UTC m=+4.077104679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:41.672308 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.672282 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:06:42.672263121 +0000 UTC m=+4.077125546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:41.773360 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:41.773317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:41.773555 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.773509 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:06:41.773555 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.773529 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:06:41.773555 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.773542 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:41.773718 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:41.773604 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:06:42.77358383 +0000 UTC m=+4.178446273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:42.020521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.020415 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 10:01:41 +0000 UTC" deadline="2028-02-29 19:45:28.929069712 +0000 UTC" Sep 08 10:06:42.020521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.020464 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12945h38m46.908618842s" Sep 08 10:06:42.060660 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.059699 2577 generic.go:356] "Generic (PLEG): container finished" podID="e8afa0d9d4d65f4b1d07416e4f25389f" containerID="49988656031a7867696268a46259e724da3ae12af917d4035f0f9bbd0cc88764" exitCode=0 Sep 08 10:06:42.060660 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.059793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" event={"ID":"e8afa0d9d4d65f4b1d07416e4f25389f","Type":"ContainerDied","Data":"49988656031a7867696268a46259e724da3ae12af917d4035f0f9bbd0cc88764"} Sep 08 10:06:42.065631 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.065555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jczk" event={"ID":"0564785d-36fe-474e-9eae-82d5797ed588","Type":"ContainerStarted","Data":"50e1835ff13a82b6aab030b634eb1734cd386b4bc9699fabf361e1e3f2fcf58e"} Sep 08 10:06:42.101857 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.087666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tthb7" event={"ID":"0d777bb5-e556-438f-8ae3-634f4f0e6879","Type":"ContainerStarted","Data":"a5c8a0f59a73fdf09c65186ec0575ac76047ba8f039b8e23abb8358e5fda381c"} Sep 08 10:06:42.101857 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.092979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5msj" event={"ID":"4c833253-97ce-42a6-a3aa-8e441495dfbf","Type":"ContainerStarted","Data":"293c66cf789345ec6fbaae29aa01a64f4098bbaf61b4be9f614bdf3e49120e51"} Sep 08 10:06:42.105768 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.102919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nsj84" event={"ID":"55457d6c-5003-42bb-9783-3ae4b3207dd4","Type":"ContainerStarted","Data":"fc28dc08d22ce70c476e4467cd4e29a5dd866276233fe3cce27c1372c394b75f"} Sep 08 10:06:42.107334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.107306 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"9a7a04eda54becbcc510ff6a9b59937b49b6d1352e43eaa61e8bcaeb7c6a03b7"} Sep 08 10:06:42.112195 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.112061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerStarted","Data":"ad2391bcef461de53a3179081436fc5af32b29dccb43abb801b1a3c0043df705"} Sep 08 10:06:42.116063 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.116040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" event={"ID":"e56543a3-5370-4bea-b3df-ca8bc18a21bb","Type":"ContainerStarted","Data":"ea9bf3939f1364c03b5366356e19c45501ee2afe35710e2eb742d0825c0d68f0"} Sep 08 10:06:42.123266 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.123238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" event={"ID":"e122af9b-b02f-4e30-b8b2-da8a542d77c5","Type":"ContainerStarted","Data":"f283b66d7ff653c902bb77c3a726490db9583046efb46c159209a24207e67814"} Sep 08 10:06:42.133217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.133192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwppv" event={"ID":"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c","Type":"ContainerStarted","Data":"86ebbcbfbec0025e537370ef127078d6761eefe6187ab369590b2b8c9da25cf7"} Sep 08 10:06:42.682545 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.681628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:42.682545 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.681737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:42.682545 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.681914 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:42.682545 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.681987 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:06:44.681967802 +0000 UTC m=+6.086830232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:42.682545 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.682411 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:42.682545 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.682463 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:06:44.68244682 +0000 UTC m=+6.087309251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:42.782716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:42.782676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:42.782928 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.782900 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:06:42.782993 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.782931 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:06:42.782993 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.782945 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:42.783097 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:42.783007 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:06:44.782987625 +0000 UTC m=+6.187850068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:43.021601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:43.021481 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 10:01:41 +0000 UTC" deadline="2028-06-23 15:13:19.372731574 +0000 UTC" Sep 08 10:06:43.021601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:43.021557 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15701h6m36.351180026s" Sep 08 10:06:43.045532 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:43.045495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:43.045690 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:43.045638 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:43.046088 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:43.046066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:43.046196 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:43.046174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:43.046315 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:43.046300 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:43.046402 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:43.046384 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:43.138931 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:43.138889 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" event={"ID":"e8afa0d9d4d65f4b1d07416e4f25389f","Type":"ContainerStarted","Data":"1d5208569c5e575fb7b48e6c471871c8b4a83a64ffe54b6bb75dc0befa63fa1b"} Sep 08 10:06:44.701637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:44.701591 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:44.702138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:44.701680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:44.702138 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.701833 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:44.702138 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.701903 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:06:48.701882814 +0000 UTC m=+10.106745257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:44.702380 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.702327 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:44.702433 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.702386 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:06:48.702370253 +0000 UTC m=+10.107232695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:44.802645 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:44.802604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:44.802969 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.802806 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:06:44.802969 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.802827 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:06:44.802969 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.802838 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:44.802969 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:44.802892 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:06:48.802878735 +0000 UTC m=+10.207741162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:45.044002 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:45.043919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:45.044161 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:45.044079 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:45.044459 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:45.044438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:45.044562 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:45.044526 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:45.045994 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:45.045965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:45.046090 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:45.046067 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:47.042598 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:47.042555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:47.043128 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:47.042744 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:47.043128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:47.042555 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:47.043128 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:47.042937 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:47.043128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:47.043094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:47.043337 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:47.043198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:48.736608 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:48.736567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:48.737111 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:48.736646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:48.737111 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.736807 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:48.737111 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.736898 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:06:56.736857838 +0000 UTC m=+18.141720265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:48.737344 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.737318 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:48.737481 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.737384 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:06:56.737364743 +0000 UTC m=+18.142227186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:48.837465 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:48.837422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:48.837673 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.837649 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:06:48.837673 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.837672 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:06:48.837834 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.837685 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:48.837834 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:48.837768 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:06:56.837726788 +0000 UTC m=+18.242589221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:49.044974 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:49.044887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:49.045154 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:49.044993 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:49.045383 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:49.045359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:49.045467 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:49.045433 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:49.045530 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:49.045479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:49.045587 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:49.045530 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:51.042711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:51.042670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:51.043217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:51.042796 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:51.043217 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:51.042796 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:51.043217 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:51.042890 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:51.043217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:51.042671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:51.043217 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:51.043004 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:53.043232 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:53.043152 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:53.043636 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:53.043297 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:53.043636 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:53.043163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:53.043636 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:53.043391 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:53.043636 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:53.043163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:53.043636 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:53.043470 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:55.042925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:55.042893 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:55.042925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:55.042923 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:55.043412 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:55.043041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:55.043412 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:55.043052 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:55.043412 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:55.043150 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:55.043412 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:55.043208 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:56.797110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:56.797071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:56.797562 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:56.797134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:56.797562 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.797256 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:56.797562 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.797260 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:56.797562 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.797321 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:07:12.797302307 +0000 UTC m=+34.202164733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:06:56.797562 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.797339 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:12.797331092 +0000 UTC m=+34.202193517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:06:56.897773 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:56.897716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:56.897946 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.897894 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:06:56.897946 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.897922 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:06:56.897946 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.897936 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:56.898107 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:56.898001 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:07:12.897982352 +0000 UTC m=+34.302844796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:06:57.043237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:57.043192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:57.043237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:57.043237 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:57.043466 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:57.043197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:57.043466 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:57.043328 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:06:57.043579 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:57.043475 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:57.043579 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:57.043548 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:59.043303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:59.043271 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:06:59.043776 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:59.043380 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:06:59.043776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:59.043470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:06:59.044012 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:59.043981 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:06:59.044377 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:06:59.043658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:06:59.044508 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:06:59.044489 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:01.043337 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.043308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:01.043337 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.043351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:01.043798 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:01.043448 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:01.044159 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:01.043971 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:01.044159 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.044007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:01.044159 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:01.044111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:01.182109 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.182073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"97b4f0deba8cc6ed31cbcfc6e753eee3756a56dfc28e3fe913faa8c852503949"} Sep 08 10:07:01.189726 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.189690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" event={"ID":"e122af9b-b02f-4e30-b8b2-da8a542d77c5","Type":"ContainerStarted","Data":"24a790d7d9c77783f7721773f3ea389598e0654317cd8632b3373770a2699f78"} Sep 08 10:07:01.208103 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.205830 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qn6nb" podStartSLOduration=1.5657898609999998 podStartE2EDuration="21.205807956s" totalImagesPullingTime="19.640018095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:01.205411673 +0000 UTC m=+22.610274121" watchObservedRunningTime="2026-09-08 10:07:01.205807956 +0000 UTC m=+22.610670406" Sep 08 10:07:01.208103 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.206804 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-17.ec2.internal" podStartSLOduration=20.206790423 podStartE2EDuration="20.206790423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:06:43.156984364 +0000 UTC m=+4.561846816" watchObservedRunningTime="2026-09-08 10:07:01.206790423 +0000 UTC m=+22.611652872" Sep 08 10:07:01.222612 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.221948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" event={"ID":"6613c508e2f799827626149a2992482f","Type":"ContainerStarted","Data":"c268052bbec5322249c9595e55b845a2c96c00e6d8023ea4bb9f4cb885b6cafe"} Sep 08 10:07:01.227139 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.226542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tthb7" event={"ID":"0d777bb5-e556-438f-8ae3-634f4f0e6879","Type":"ContainerStarted","Data":"ab062d1e2055e781d5071bc570356f70b7dd1b453f67777255ce6605a0ab653f"} Sep 08 10:07:01.234033 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.233979 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vwppv" podStartSLOduration=1.476611047 podStartE2EDuration="21.23396423s" totalImagesPullingTime="19.757353183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:01.233291454 +0000 UTC m=+22.638153904" watchObservedRunningTime="2026-09-08 10:07:01.23396423 +0000 UTC m=+22.638826677" Sep 08 10:07:01.271211 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.271075 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tthb7" podStartSLOduration=1.687579386 podStartE2EDuration="21.271058704s" totalImagesPullingTime="19.583479318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:01.25794809 +0000 UTC m=+22.662810551" watchObservedRunningTime="2026-09-08 10:07:01.271058704 +0000 UTC m=+22.675921232" Sep 08 10:07:01.271513 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:01.271472 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-17.ec2.internal" podStartSLOduration=20.271460441 podStartE2EDuration="20.271460441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:01.270672726 +0000 UTC m=+22.675535185" watchObservedRunningTime="2026-09-08 10:07:01.271460441 +0000 UTC m=+22.676322892" Sep 08 10:07:02.230265 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.230233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jczk" event={"ID":"0564785d-36fe-474e-9eae-82d5797ed588","Type":"ContainerStarted","Data":"a81fdacbc060075419ec1c0d6c0caffb34ff5f858ad16440c677d964c4163763"} Sep 08 10:07:02.231852 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.231822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l5msj" event={"ID":"4c833253-97ce-42a6-a3aa-8e441495dfbf","Type":"ContainerStarted","Data":"c3a7869b43d7406e87c28e2f5b2ac280b4d83736a383f661f994e6507cd7b396"} Sep 08 10:07:02.234760 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.234722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"f23429edf1f728ac2101cde8c76c0fe718d6d93d21205aa0dea95ef72e97f6b1"} Sep 08 10:07:02.234886 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.234807 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"e2243fb27b98f63c1f8431400573faa5964822abd14af23cf0783f066ee3576a"} Sep 08 10:07:02.234886 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.234859 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"7e10dc6da335f5e3c177f430e8434ff7afb7ef6e2db8edd806716d355c59356f"} Sep 08 10:07:02.234966 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.234908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"0e2eb9074b62dc7e519ccf0c387c96ee0a4d6f55a602fca200f23c5f63372d3c"} Sep 08 10:07:02.234966 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.234958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"4b74673a3dc1f750522a97c564b7af1b137420ec928b82339179e7aad7aedd45"} Sep 08 10:07:02.236217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.236197 2577 generic.go:356] "Generic (PLEG): container finished" podID="14b94402-8a66-4526-9a13-650d2187c4fd" containerID="8e34ed9d724bcf90954b4b66c0111cf0a414284d9f7c1114b800b09c7b054813" exitCode=0 Sep 08 10:07:02.236308 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.236255 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerDied","Data":"8e34ed9d724bcf90954b4b66c0111cf0a414284d9f7c1114b800b09c7b054813"} Sep 08 10:07:02.237855 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.237832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" event={"ID":"e56543a3-5370-4bea-b3df-ca8bc18a21bb","Type":"ContainerStarted","Data":"0c59c756b71280c3616e7237510800cd23574fc9b10d3ab748c51e22ac205964"} Sep 08 10:07:02.239349 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.239327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vwppv" event={"ID":"5bfdc435-5a0e-418e-93eb-020c0d5a2d6c","Type":"ContainerStarted","Data":"cc8987af7bbc047c506313c182da427c90be4cc6dca4968eb85c5cc32c702a21"} Sep 08 10:07:02.244531 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.244493 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2jczk" podStartSLOduration=2.646661141 podStartE2EDuration="22.244480639s" totalImagesPullingTime="19.597819498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:02.244145368 +0000 UTC m=+23.649007890" watchObservedRunningTime="2026-09-08 10:07:02.244480639 +0000 UTC m=+23.649343086" Sep 08 10:07:02.278916 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.278859 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l5msj" podStartSLOduration=2.528996579 podStartE2EDuration="22.27884297s" totalImagesPullingTime="19.749846391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:02.278721549 +0000 UTC m=+23.683583995" watchObservedRunningTime="2026-09-08 10:07:02.27884297 +0000 UTC m=+23.683705417" Sep 08 10:07:02.851797 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.851763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:07:02.852665 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:02.852638 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:07:03.042702 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.042665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:03.042702 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.042695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:03.042940 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.042665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:03.042940 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:03.042846 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:03.043035 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:03.042992 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:03.043103 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:03.043080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:03.243011 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.242972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nsj84" event={"ID":"55457d6c-5003-42bb-9783-3ae4b3207dd4","Type":"ContainerStarted","Data":"c9c155001052be73fd590e7cc38256ca6ec3bfe130ce69297d03e782261d403e"} Sep 08 10:07:03.243477 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.243356 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:07:03.243832 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.243810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l5msj" Sep 08 10:07:03.274392 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:03.274324 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nsj84" podStartSLOduration=3.664978198 podStartE2EDuration="23.274306688s" totalImagesPullingTime="19.60932849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:03.259069533 +0000 UTC m=+24.663931982" watchObservedRunningTime="2026-09-08 10:07:03.274306688 +0000 UTC m=+24.679169134" Sep 08 10:07:04.248722 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:04.248689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"bfc4b25b9c723261b1a655487934a9e8a878a1f1df8f61657091a80c2a5d759f"} Sep 08 10:07:05.045506 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:05.045472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:05.045767 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:05.045566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:05.045767 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:05.045573 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:05.045767 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:05.045680 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:05.045767 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:05.045750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:05.045957 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:05.045836 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:07.043386 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:07.043351 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:07.043931 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:07.043417 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:07.043931 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:07.043424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:07.043931 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:07.043500 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:07.043931 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:07.043624 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:07.043931 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:07.043746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:07.882239 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:07.877872 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 10:07:08.016890 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.016782 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T10:07:07.878080525Z","UUID":"fd6ba63c-8f8e-4731-951a-d9b31433f826","Handler":null,"Name":"","Endpoint":""} Sep 08 10:07:08.018456 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.018434 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 10:07:08.018561 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.018468 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 10:07:08.261178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.261146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" event={"ID":"e2565da8-d702-4762-a544-bd4d712e6ac6","Type":"ContainerStarted","Data":"a43ebc249f6395535ff8a6b029ed6e1cf0c398b61eb9fe3532a5bd0784f4d8e6"} Sep 08 10:07:08.261935 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.261429 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:07:08.261935 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.261499 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:07:08.261935 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.261530 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:07:08.263562 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.263540 2577 generic.go:356] "Generic (PLEG): container finished" podID="14b94402-8a66-4526-9a13-650d2187c4fd" containerID="2947db4138d0e60bfb3ed8f21a39a25781da4b7519790aa3b161403a36f36d87" exitCode=0 Sep 08 10:07:08.263711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.263604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerDied","Data":"2947db4138d0e60bfb3ed8f21a39a25781da4b7519790aa3b161403a36f36d87"} Sep 08 10:07:08.266107 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.266085 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" event={"ID":"e56543a3-5370-4bea-b3df-ca8bc18a21bb","Type":"ContainerStarted","Data":"4624eec22f3f5eb9fabd5be18aeead14fe1c3d6a79f155dc13063c85451fc79e"} Sep 08 10:07:08.278519 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.278480 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:07:08.278650 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.278613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:07:08.292839 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:08.292786 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" podStartSLOduration=8.645253569 podStartE2EDuration="28.292770247s" totalImagesPullingTime="19.647516678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:08.290135482 +0000 UTC m=+29.694997930" watchObservedRunningTime="2026-09-08 10:07:08.292770247 +0000 UTC m=+29.697632693" Sep 08 10:07:09.043091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.043054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:09.043278 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.043166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:09.043278 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:09.043179 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:09.043401 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.043295 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:09.043401 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:09.043373 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:09.043401 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:09.043290 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:09.738530 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.738340 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bvvg9"] Sep 08 10:07:09.739053 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.738615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:09.739053 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:09.738707 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:09.747102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.745561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9rrz2"] Sep 08 10:07:09.747102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.745671 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8s9q4"] Sep 08 10:07:09.747102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.745808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:09.747102 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:09.745955 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:09.747102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:09.746084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:09.747102 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:09.746212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:10.273944 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:10.273909 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" event={"ID":"e56543a3-5370-4bea-b3df-ca8bc18a21bb","Type":"ContainerStarted","Data":"5848b82df29ab6fcb55c99c2c28f35bfa3727d25d751b57795ccf457b70f7061"} Sep 08 10:07:10.290475 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:10.290430 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b7qkc" podStartSLOduration=2.831217378 podStartE2EDuration="30.290416978s" totalImagesPullingTime="27.4591996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:10.290026622 +0000 UTC m=+31.694889070" watchObservedRunningTime="2026-09-08 10:07:10.290416978 +0000 UTC m=+31.695279426" Sep 08 10:07:11.042901 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:11.042864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:11.043249 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:11.042912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:11.043249 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:11.042864 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:11.043249 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:11.042988 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:11.043249 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:11.043053 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:11.043249 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:11.043134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:11.277993 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:11.277961 2577 generic.go:356] "Generic (PLEG): container finished" podID="14b94402-8a66-4526-9a13-650d2187c4fd" containerID="60ad478a336bbe08617c52b4ba35f23fcf2869e2701eab957889d38cb689107c" exitCode=0 Sep 08 10:07:11.278140 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:11.278048 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerDied","Data":"60ad478a336bbe08617c52b4ba35f23fcf2869e2701eab957889d38cb689107c"} Sep 08 10:07:12.282973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:12.282934 2577 generic.go:356] "Generic (PLEG): container finished" podID="14b94402-8a66-4526-9a13-650d2187c4fd" containerID="ce0fb999e86ad42c3b910c6f9c2484de30486d0fa1b025d82da0245cc2d57cf6" exitCode=0 Sep 08 10:07:12.282973 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:12.282977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerDied","Data":"ce0fb999e86ad42c3b910c6f9c2484de30486d0fa1b025d82da0245cc2d57cf6"} Sep 08 10:07:12.811857 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:12.811824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:12.812099 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:12.811876 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:12.812099 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.811955 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:07:12.812099 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.811958 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:07:12.812099 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.812002 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:44.811988158 +0000 UTC m=+66.216850584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:07:12.812099 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.812014 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret podName:31afbe58-732a-4cf8-81e9-9af79095b26e nodeName:}" failed. No retries permitted until 2026-09-08 10:07:44.812008487 +0000 UTC m=+66.216870912 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret") pod "global-pull-secret-syncer-bvvg9" (UID: "31afbe58-732a-4cf8-81e9-9af79095b26e") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:07:12.912945 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:12.912913 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:12.913088 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.913020 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:07:12.913088 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.913035 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:07:12.913088 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.913043 2577 projected.go:196] Error preparing data for projected volume kube-api-access-7np8w for pod openshift-network-diagnostics/network-check-target-9rrz2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:07:12.913088 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:12.913087 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w podName:6d595065-eb5d-4533-be4c-7182c9d724ba nodeName:}" failed. No retries permitted until 2026-09-08 10:07:44.91307499 +0000 UTC m=+66.317937415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7np8w" (UniqueName: "kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w") pod "network-check-target-9rrz2" (UID: "6d595065-eb5d-4533-be4c-7182c9d724ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:07:13.042767 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:13.042715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:13.042767 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:13.042766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:13.042978 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:13.042860 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9rrz2" podUID="6d595065-eb5d-4533-be4c-7182c9d724ba" Sep 08 10:07:13.042978 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:13.042896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:13.042978 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:13.042965 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvvg9" podUID="31afbe58-732a-4cf8-81e9-9af79095b26e" Sep 08 10:07:13.043131 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:13.043063 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:07:13.923418 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:13.923347 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-17.ec2.internal" event="NodeReady" Sep 08 10:07:13.923780 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:13.923466 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 10:07:13.955516 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:13.955483 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68cdf78ffc-wdptn"] Sep 08 10:07:14.046857 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.046819 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cdf78ffc-wdptn"] Sep 08 10:07:14.046857 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.046864 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rj6lj"] Sep 08 10:07:14.047061 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.046931 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.049126 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.049091 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 10:07:14.049265 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.049141 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 10:07:14.049265 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.049105 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ssdtn\"" Sep 08 10:07:14.049265 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.049235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 10:07:14.057287 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.056390 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 10:07:14.061074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.061054 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h8p2w"] Sep 08 10:07:14.061178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.061163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.065102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.065083 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 10:07:14.065199 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.065113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 10:07:14.065199 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.065118 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8hl6\"" Sep 08 10:07:14.077215 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.077196 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rj6lj"] Sep 08 10:07:14.077328 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.077238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h8p2w"] Sep 08 10:07:14.077328 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.077261 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.082883 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.082859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 10:07:14.082979 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.082897 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bpsj5\"" Sep 08 10:07:14.083149 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.083135 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 10:07:14.083149 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.083145 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 10:07:14.121624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-trusted-ca\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.121624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d76450c-2824-4337-9bf8-11dc16b10c2f-ca-trust-extracted\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.121925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.121925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6vw\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-kube-api-access-xl6vw\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.121925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-certificates\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.121925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-installation-pull-secrets\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.122160 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-image-registry-private-configuration\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.122160 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.121988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-bound-sa-token\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.149455 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.149415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:14.222639 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-tmp-dir\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.222639 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6vw\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-kube-api-access-xl6vw\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.222639 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222627 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-certificates\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.222639 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-installation-pull-secrets\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.222939 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzhlm\" (UniqueName: \"kubernetes.io/projected/98c2ff34-89c0-4e96-b722-92660a639e28-kube-api-access-bzhlm\") pod \"ingress-canary-h8p2w\" (UID: \"98c2ff34-89c0-4e96-b722-92660a639e28\") " pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.222939 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-config-volume\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.222939 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-image-registry-private-configuration\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-bound-sa-token\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.222994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.223085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9zt\" (UniqueName: \"kubernetes.io/projected/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-kube-api-access-sx9zt\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.223085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-trusted-ca\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d76450c-2824-4337-9bf8-11dc16b10c2f-ca-trust-extracted\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223153 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c2ff34-89c0-4e96-b722-92660a639e28-cert\") pod \"ingress-canary-h8p2w\" (UID: \"98c2ff34-89c0-4e96-b722-92660a639e28\") " pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.223334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223220 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-certificates\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223334 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.223290 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:14.223334 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.223303 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:14.223568 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.223358 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:07:14.723341608 +0000 UTC m=+36.128204036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:14.223568 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d76450c-2824-4337-9bf8-11dc16b10c2f-ca-trust-extracted\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.223953 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.223921 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-trusted-ca\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.226990 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.226968 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-image-registry-private-configuration\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.227199 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.226975 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-installation-pull-secrets\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.233814 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.233792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6vw\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-kube-api-access-xl6vw\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.233814 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.233806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-bound-sa-token\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.255870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.255835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:14.323550 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-tmp-dir\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.323550 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzhlm\" (UniqueName: \"kubernetes.io/projected/98c2ff34-89c0-4e96-b722-92660a639e28-kube-api-access-bzhlm\") pod \"ingress-canary-h8p2w\" (UID: \"98c2ff34-89c0-4e96-b722-92660a639e28\") " pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.323772 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-config-volume\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.323772 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.323847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9zt\" (UniqueName: \"kubernetes.io/projected/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-kube-api-access-sx9zt\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.323879 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c2ff34-89c0-4e96-b722-92660a639e28-cert\") pod \"ingress-canary-h8p2w\" (UID: \"98c2ff34-89c0-4e96-b722-92660a639e28\") " pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.323909 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.323877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-tmp-dir\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.323909 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.323897 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:14.323982 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.323970 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:14.823948944 +0000 UTC m=+36.228811402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:14.324192 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.324172 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-config-volume\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.326253 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.326237 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c2ff34-89c0-4e96-b722-92660a639e28-cert\") pod \"ingress-canary-h8p2w\" (UID: \"98c2ff34-89c0-4e96-b722-92660a639e28\") " pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.333041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.333020 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzhlm\" (UniqueName: \"kubernetes.io/projected/98c2ff34-89c0-4e96-b722-92660a639e28-kube-api-access-bzhlm\") pod \"ingress-canary-h8p2w\" (UID: \"98c2ff34-89c0-4e96-b722-92660a639e28\") " pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.333247 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.333232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9zt\" (UniqueName: \"kubernetes.io/projected/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-kube-api-access-sx9zt\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.385548 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.385519 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h8p2w" Sep 08 10:07:14.712289 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.712117 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h8p2w"] Sep 08 10:07:14.716145 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:07:14.716120 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c2ff34_89c0_4e96_b722_92660a639e28.slice/crio-f9f8a1b084e2de59104b6ebd5dd32076e3d11bfd6ae1658fd3070c003a899bd2 WatchSource:0}: Error finding container f9f8a1b084e2de59104b6ebd5dd32076e3d11bfd6ae1658fd3070c003a899bd2: Status 404 returned error can't find the container with id f9f8a1b084e2de59104b6ebd5dd32076e3d11bfd6ae1658fd3070c003a899bd2 Sep 08 10:07:14.726221 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.726200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:14.726316 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.726303 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:14.726355 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.726319 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:14.726391 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.726362 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:07:15.726348128 +0000 UTC m=+37.131210556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:14.827348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:14.827260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:14.827489 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.827407 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:14.827489 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:14.827482 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:15.827464882 +0000 UTC m=+37.232327331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:15.043356 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.043318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:15.043356 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.043352 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:15.043965 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.043318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:15.046361 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.046338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 10:07:15.046476 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.046388 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 10:07:15.046476 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.046396 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-755cm\"" Sep 08 10:07:15.047250 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.047234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 10:07:15.047250 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.047242 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm4jr\"" Sep 08 10:07:15.047382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.047275 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 10:07:15.290299 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.290263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h8p2w" event={"ID":"98c2ff34-89c0-4e96-b722-92660a639e28","Type":"ContainerStarted","Data":"f9f8a1b084e2de59104b6ebd5dd32076e3d11bfd6ae1658fd3070c003a899bd2"} Sep 08 10:07:15.734592 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.734545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:15.734787 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:15.734695 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:15.734787 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:15.734715 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:15.734894 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:15.734797 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:07:17.734781359 +0000 UTC m=+39.139643805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:15.835690 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:15.835653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:15.835866 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:15.835821 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:15.835925 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:15.835881 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:17.835865635 +0000 UTC m=+39.240728080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:16.575795 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:16.575752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:16.698173 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:16.698095 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:17.753045 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:17.753009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:17.753592 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:17.753155 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:17.753592 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:17.753178 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:17.753592 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:17.753251 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:07:21.753229215 +0000 UTC m=+43.158091657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:17.854073 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:17.854002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:17.854203 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:17.854105 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:17.854203 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:17.854155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:21.854142203 +0000 UTC m=+43.259004628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:18.299473 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:18.299440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h8p2w" event={"ID":"98c2ff34-89c0-4e96-b722-92660a639e28","Type":"ContainerStarted","Data":"210b06629252d4a24e00ed02f8426e44fdf6ff907eebeb5102b9b298b0637779"} Sep 08 10:07:18.315659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:18.315603 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h8p2w" podStartSLOduration=2.47614714 podStartE2EDuration="5.31558174s" totalImagesPullingTime="2.8394346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:18.315066916 +0000 UTC m=+39.719929365" watchObservedRunningTime="2026-09-08 10:07:18.31558174 +0000 UTC m=+39.720444191" Sep 08 10:07:18.524905 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:18.524694 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:19.949142 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:19.949103 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:20.281414 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:20.281381 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:21.788213 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:21.788174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:21.788614 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:21.788344 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:21.788614 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:21.788366 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:21.788614 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:21.788424 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:07:29.788408687 +0000 UTC m=+51.193271122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:21.889055 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:21.888982 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:21.889137 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:21.889101 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:21.889172 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:21.889153 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:29.889140063 +0000 UTC m=+51.294002501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:21.957908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:21.957879 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:22.076540 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:22.076506 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:22.311331 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:22.311296 2577 generic.go:356] "Generic (PLEG): container finished" podID="14b94402-8a66-4526-9a13-650d2187c4fd" containerID="47e09d65c4ae8a5e66a8e3fefea0f18ffb3990cb24b262122e9136f7786777ad" exitCode=0 Sep 08 10:07:22.311507 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:22.311350 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerDied","Data":"47e09d65c4ae8a5e66a8e3fefea0f18ffb3990cb24b262122e9136f7786777ad"} Sep 08 10:07:23.317214 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:23.317176 2577 generic.go:356] "Generic (PLEG): container finished" podID="14b94402-8a66-4526-9a13-650d2187c4fd" containerID="41172bf914292a9f173a1ea5df880ddc25bdb8d3acb7b09fe1576e3575772265" exitCode=0 Sep 08 10:07:23.317670 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:23.317224 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerDied","Data":"41172bf914292a9f173a1ea5df880ddc25bdb8d3acb7b09fe1576e3575772265"} Sep 08 10:07:24.323316 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:24.323275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" event={"ID":"14b94402-8a66-4526-9a13-650d2187c4fd","Type":"ContainerStarted","Data":"22794338289d1f0ef8d55f6a4630a4a121a581f62c0d5c902e1ea4d9c5beb06d"} Sep 08 10:07:24.345879 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:24.345830 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2lnm4" podStartSLOduration=7.073816106 podStartE2EDuration="44.345813755s" totalImagesPullingTime="37.271997649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:24.344866788 +0000 UTC m=+45.749729234" watchObservedRunningTime="2026-09-08 10:07:24.345813755 +0000 UTC m=+45.750676201" Sep 08 10:07:24.481303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:24.481267 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:24.594259 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:24.594174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:28.955370 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:28.955341 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:29.081961 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:29.081917 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:29.188082 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:29.188049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:29.291164 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:29.291112 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:29.849964 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:29.849885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:29.850367 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:29.850346 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:29.850464 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:29.850370 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:29.850600 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:29.850588 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:07:45.850568252 +0000 UTC m=+67.255430677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:29.951273 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:29.951234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:29.951437 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:29.951395 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:29.951477 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:29.951472 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:07:45.95145514 +0000 UTC m=+67.356317570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:29.966887 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:29.966857 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:30.029807 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:30.029778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:34.553306 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:34.553270 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:34.615661 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:34.615626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:35.447241 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:35.447195 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:36.059876 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:36.059852 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:37.618874 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:37.618833 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:38.595362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:38.595328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:40.284898 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:40.284867 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2rmb7" Sep 08 10:07:40.643826 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:40.643707 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:40.708849 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:40.708820 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:44.858918 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.858885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:44.859382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.858949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:07:44.861142 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.861121 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 10:07:44.861273 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.861223 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 10:07:44.869839 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:44.869820 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 10:07:44.869908 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:44.869896 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:08:48.869876541 +0000 UTC m=+130.274738980 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : secret "metrics-daemon-secret" not found Sep 08 10:07:44.872592 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.872574 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31afbe58-732a-4cf8-81e9-9af79095b26e-original-pull-secret\") pod \"global-pull-secret-syncer-bvvg9\" (UID: \"31afbe58-732a-4cf8-81e9-9af79095b26e\") " pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:44.960258 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.960220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:44.962538 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.962519 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 10:07:44.973153 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.973130 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 10:07:44.984343 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:44.984313 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7np8w\" (UniqueName: \"kubernetes.io/projected/6d595065-eb5d-4533-be4c-7182c9d724ba-kube-api-access-7np8w\") pod \"network-check-target-9rrz2\" (UID: \"6d595065-eb5d-4533-be4c-7182c9d724ba\") " pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:45.053214 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.053184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvvg9" Sep 08 10:07:45.065962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.065940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-755cm\"" Sep 08 10:07:45.074656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.074636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:45.324063 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.321805 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bvvg9"] Sep 08 10:07:45.325427 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:07:45.325397 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31afbe58_732a_4cf8_81e9_9af79095b26e.slice/crio-0a27aedfd2cc652b279002a6ce522cc1550ba89e7cfcf5985f2d72a26c4d06cf WatchSource:0}: Error finding container 0a27aedfd2cc652b279002a6ce522cc1550ba89e7cfcf5985f2d72a26c4d06cf: Status 404 returned error can't find the container with id 0a27aedfd2cc652b279002a6ce522cc1550ba89e7cfcf5985f2d72a26c4d06cf Sep 08 10:07:45.347182 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.347149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9rrz2"] Sep 08 10:07:45.351079 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:07:45.351048 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d595065_eb5d_4533_be4c_7182c9d724ba.slice/crio-24d1660688a7984f83492228093a23348ea1daa99532033b44ec5f2c94d5f28b WatchSource:0}: Error finding container 24d1660688a7984f83492228093a23348ea1daa99532033b44ec5f2c94d5f28b: Status 404 returned error can't find the container with id 24d1660688a7984f83492228093a23348ea1daa99532033b44ec5f2c94d5f28b Sep 08 10:07:45.363610 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.363577 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:45.370355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.370325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9rrz2" event={"ID":"6d595065-eb5d-4533-be4c-7182c9d724ba","Type":"ContainerStarted","Data":"24d1660688a7984f83492228093a23348ea1daa99532033b44ec5f2c94d5f28b"} Sep 08 10:07:45.371358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.371336 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bvvg9" event={"ID":"31afbe58-732a-4cf8-81e9-9af79095b26e","Type":"ContainerStarted","Data":"0a27aedfd2cc652b279002a6ce522cc1550ba89e7cfcf5985f2d72a26c4d06cf"} Sep 08 10:07:45.866837 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.866794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:07:45.867220 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:45.866944 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:07:45.867220 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:45.866967 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:07:45.867220 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:45.867020 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:08:17.867005294 +0000 UTC m=+99.271867719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:07:45.967958 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:45.967919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:07:45.968119 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:45.968027 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:07:45.968119 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:07:45.968078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:08:17.968065392 +0000 UTC m=+99.372927830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:07:51.388626 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:51.388588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9rrz2" event={"ID":"6d595065-eb5d-4533-be4c-7182c9d724ba","Type":"ContainerStarted","Data":"c77b79af714330e0c7ff9464255c067bbe7289f20c2602309f3f665399e11faa"} Sep 08 10:07:51.389123 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:51.388657 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:07:51.390052 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:51.390032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bvvg9" event={"ID":"31afbe58-732a-4cf8-81e9-9af79095b26e","Type":"ContainerStarted","Data":"599585d2e010fceffea724f2172a79d7d8183705c123bec717d5ed06664513c1"} Sep 08 10:07:51.403275 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:51.403214 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9rrz2" podStartSLOduration=66.03140857 podStartE2EDuration="1m11.403199348s" totalImagesPullingTime="5.371790778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:51.403016324 +0000 UTC m=+72.807878771" watchObservedRunningTime="2026-09-08 10:07:51.403199348 +0000 UTC m=+72.808061792" Sep 08 10:07:51.416605 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:51.416558 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bvvg9" podStartSLOduration=66.007350641 podStartE2EDuration="1m11.416541732s" totalImagesPullingTime="5.409191091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:51.415996505 +0000 UTC m=+72.820858952" watchObservedRunningTime="2026-09-08 10:07:51.416541732 +0000 UTC m=+72.821404180" Sep 08 10:07:53.859124 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:53.859094 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:53.960668 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:53.960643 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:54.669954 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:54.669920 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:55.465908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:55.465878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:07:55.565486 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:07:55.565452 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:08:17.890326 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:08:17.890267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:08:17.890861 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:17.890426 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 10:08:17.890861 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:17.890447 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68cdf78ffc-wdptn: secret "image-registry-tls" not found Sep 08 10:08:17.890861 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:17.890513 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls podName:1d76450c-2824-4337-9bf8-11dc16b10c2f nodeName:}" failed. No retries permitted until 2026-09-08 10:09:21.890497749 +0000 UTC m=+163.295360189 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls") pod "image-registry-68cdf78ffc-wdptn" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f") : secret "image-registry-tls" not found Sep 08 10:08:17.990629 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:08:17.990592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:08:17.990796 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:17.990776 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:08:17.990924 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:17.990911 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls podName:9400831b-d835-4eb6-9ce2-be6c3b0a1bf3 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:21.990893723 +0000 UTC m=+163.395756149 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls") pod "dns-default-rj6lj" (UID: "9400831b-d835-4eb6-9ce2-be6c3b0a1bf3") : secret "dns-default-metrics-tls" not found Sep 08 10:08:22.395250 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:08:22.395211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9rrz2" Sep 08 10:08:48.912052 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:08:48.912002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:08:48.912539 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:48.912162 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 10:08:48.912539 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:08:48.912240 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs podName:f888f945-1538-4b99-9cc4-fc69c518a469 nodeName:}" failed. No retries permitted until 2026-09-08 10:10:50.912222853 +0000 UTC m=+252.317085291 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs") pod "network-metrics-daemon-8s9q4" (UID: "f888f945-1538-4b99-9cc4-fc69c518a469") : secret "metrics-daemon-secret" not found Sep 08 10:08:59.766571 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:08:59.766535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:08:59.843351 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:08:59.843324 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:01.505725 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.505691 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d"] Sep 08 10:09:01.508692 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.508671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.511721 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.511694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mq7lw\"" Sep 08 10:09:01.512284 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.512266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 08 10:09:01.512332 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.512285 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 10:09:01.512548 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.512535 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 10:09:01.513950 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.513933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 08 10:09:01.524173 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.524145 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d"] Sep 08 10:09:01.601254 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.601196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.601501 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.601281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67d455ed-3301-4c43-b6b7-3f6c573b1174-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.601501 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.601316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6d4c\" (UniqueName: \"kubernetes.io/projected/67d455ed-3301-4c43-b6b7-3f6c573b1174-kube-api-access-s6d4c\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.602386 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.602361 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-rpj69"] Sep 08 10:09:01.605185 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.605166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.610789 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.610761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 08 10:09:01.610959 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.610822 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mphbg\"" Sep 08 10:09:01.611657 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.611631 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 08 10:09:01.614604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.614585 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:09:01.620035 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.620012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 08 10:09:01.620657 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.620635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 08 10:09:01.620982 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.620963 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-rpj69"] Sep 08 10:09:01.642562 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.642526 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh"] Sep 08 10:09:01.649078 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.649044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.654870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.654781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 10:09:01.654870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.654784 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 10:09:01.655126 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.655079 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 08 10:09:01.655251 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.655194 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 08 10:09:01.655442 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.655429 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 08 10:09:01.655489 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.655427 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 08 10:09:01.658342 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.658320 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 10:09:01.660115 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.660096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh"] Sep 08 10:09:01.702255 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.702255 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sf8h\" (UniqueName: \"kubernetes.io/projected/f9be1eec-3fb6-4544-9cf7-a78f8de71871-kube-api-access-9sf8h\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.702508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9be1eec-3fb6-4544-9cf7-a78f8de71871-serving-cert\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.702508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67d455ed-3301-4c43-b6b7-3f6c573b1174-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.702508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9be1eec-3fb6-4544-9cf7-a78f8de71871-trusted-ca\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.702508 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:01.702402 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:01.702508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6d4c\" (UniqueName: \"kubernetes.io/projected/67d455ed-3301-4c43-b6b7-3f6c573b1174-kube-api-access-s6d4c\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.702508 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:01.702490 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls podName:67d455ed-3301-4c43-b6b7-3f6c573b1174 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:02.202467597 +0000 UTC m=+143.607330025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vcg9d" (UID: "67d455ed-3301-4c43-b6b7-3f6c573b1174") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:01.702826 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702520 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9be1eec-3fb6-4544-9cf7-a78f8de71871-config\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.702967 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.702950 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67d455ed-3301-4c43-b6b7-3f6c573b1174-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.761643 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.761570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6d4c\" (UniqueName: \"kubernetes.io/projected/67d455ed-3301-4c43-b6b7-3f6c573b1174-kube-api-access-s6d4c\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:01.803779 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sf8h\" (UniqueName: \"kubernetes.io/projected/f9be1eec-3fb6-4544-9cf7-a78f8de71871-kube-api-access-9sf8h\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.803779 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9be1eec-3fb6-4544-9cf7-a78f8de71871-serving-cert\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.803779 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-hub\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-ca\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/836e790a-95ff-469d-aa16-af7cf1e11907-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9be1eec-3fb6-4544-9cf7-a78f8de71871-trusted-ca\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqd8x\" (UniqueName: \"kubernetes.io/projected/836e790a-95ff-469d-aa16-af7cf1e11907-kube-api-access-hqd8x\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.804084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.803969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9be1eec-3fb6-4544-9cf7-a78f8de71871-config\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.804598 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.804579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f9be1eec-3fb6-4544-9cf7-a78f8de71871-config\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.804759 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.804717 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9be1eec-3fb6-4544-9cf7-a78f8de71871-trusted-ca\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.806253 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.806221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f9be1eec-3fb6-4544-9cf7-a78f8de71871-serving-cert\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.853806 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.853766 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sf8h\" (UniqueName: \"kubernetes.io/projected/f9be1eec-3fb6-4544-9cf7-a78f8de71871-kube-api-access-9sf8h\") pod \"console-operator-85b454874b-rpj69\" (UID: \"f9be1eec-3fb6-4544-9cf7-a78f8de71871\") " pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.905237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.905177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-ca\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.905237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.905243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.905498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.905266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/836e790a-95ff-469d-aa16-af7cf1e11907-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.905498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.905293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.905498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.905343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqd8x\" (UniqueName: \"kubernetes.io/projected/836e790a-95ff-469d-aa16-af7cf1e11907-kube-api-access-hqd8x\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.905498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.905431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-hub\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.906314 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.906283 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/836e790a-95ff-469d-aa16-af7cf1e11907-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.907810 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.907779 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-ca\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.907983 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.907963 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.908108 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.908088 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-hub\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.908146 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.908091 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/836e790a-95ff-469d-aa16-af7cf1e11907-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.913849 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.913828 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:01.930141 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.930111 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqd8x\" (UniqueName: \"kubernetes.io/projected/836e790a-95ff-469d-aa16-af7cf1e11907-kube-api-access-hqd8x\") pod \"cluster-proxy-proxy-agent-6ddd7cc76-vzwgh\" (UID: \"836e790a-95ff-469d-aa16-af7cf1e11907\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:01.968084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:01.968053 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:09:02.188934 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:02.188886 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-rpj69"] Sep 08 10:09:02.193501 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:02.193473 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9be1eec_3fb6_4544_9cf7_a78f8de71871.slice/crio-6e18d8d7bd00d667ca4b02e5081873699b36a7c2801f46244a075307c6f555aa WatchSource:0}: Error finding container 6e18d8d7bd00d667ca4b02e5081873699b36a7c2801f46244a075307c6f555aa: Status 404 returned error can't find the container with id 6e18d8d7bd00d667ca4b02e5081873699b36a7c2801f46244a075307c6f555aa Sep 08 10:09:02.208546 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:02.208517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:02.208669 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:02.208633 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:02.208706 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:02.208686 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls podName:67d455ed-3301-4c43-b6b7-3f6c573b1174 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:03.208672596 +0000 UTC m=+144.613535021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vcg9d" (UID: "67d455ed-3301-4c43-b6b7-3f6c573b1174") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:02.249522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:02.249481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh"] Sep 08 10:09:02.252909 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:02.252882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod836e790a_95ff_469d_aa16_af7cf1e11907.slice/crio-d8dee2d26dfc31808cf8ca75421e030ec025044e2ceff443396dfb77988a2f46 WatchSource:0}: Error finding container d8dee2d26dfc31808cf8ca75421e030ec025044e2ceff443396dfb77988a2f46: Status 404 returned error can't find the container with id d8dee2d26dfc31808cf8ca75421e030ec025044e2ceff443396dfb77988a2f46 Sep 08 10:09:02.559976 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:02.559942 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" event={"ID":"836e790a-95ff-469d-aa16-af7cf1e11907","Type":"ContainerStarted","Data":"d8dee2d26dfc31808cf8ca75421e030ec025044e2ceff443396dfb77988a2f46"} Sep 08 10:09:02.561103 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:02.561079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-rpj69" event={"ID":"f9be1eec-3fb6-4544-9cf7-a78f8de71871","Type":"ContainerStarted","Data":"6e18d8d7bd00d667ca4b02e5081873699b36a7c2801f46244a075307c6f555aa"} Sep 08 10:09:03.217087 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:03.217041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:03.217256 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:03.217226 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:03.217332 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:03.217291 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls podName:67d455ed-3301-4c43-b6b7-3f6c573b1174 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:05.217273344 +0000 UTC m=+146.622135785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vcg9d" (UID: "67d455ed-3301-4c43-b6b7-3f6c573b1174") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:03.698846 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:03.698810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:03.777239 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:03.777203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:05.234712 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.234680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:05.235463 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:05.234870 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:05.235463 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:05.234965 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls podName:67d455ed-3301-4c43-b6b7-3f6c573b1174 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:09.234948396 +0000 UTC m=+150.639810840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vcg9d" (UID: "67d455ed-3301-4c43-b6b7-3f6c573b1174") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:05.965315 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.965265 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-frtg9"] Sep 08 10:09:05.968511 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.968484 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:05.972567 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.972547 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 10:09:05.972900 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.972865 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 10:09:05.973522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.973188 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fpk9p\"" Sep 08 10:09:05.973522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.973305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 10:09:05.973522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.973382 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 10:09:05.991996 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.991958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frtg9"] Sep 08 10:09:05.999422 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:05.999382 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:06.141982 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.141941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62dd1c11-c544-4e51-9cb9-44e5a413837d-data-volume\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.142178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.142014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62dd1c11-c544-4e51-9cb9-44e5a413837d-crio-socket\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.142178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.142042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvmlj\" (UniqueName: \"kubernetes.io/projected/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-api-access-nvmlj\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.142178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.142159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.142352 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.142199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.150345 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.150312 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:06.242813 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.242770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62dd1c11-c544-4e51-9cb9-44e5a413837d-data-volume\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.242883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62dd1c11-c544-4e51-9cb9-44e5a413837d-crio-socket\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.242908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvmlj\" (UniqueName: \"kubernetes.io/projected/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-api-access-nvmlj\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.242975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.242996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.243011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62dd1c11-c544-4e51-9cb9-44e5a413837d-crio-socket\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.243090 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.243112 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.243156 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:06.743138978 +0000 UTC m=+148.148001434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : configmap "kube-rbac-proxy" not found Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.243174 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:06.743164624 +0000 UTC m=+148.148027050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : secret "insights-runtime-extractor-tls" not found Sep 08 10:09:06.243290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.243196 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62dd1c11-c544-4e51-9cb9-44e5a413837d-data-volume\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.262893 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.262861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvmlj\" (UniqueName: \"kubernetes.io/projected/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-api-access-nvmlj\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.576125 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.576094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" event={"ID":"836e790a-95ff-469d-aa16-af7cf1e11907","Type":"ContainerStarted","Data":"155713854e07cbe881e4977cfbe03e34005a63a1bf341f1245377aed21224c0a"} Sep 08 10:09:06.576237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.576148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" event={"ID":"836e790a-95ff-469d-aa16-af7cf1e11907","Type":"ContainerStarted","Data":"0bf1fb6ca008f00639915c44c650a8266d92c19971c11ddcb922baab4b621da6"} Sep 08 10:09:06.577669 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.577651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/0.log" Sep 08 10:09:06.577772 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.577686 2577 generic.go:356] "Generic (PLEG): container finished" podID="f9be1eec-3fb6-4544-9cf7-a78f8de71871" containerID="18c4700d61c0afe2f531a1681d22db19ed82c1dbf837604a13cd625a3bebf100" exitCode=255 Sep 08 10:09:06.577772 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.577726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-rpj69" event={"ID":"f9be1eec-3fb6-4544-9cf7-a78f8de71871","Type":"ContainerDied","Data":"18c4700d61c0afe2f531a1681d22db19ed82c1dbf837604a13cd625a3bebf100"} Sep 08 10:09:06.577996 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.577983 2577 scope.go:117] "RemoveContainer" containerID="18c4700d61c0afe2f531a1681d22db19ed82c1dbf837604a13cd625a3bebf100" Sep 08 10:09:06.746427 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.746339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.746566 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.746434 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:09:06.746566 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:06.746497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:06.746675 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.746583 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:07.74656201 +0000 UTC m=+149.151424441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : configmap "kube-rbac-proxy" not found Sep 08 10:09:06.746675 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.746610 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:09:06.746817 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:06.746699 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:07.746679542 +0000 UTC m=+149.151541990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : secret "insights-runtime-extractor-tls" not found Sep 08 10:09:07.582981 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.582944 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" event={"ID":"836e790a-95ff-469d-aa16-af7cf1e11907","Type":"ContainerStarted","Data":"4a0a236cf2764c85ef47062042ca31724fda1c60c20a4ab2c05c7f49b77f0bb7"} Sep 08 10:09:07.584519 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.584497 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:09:07.584913 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.584891 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/0.log" Sep 08 10:09:07.585001 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.584926 2577 generic.go:356] "Generic (PLEG): container finished" podID="f9be1eec-3fb6-4544-9cf7-a78f8de71871" containerID="f5050273f9a7e2362bf849c9a8fcbd6eb6cadbb8cb5c67557f9557060a9b5700" exitCode=255 Sep 08 10:09:07.585001 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.584954 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-rpj69" event={"ID":"f9be1eec-3fb6-4544-9cf7-a78f8de71871","Type":"ContainerDied","Data":"f5050273f9a7e2362bf849c9a8fcbd6eb6cadbb8cb5c67557f9557060a9b5700"} Sep 08 10:09:07.585070 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.585009 2577 scope.go:117] "RemoveContainer" containerID="18c4700d61c0afe2f531a1681d22db19ed82c1dbf837604a13cd625a3bebf100" Sep 08 10:09:07.585219 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.585198 2577 scope.go:117] "RemoveContainer" containerID="f5050273f9a7e2362bf849c9a8fcbd6eb6cadbb8cb5c67557f9557060a9b5700" Sep 08 10:09:07.585403 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:07.585384 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-rpj69_openshift-console-operator(f9be1eec-3fb6-4544-9cf7-a78f8de71871)\"" pod="openshift-console-operator/console-operator-85b454874b-rpj69" podUID="f9be1eec-3fb6-4544-9cf7-a78f8de71871" Sep 08 10:09:07.602894 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.602854 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" podStartSLOduration=2.456125266 podStartE2EDuration="6.602840822s" totalImagesPullingTime="4.146715556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:07.6018179 +0000 UTC m=+149.006680349" watchObservedRunningTime="2026-09-08 10:09:07.602840822 +0000 UTC m=+149.007703269" Sep 08 10:09:07.705465 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.705412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jczk_0564785d-36fe-474e-9eae-82d5797ed588/dns-node-resolver/0.log" Sep 08 10:09:07.753830 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.753789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:07.753992 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:07.753838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:07.753992 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:07.753962 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:09:07.754101 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:07.753985 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:09:07.754101 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:07.754031 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:09.754011914 +0000 UTC m=+151.158874339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : configmap "kube-rbac-proxy" not found Sep 08 10:09:07.754208 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:07.754125 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:09.75410775 +0000 UTC m=+151.158970178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : secret "insights-runtime-extractor-tls" not found Sep 08 10:09:08.065909 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.065871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:08.161821 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.161789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:08.589290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.589264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:09:08.589653 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.589572 2577 scope.go:117] "RemoveContainer" containerID="f5050273f9a7e2362bf849c9a8fcbd6eb6cadbb8cb5c67557f9557060a9b5700" Sep 08 10:09:08.589742 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:08.589710 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-rpj69_openshift-console-operator(f9be1eec-3fb6-4544-9cf7-a78f8de71871)\"" pod="openshift-console-operator/console-operator-85b454874b-rpj69" podUID="f9be1eec-3fb6-4544-9cf7-a78f8de71871" Sep 08 10:09:08.617271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.617251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:08.790997 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.790957 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:08.971716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:08.971634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:09.105670 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.105645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tthb7_0d777bb5-e556-438f-8ae3-634f4f0e6879/node-ca/0.log" Sep 08 10:09:09.267530 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.267488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:09.267698 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:09.267630 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:09.267698 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:09.267691 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls podName:67d455ed-3301-4c43-b6b7-3f6c573b1174 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:17.267676358 +0000 UTC m=+158.672538788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vcg9d" (UID: "67d455ed-3301-4c43-b6b7-3f6c573b1174") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:09.506113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.506079 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8p2w_98c2ff34-89c0-4e96-b722-92660a639e28/serve-healthcheck-canary/0.log" Sep 08 10:09:09.757252 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.757222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:09.772326 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.772301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:09.772393 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.772332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:09.772439 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:09.772424 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:09:09.772473 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:09.772438 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:09:09.772506 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:09.772489 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:13.77247273 +0000 UTC m=+155.177335179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : secret "insights-runtime-extractor-tls" not found Sep 08 10:09:09.772506 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:09.772503 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:13.772495967 +0000 UTC m=+155.177358392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : configmap "kube-rbac-proxy" not found Sep 08 10:09:09.858143 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:09.858077 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:11.027979 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:11.027944 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:11.144068 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:11.144035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:11.913992 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:11.913950 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:11.914196 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:11.914017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:11.914394 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:11.914378 2577 scope.go:117] "RemoveContainer" containerID="f5050273f9a7e2362bf849c9a8fcbd6eb6cadbb8cb5c67557f9557060a9b5700" Sep 08 10:09:11.914576 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:11.914555 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-rpj69_openshift-console-operator(f9be1eec-3fb6-4544-9cf7-a78f8de71871)\"" pod="openshift-console-operator/console-operator-85b454874b-rpj69" podUID="f9be1eec-3fb6-4544-9cf7-a78f8de71871" Sep 08 10:09:12.440680 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:12.440649 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:13.005379 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.005342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:13.250793 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.250765 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:13.414429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.414357 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:13.597983 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.597951 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:13.731494 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.731467 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:13.807823 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.807788 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:13.807910 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:13.807827 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:13.807944 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:13.807910 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:09:13.807944 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:13.807931 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:09:13.808009 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:13.807983 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:21.807970752 +0000 UTC m=+163.212833191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : secret "insights-runtime-extractor-tls" not found Sep 08 10:09:13.808009 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:13.807998 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:21.80799041 +0000 UTC m=+163.212852835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : configmap "kube-rbac-proxy" not found Sep 08 10:09:14.704544 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:14.704508 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:15.450087 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:15.450051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:15.576919 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:15.576885 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:15.675598 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:15.675565 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:16.491176 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:16.491134 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:16.887051 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:16.886955 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:16.986944 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:16.986913 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:17.059942 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:17.059899 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" podUID="1d76450c-2824-4337-9bf8-11dc16b10c2f" Sep 08 10:09:17.069053 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:17.069021 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rj6lj" podUID="9400831b-d835-4eb6-9ce2-be6c3b0a1bf3" Sep 08 10:09:17.336241 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:17.336202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:17.336417 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:17.336362 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:17.336459 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:17.336439 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls podName:67d455ed-3301-4c43-b6b7-3f6c573b1174 nodeName:}" failed. No retries permitted until 2026-09-08 10:09:33.336424253 +0000 UTC m=+174.741286677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-vcg9d" (UID: "67d455ed-3301-4c43-b6b7-3f6c573b1174") : secret "cluster-monitoring-operator-tls" not found Sep 08 10:09:17.615654 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:17.615573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rj6lj" Sep 08 10:09:17.994687 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:17.994651 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:18.059256 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:18.059205 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8s9q4" podUID="f888f945-1538-4b99-9cc4-fc69c518a469" Sep 08 10:09:18.097895 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:18.097861 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:18.468563 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:18.468473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:19.097226 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:19.097189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:19.223905 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:19.223866 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:19.380202 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:19.380120 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:20.447757 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:20.447693 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:20.549614 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:20.549581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:20.673661 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:20.673629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:21.874649 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:21.874616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:21.874649 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:21.874652 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:21.875151 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:21.874774 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:09:21.875151 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:09:21.874827 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls podName:62dd1c11-c544-4e51-9cb9-44e5a413837d nodeName:}" failed. No retries permitted until 2026-09-08 10:09:37.874814622 +0000 UTC m=+179.279677060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frtg9" (UID: "62dd1c11-c544-4e51-9cb9-44e5a413837d") : secret "insights-runtime-extractor-tls" not found Sep 08 10:09:21.875234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:21.875155 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62dd1c11-c544-4e51-9cb9-44e5a413837d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:21.975993 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:21.975960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:09:21.978444 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:21.978420 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"image-registry-68cdf78ffc-wdptn\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:09:22.076932 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:22.076895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:09:22.079323 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:22.079303 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9400831b-d835-4eb6-9ce2-be6c3b0a1bf3-metrics-tls\") pod \"dns-default-rj6lj\" (UID: \"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3\") " pod="openshift-dns/dns-default-rj6lj" Sep 08 10:09:22.119033 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:22.119008 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8hl6\"" Sep 08 10:09:22.127182 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:22.127139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rj6lj" Sep 08 10:09:22.417754 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:22.417663 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rj6lj"] Sep 08 10:09:22.421062 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:22.421035 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9400831b_d835_4eb6_9ce2_be6c3b0a1bf3.slice/crio-2508b0736e771124ed7764bedab58cc11540b4d7edcd09ee9d1508a168f8a082 WatchSource:0}: Error finding container 2508b0736e771124ed7764bedab58cc11540b4d7edcd09ee9d1508a168f8a082: Status 404 returned error can't find the container with id 2508b0736e771124ed7764bedab58cc11540b4d7edcd09ee9d1508a168f8a082 Sep 08 10:09:22.630713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:22.630678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rj6lj" event={"ID":"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3","Type":"ContainerStarted","Data":"2508b0736e771124ed7764bedab58cc11540b4d7edcd09ee9d1508a168f8a082"} Sep 08 10:09:23.817516 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:23.817467 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:23.922537 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:23.922498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:24.043170 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:24.043141 2577 scope.go:117] "RemoveContainer" containerID="f5050273f9a7e2362bf849c9a8fcbd6eb6cadbb8cb5c67557f9557060a9b5700" Sep 08 10:09:24.639554 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:24.639525 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:09:24.639766 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:24.639575 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-rpj69" event={"ID":"f9be1eec-3fb6-4544-9cf7-a78f8de71871","Type":"ContainerStarted","Data":"71bb87bc8d562e98b3f9901fce8da71cf8f64703a6307f863aaa44a7092c4059"} Sep 08 10:09:24.639991 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:24.639934 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:24.657011 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:24.656957 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-rpj69" podStartSLOduration=19.46437981 podStartE2EDuration="23.656937209s" totalImagesPullingTime="4.192557399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:24.656044236 +0000 UTC m=+166.060906695" watchObservedRunningTime="2026-09-08 10:09:24.656937209 +0000 UTC m=+166.061799660" Sep 08 10:09:24.809234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:24.809154 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:25.640318 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.640276 2577 patch_prober.go:28] interesting pod/console-operator-85b454874b-rpj69 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 08 10:09:25.640841 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.640341 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-rpj69" podUID="f9be1eec-3fb6-4544-9cf7-a78f8de71871" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 08 10:09:25.646689 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.646660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rj6lj" event={"ID":"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3","Type":"ContainerStarted","Data":"0e534464acf286a3b17b921eaed816f00bd4709857f9fe1240e8969597d4d2ea"} Sep 08 10:09:25.646927 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.646754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rj6lj" event={"ID":"9400831b-d835-4eb6-9ce2-be6c3b0a1bf3","Type":"ContainerStarted","Data":"75f61fac2f4b4f839bea4e9b833fdc159122a638b824645d410fe0e227790252"} Sep 08 10:09:25.647025 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.647002 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rj6lj" Sep 08 10:09:25.665591 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.665492 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rj6lj" podStartSLOduration=129.940190709 podStartE2EDuration="2m12.665477422s" totalImagesPullingTime="2.725286713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:25.664518564 +0000 UTC m=+167.069381007" watchObservedRunningTime="2026-09-08 10:09:25.665477422 +0000 UTC m=+167.070339886" Sep 08 10:09:25.916048 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:25.915971 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-rpj69" Sep 08 10:09:26.120112 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:26.120064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:26.222272 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:26.222166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:26.320497 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:26.320464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:26.420323 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:26.420273 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:26.779268 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:26.779237 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:26.880437 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:26.880404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:28.012906 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:28.012876 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:28.085629 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:28.085600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:30.042670 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:30.042624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:09:31.046036 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.045967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:09:31.048500 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.048480 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ssdtn\"" Sep 08 10:09:31.056496 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.056476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:09:31.123720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.123694 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:31.329706 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.329621 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cdf78ffc-wdptn"] Sep 08 10:09:31.332273 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:31.332244 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d76450c_2824_4337_9bf8_11dc16b10c2f.slice/crio-f4993ccb6677be355b749960a80e2eb749a3eebbf83eca3ca5eeca1d66878b64 WatchSource:0}: Error finding container f4993ccb6677be355b749960a80e2eb749a3eebbf83eca3ca5eeca1d66878b64: Status 404 returned error can't find the container with id f4993ccb6677be355b749960a80e2eb749a3eebbf83eca3ca5eeca1d66878b64 Sep 08 10:09:31.669046 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.668963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" event={"ID":"1d76450c-2824-4337-9bf8-11dc16b10c2f","Type":"ContainerStarted","Data":"550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5"} Sep 08 10:09:31.669046 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.669007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" event={"ID":"1d76450c-2824-4337-9bf8-11dc16b10c2f","Type":"ContainerStarted","Data":"f4993ccb6677be355b749960a80e2eb749a3eebbf83eca3ca5eeca1d66878b64"} Sep 08 10:09:31.669240 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.669097 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:09:31.690271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:31.690221 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" podStartSLOduration=171.690205842 podStartE2EDuration="2m51.690205842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:31.689049342 +0000 UTC m=+173.093911803" watchObservedRunningTime="2026-09-08 10:09:31.690205842 +0000 UTC m=+173.095068303" Sep 08 10:09:33.373330 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:33.373285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:33.375891 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:33.375867 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67d455ed-3301-4c43-b6b7-3f6c573b1174-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-vcg9d\" (UID: \"67d455ed-3301-4c43-b6b7-3f6c573b1174\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:33.617368 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:33.617313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" Sep 08 10:09:33.888586 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:33.888505 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d"] Sep 08 10:09:33.891350 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:33.891322 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d455ed_3301_4c43_b6b7_3f6c573b1174.slice/crio-2029ab9a4189e38678cbcb3c6eafbd0ddaa1cc48c4d36522fccbee562b316eaa WatchSource:0}: Error finding container 2029ab9a4189e38678cbcb3c6eafbd0ddaa1cc48c4d36522fccbee562b316eaa: Status 404 returned error can't find the container with id 2029ab9a4189e38678cbcb3c6eafbd0ddaa1cc48c4d36522fccbee562b316eaa Sep 08 10:09:34.008429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:34.008398 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:34.678620 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:34.678585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" event={"ID":"67d455ed-3301-4c43-b6b7-3f6c573b1174","Type":"ContainerStarted","Data":"2029ab9a4189e38678cbcb3c6eafbd0ddaa1cc48c4d36522fccbee562b316eaa"} Sep 08 10:09:35.606146 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:35.606107 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:35.652492 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:35.652458 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rj6lj" Sep 08 10:09:35.678191 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:35.678162 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:36.145451 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:36.145415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:36.244227 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:36.244196 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:36.343717 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:36.343686 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:36.685852 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:36.685814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" event={"ID":"67d455ed-3301-4c43-b6b7-3f6c573b1174","Type":"ContainerStarted","Data":"238dbbf51e23648824c4804062759dcddb5dda03d6ff6b0e7c13b64ad5585c4d"} Sep 08 10:09:36.712751 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:36.712676 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-vcg9d" podStartSLOduration=33.80909837 podStartE2EDuration="35.712660561s" totalImagesPullingTime="1.903562191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:36.71109475 +0000 UTC m=+178.115957196" watchObservedRunningTime="2026-09-08 10:09:36.712660561 +0000 UTC m=+178.117523008" Sep 08 10:09:37.493345 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:37.493306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:37.567717 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:37.567685 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:37.830796 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:37.830682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:37.908817 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:37.908774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:37.911282 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:37.911251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62dd1c11-c544-4e51-9cb9-44e5a413837d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frtg9\" (UID: \"62dd1c11-c544-4e51-9cb9-44e5a413837d\") " pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:37.931187 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:37.931159 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:38.080271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:38.080239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frtg9" Sep 08 10:09:38.358303 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:38.358230 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frtg9"] Sep 08 10:09:38.360962 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:38.360932 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62dd1c11_c544_4e51_9cb9_44e5a413837d.slice/crio-1a81ae5d3109be112701ae9781c80895c544b7f3786b50d2ea529b98d3a861f6 WatchSource:0}: Error finding container 1a81ae5d3109be112701ae9781c80895c544b7f3786b50d2ea529b98d3a861f6: Status 404 returned error can't find the container with id 1a81ae5d3109be112701ae9781c80895c544b7f3786b50d2ea529b98d3a861f6 Sep 08 10:09:38.693645 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:38.693555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frtg9" event={"ID":"62dd1c11-c544-4e51-9cb9-44e5a413837d","Type":"ContainerStarted","Data":"c1d56d34e8ab790d4090d1e78f99062a74f440302dea924ce7c7a3239d78f90a"} Sep 08 10:09:38.693645 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:38.693611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frtg9" event={"ID":"62dd1c11-c544-4e51-9cb9-44e5a413837d","Type":"ContainerStarted","Data":"1a81ae5d3109be112701ae9781c80895c544b7f3786b50d2ea529b98d3a861f6"} Sep 08 10:09:39.385366 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:39.385337 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:39.466848 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:39.466817 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:39.702289 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:39.702208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frtg9" event={"ID":"62dd1c11-c544-4e51-9cb9-44e5a413837d","Type":"ContainerStarted","Data":"6fa8b9df873de2eb094a6d77f5d8f07cae20081c41357794a83618a2f3d8ef31"} Sep 08 10:09:39.793702 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:39.793666 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:40.215110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.215077 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bf66bc975-4rgmx"] Sep 08 10:09:40.218163 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.218144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.222604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.222585 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 10:09:40.222947 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.222919 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 10:09:40.223029 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.222964 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 10:09:40.223029 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.222993 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 10:09:40.223456 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.223434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 10:09:40.223538 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.223456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfcqc\"" Sep 08 10:09:40.223690 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.223672 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 10:09:40.223832 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.223706 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 10:09:40.226643 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.226626 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 10:09:40.234940 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.234922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf66bc975-4rgmx"] Sep 08 10:09:40.242258 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.242239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:40.329935 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.329901 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-service-ca\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.329935 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.329937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-trusted-ca-bundle\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.330135 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.329957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjcx\" (UniqueName: \"kubernetes.io/projected/4d645889-867d-4293-bdf1-735661ca32e9-kube-api-access-rkjcx\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.330135 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.330002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-oauth-serving-cert\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.330135 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.330037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-serving-cert\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.330135 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.330056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-console-config\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.330135 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.330090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-oauth-config\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431020 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.430981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-service-ca\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431020 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-trusted-ca-bundle\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjcx\" (UniqueName: \"kubernetes.io/projected/4d645889-867d-4293-bdf1-735661ca32e9-kube-api-access-rkjcx\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-oauth-serving-cert\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431237 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-serving-cert\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431367 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-console-config\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431367 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-oauth-config\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431825 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431800 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-service-ca\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.431977 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.431945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-oauth-serving-cert\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.432192 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.432028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-trusted-ca-bundle\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.432266 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.432243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-console-config\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.433924 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.433898 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-serving-cert\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.433924 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.433917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-oauth-config\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.439882 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.439863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjcx\" (UniqueName: \"kubernetes.io/projected/4d645889-867d-4293-bdf1-735661ca32e9-kube-api-access-rkjcx\") pod \"console-5bf66bc975-4rgmx\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.527898 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.527847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:40.801742 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:40.801643 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf66bc975-4rgmx"] Sep 08 10:09:40.805549 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:40.805518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d645889_867d_4293_bdf1_735661ca32e9.slice/crio-7af59de0e1d21e3ab58c1c015d35d2072d0caad864ade23ca5a2e2836191f0a1 WatchSource:0}: Error finding container 7af59de0e1d21e3ab58c1c015d35d2072d0caad864ade23ca5a2e2836191f0a1: Status 404 returned error can't find the container with id 7af59de0e1d21e3ab58c1c015d35d2072d0caad864ade23ca5a2e2836191f0a1 Sep 08 10:09:41.708977 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:41.708940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf66bc975-4rgmx" event={"ID":"4d645889-867d-4293-bdf1-735661ca32e9","Type":"ContainerStarted","Data":"7af59de0e1d21e3ab58c1c015d35d2072d0caad864ade23ca5a2e2836191f0a1"} Sep 08 10:09:43.328695 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:43.328655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:43.384372 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:43.384335 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:43.797971 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:43.797940 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:44.463648 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.463605 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:44.566126 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.566045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:44.690621 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.690581 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:44.722820 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.722761 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frtg9" event={"ID":"62dd1c11-c544-4e51-9cb9-44e5a413837d","Type":"ContainerStarted","Data":"1c3e2785632cf0fdb89adaebd8ff70ed3760849b482a6755b63d681f0ea77f2c"} Sep 08 10:09:44.724366 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.724344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf66bc975-4rgmx" event={"ID":"4d645889-867d-4293-bdf1-735661ca32e9","Type":"ContainerStarted","Data":"7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927"} Sep 08 10:09:44.743950 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.743910 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-frtg9" podStartSLOduration=33.930459296 podStartE2EDuration="39.74389813s" totalImagesPullingTime="5.813438834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:09:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:44.743398009 +0000 UTC m=+186.148260456" watchObservedRunningTime="2026-09-08 10:09:44.74389813 +0000 UTC m=+186.148760602" Sep 08 10:09:44.763241 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.763183 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bf66bc975-4rgmx" podStartSLOduration=1.2547269650000001 podStartE2EDuration="4.763168534s" totalImagesPullingTime="3.508441569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:44.762453781 +0000 UTC m=+186.167316227" watchObservedRunningTime="2026-09-08 10:09:44.763168534 +0000 UTC m=+186.168030997" Sep 08 10:09:44.771923 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:44.771900 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:45.571473 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.571437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:45.666275 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.666238 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:45.776021 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.775981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:45.913718 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.913632 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:45.917820 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.917795 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k8xbz"] Sep 08 10:09:45.921053 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.921036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:45.923862 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.923842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hz64k\"" Sep 08 10:09:45.923957 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.923893 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 10:09:45.924464 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.924447 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 10:09:45.924608 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.924593 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 10:09:45.925536 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:45.925516 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 10:09:46.032664 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.032626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:46.076028 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.075994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7deac37b-9ae5-4f66-8268-ea6250f10864-metrics-client-ca\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdrlj\" (UniqueName: \"kubernetes.io/projected/7deac37b-9ae5-4f66-8268-ea6250f10864-kube-api-access-mdrlj\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-wtmp\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-root\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-sys\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-tls\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076461 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-textfile\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.076461 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.076296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-accelerators-collector-config\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.127506 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.127476 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:46.176837 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-wtmp\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.176837 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-root\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.176837 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-root\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-sys\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-tls\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-textfile\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-sys\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.176962 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-wtmp\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.177099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-accelerators-collector-config\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.177130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7deac37b-9ae5-4f66-8268-ea6250f10864-metrics-client-ca\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.177152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdrlj\" (UniqueName: \"kubernetes.io/projected/7deac37b-9ae5-4f66-8268-ea6250f10864-kube-api-access-mdrlj\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.177285 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-textfile\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.177632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-accelerators-collector-config\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.177925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.177709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7deac37b-9ae5-4f66-8268-ea6250f10864-metrics-client-ca\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.179420 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.179393 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-tls\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.179544 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.179493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7deac37b-9ae5-4f66-8268-ea6250f10864-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.185034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.185015 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdrlj\" (UniqueName: \"kubernetes.io/projected/7deac37b-9ae5-4f66-8268-ea6250f10864-kube-api-access-mdrlj\") pod \"node-exporter-k8xbz\" (UID: \"7deac37b-9ae5-4f66-8268-ea6250f10864\") " pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.227651 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.227617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:46.230604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.230584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k8xbz" Sep 08 10:09:46.242744 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:46.242705 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7deac37b_9ae5_4f66_8268_ea6250f10864.slice/crio-b664ebfb81c52f87a31d8a5e677f77a1115f18fb4d19eb8a1a9bbe7589183957 WatchSource:0}: Error finding container b664ebfb81c52f87a31d8a5e677f77a1115f18fb4d19eb8a1a9bbe7589183957: Status 404 returned error can't find the container with id b664ebfb81c52f87a31d8a5e677f77a1115f18fb4d19eb8a1a9bbe7589183957 Sep 08 10:09:46.732877 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:46.732843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k8xbz" event={"ID":"7deac37b-9ae5-4f66-8268-ea6250f10864","Type":"ContainerStarted","Data":"b664ebfb81c52f87a31d8a5e677f77a1115f18fb4d19eb8a1a9bbe7589183957"} Sep 08 10:09:47.413428 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.413391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:47.516047 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.516015 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:47.945508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.945476 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq"] Sep 08 10:09:47.949990 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.949972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:47.952592 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.952559 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 08 10:09:47.952721 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.952628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 08 10:09:47.953156 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.953137 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 08 10:09:47.953228 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.953176 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 08 10:09:47.953228 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.953211 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 08 10:09:47.953909 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.953895 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-emqnkgmck6p85\"" Sep 08 10:09:47.958110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.958094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7tcv5\"" Sep 08 10:09:47.973600 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:47.973513 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq"] Sep 08 10:09:48.092474 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-grpc-tls\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092622 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092622 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092622 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jxgq\" (UniqueName: \"kubernetes.io/projected/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-kube-api-access-2jxgq\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092622 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092776 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-metrics-client-ca\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.092848 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.092785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194087 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194087 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-grpc-tls\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194304 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194304 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194370 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jxgq\" (UniqueName: \"kubernetes.io/projected/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-kube-api-access-2jxgq\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194370 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194458 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.194616 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.194574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-metrics-client-ca\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.195650 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.195588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-metrics-client-ca\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.197072 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.197045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-tls\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.197181 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.197129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.197227 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.197208 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.197434 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.197412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.197500 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.197479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.197537 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.197509 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-secret-grpc-tls\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.202567 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.202542 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jxgq\" (UniqueName: \"kubernetes.io/projected/d2992574-ce43-4e6f-a6e5-4b5bb0fbede8-kube-api-access-2jxgq\") pod \"thanos-querier-7bb8dbf8c4-zfnlq\" (UID: \"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8\") " pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.259590 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.259556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:48.546157 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.546129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq"] Sep 08 10:09:48.548914 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:48.548884 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2992574_ce43_4e6f_a6e5_4b5bb0fbede8.slice/crio-ac99e15c1f831738c25fee9c22ba9a7f41ae5622ed04aa5ce4688546817661cf WatchSource:0}: Error finding container ac99e15c1f831738c25fee9c22ba9a7f41ae5622ed04aa5ce4688546817661cf: Status 404 returned error can't find the container with id ac99e15c1f831738c25fee9c22ba9a7f41ae5622ed04aa5ce4688546817661cf Sep 08 10:09:48.636547 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.636505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:48.741513 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.741462 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:48.741697 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.741669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"ac99e15c1f831738c25fee9c22ba9a7f41ae5622ed04aa5ce4688546817661cf"} Sep 08 10:09:48.839488 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.839406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:48.940368 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:48.940332 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:49.040601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:49.040574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:49.451101 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:49.451059 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:49.746079 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:49.746045 2577 generic.go:356] "Generic (PLEG): container finished" podID="7deac37b-9ae5-4f66-8268-ea6250f10864" containerID="1c78d61b961ab52b34e3b87aef1eef2f5070f19acb08efa9d1dba65b465f3ce9" exitCode=0 Sep 08 10:09:49.746231 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:49.746091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k8xbz" event={"ID":"7deac37b-9ae5-4f66-8268-ea6250f10864","Type":"ContainerDied","Data":"1c78d61b961ab52b34e3b87aef1eef2f5070f19acb08efa9d1dba65b465f3ce9"} Sep 08 10:09:50.345345 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.345306 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5784dcb644-gbnwz"] Sep 08 10:09:50.348673 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.348649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.351043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.350997 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 10:09:50.351624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.351606 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a0eaftm4ac64a\"" Sep 08 10:09:50.351775 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.351746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 10:09:50.351775 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.351766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 10:09:50.351919 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.351862 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8prd9\"" Sep 08 10:09:50.352027 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.352007 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 10:09:50.360427 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.360406 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5784dcb644-gbnwz"] Sep 08 10:09:50.515616 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-secret-metrics-server-client-certs\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.515616 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93fe7e4e-b8dc-458a-b72e-fe142ff22245-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.515886 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-client-ca-bundle\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.515886 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-secret-metrics-server-tls\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.515886 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rszfc\" (UniqueName: \"kubernetes.io/projected/93fe7e4e-b8dc-458a-b72e-fe142ff22245-kube-api-access-rszfc\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.516034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93fe7e4e-b8dc-458a-b72e-fe142ff22245-metrics-server-audit-profiles\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.516034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.515961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93fe7e4e-b8dc-458a-b72e-fe142ff22245-audit-log\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.528532 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.528495 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:50.528654 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.528568 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:50.533070 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.533049 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:50.559429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.559398 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:50.565523 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.565492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt"] Sep 08 10:09:50.568667 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.568644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.570938 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.570914 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 08 10:09:50.571047 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.570976 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sxckp\"" Sep 08 10:09:50.578620 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.578563 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt"] Sep 08 10:09:50.616958 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.616878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93fe7e4e-b8dc-458a-b72e-fe142ff22245-audit-log\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.616958 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.616951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-secret-metrics-server-client-certs\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.617204 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.617078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93fe7e4e-b8dc-458a-b72e-fe142ff22245-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.617204 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.617127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-client-ca-bundle\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.617759 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.617655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/93fe7e4e-b8dc-458a-b72e-fe142ff22245-audit-log\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.618036 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.617917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-secret-metrics-server-tls\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.618142 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.618075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rszfc\" (UniqueName: \"kubernetes.io/projected/93fe7e4e-b8dc-458a-b72e-fe142ff22245-kube-api-access-rszfc\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.618142 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.618118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93fe7e4e-b8dc-458a-b72e-fe142ff22245-metrics-server-audit-profiles\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.620319 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.619515 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/93fe7e4e-b8dc-458a-b72e-fe142ff22245-metrics-server-audit-profiles\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.620658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.620565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-secret-metrics-server-client-certs\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.623324 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.621068 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-client-ca-bundle\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.623324 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.621115 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/93fe7e4e-b8dc-458a-b72e-fe142ff22245-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.623807 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.623785 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/93fe7e4e-b8dc-458a-b72e-fe142ff22245-secret-metrics-server-tls\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.628027 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.627984 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rszfc\" (UniqueName: \"kubernetes.io/projected/93fe7e4e-b8dc-458a-b72e-fe142ff22245-kube-api-access-rszfc\") pod \"metrics-server-5784dcb644-gbnwz\" (UID: \"93fe7e4e-b8dc-458a-b72e-fe142ff22245\") " pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.658612 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.658547 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:50.659453 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.659429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:09:50.719295 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.719243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43d811e9-a765-495d-ad2e-94c190d8e817-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-4srrt\" (UID: \"43d811e9-a765-495d-ad2e-94c190d8e817\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.719458 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.719313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thflm\" (UniqueName: \"kubernetes.io/projected/43d811e9-a765-495d-ad2e-94c190d8e817-kube-api-access-thflm\") pod \"monitoring-plugin-85bbbbbf4-4srrt\" (UID: \"43d811e9-a765-495d-ad2e-94c190d8e817\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.752014 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.751984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k8xbz" event={"ID":"7deac37b-9ae5-4f66-8268-ea6250f10864","Type":"ContainerStarted","Data":"3cbb1bc8d74be06e554d2b4f6f590233bfd47ca9401f8823fa381ee2394d901d"} Sep 08 10:09:50.752191 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.752073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k8xbz" event={"ID":"7deac37b-9ae5-4f66-8268-ea6250f10864","Type":"ContainerStarted","Data":"86aab272a361c65cce766165f6967699c1104aa71bba5e5b8d498f8cce4c3c1b"} Sep 08 10:09:50.757319 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.757287 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:09:50.770941 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.770888 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k8xbz" podStartSLOduration=3.088993128 podStartE2EDuration="5.770873849s" totalImagesPullingTime="2.612609439s" totalInitContainerRuntime="69.271282ms" isStatefulPod=true podCreationTimestamp="2026-09-08 10:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:50.769762166 +0000 UTC m=+192.174624664" watchObservedRunningTime="2026-09-08 10:09:50.770873849 +0000 UTC m=+192.175736296" Sep 08 10:09:50.820176 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.820140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43d811e9-a765-495d-ad2e-94c190d8e817-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-4srrt\" (UID: \"43d811e9-a765-495d-ad2e-94c190d8e817\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.820358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.820205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thflm\" (UniqueName: \"kubernetes.io/projected/43d811e9-a765-495d-ad2e-94c190d8e817-kube-api-access-thflm\") pod \"monitoring-plugin-85bbbbbf4-4srrt\" (UID: \"43d811e9-a765-495d-ad2e-94c190d8e817\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.823038 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.823014 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43d811e9-a765-495d-ad2e-94c190d8e817-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-4srrt\" (UID: \"43d811e9-a765-495d-ad2e-94c190d8e817\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.832548 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.832518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thflm\" (UniqueName: \"kubernetes.io/projected/43d811e9-a765-495d-ad2e-94c190d8e817-kube-api-access-thflm\") pod \"monitoring-plugin-85bbbbbf4-4srrt\" (UID: \"43d811e9-a765-495d-ad2e-94c190d8e817\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.879596 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.879517 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:50.977086 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:50.977053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:51.110175 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.110100 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7954d4b98d-k6lzn"] Sep 08 10:09:51.114047 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.114017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.116313 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.116276 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 08 10:09:51.116673 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.116551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 08 10:09:51.117282 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.117251 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 08 10:09:51.117912 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.117477 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 08 10:09:51.117912 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.117758 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lhp7c\"" Sep 08 10:09:51.118088 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.117963 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 08 10:09:51.122549 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.122528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 08 10:09:51.129249 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.128712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7954d4b98d-k6lzn"] Sep 08 10:09:51.223991 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.223965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224011 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-telemeter-client-tls\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-serving-certs-ca-bundle\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84d9l\" (UniqueName: \"kubernetes.io/projected/c6098c37-7102-4f9a-9eec-bd4b4d36c710-kube-api-access-84d9l\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224084 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-federate-client-tls\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-secret-telemeter-client\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-metrics-client-ca\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.224428 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.224144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325254 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-federate-client-tls\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325317 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-secret-telemeter-client\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325317 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-metrics-client-ca\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325420 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325420 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325420 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-telemeter-client-tls\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325574 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-serving-certs-ca-bundle\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.325574 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.325477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84d9l\" (UniqueName: \"kubernetes.io/projected/c6098c37-7102-4f9a-9eec-bd4b4d36c710-kube-api-access-84d9l\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.326350 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.326299 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-metrics-client-ca\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.326530 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.326476 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.326530 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.326515 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6098c37-7102-4f9a-9eec-bd4b4d36c710-serving-certs-ca-bundle\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.329633 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.329294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-secret-telemeter-client\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.329633 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.329595 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-telemeter-client-tls\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.330425 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.330365 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-federate-client-tls\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.331056 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.331017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6098c37-7102-4f9a-9eec-bd4b4d36c710-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.334184 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.334164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84d9l\" (UniqueName: \"kubernetes.io/projected/c6098c37-7102-4f9a-9eec-bd4b4d36c710-kube-api-access-84d9l\") pod \"telemeter-client-7954d4b98d-k6lzn\" (UID: \"c6098c37-7102-4f9a-9eec-bd4b4d36c710\") " pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.418524 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.418439 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5784dcb644-gbnwz"] Sep 08 10:09:51.421088 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.421063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt"] Sep 08 10:09:51.421895 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:51.421880 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93fe7e4e_b8dc_458a_b72e_fe142ff22245.slice/crio-5d24706a4666d07c1d0cda80741e7b3fdaf475a4f8cbfcd9f1b325ece710a3e9 WatchSource:0}: Error finding container 5d24706a4666d07c1d0cda80741e7b3fdaf475a4f8cbfcd9f1b325ece710a3e9: Status 404 returned error can't find the container with id 5d24706a4666d07c1d0cda80741e7b3fdaf475a4f8cbfcd9f1b325ece710a3e9 Sep 08 10:09:51.423839 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:51.423767 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d811e9_a765_495d_ad2e_94c190d8e817.slice/crio-0da59f5564119d347e5ebba10af67c574b6a0125ded02132895a6a82630b870e WatchSource:0}: Error finding container 0da59f5564119d347e5ebba10af67c574b6a0125ded02132895a6a82630b870e: Status 404 returned error can't find the container with id 0da59f5564119d347e5ebba10af67c574b6a0125ded02132895a6a82630b870e Sep 08 10:09:51.429551 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.429534 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" Sep 08 10:09:51.707205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.707131 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7954d4b98d-k6lzn"] Sep 08 10:09:51.710563 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:09:51.710534 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6098c37_7102_4f9a_9eec_bd4b4d36c710.slice/crio-c3f90db74be0ece7d06a6023a6f49203ecf19552c1ec621e46c00e4252cff1f3 WatchSource:0}: Error finding container c3f90db74be0ece7d06a6023a6f49203ecf19552c1ec621e46c00e4252cff1f3: Status 404 returned error can't find the container with id c3f90db74be0ece7d06a6023a6f49203ecf19552c1ec621e46c00e4252cff1f3 Sep 08 10:09:51.757141 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.757108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"f888856559b328c5a490af879630a7ab4b407a47e8bdf9d8318654318809976c"} Sep 08 10:09:51.757313 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.757189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"dfa81fa238873ff8ab7c2eaf5be0acb3b9a2d3d2552bb8402a958a76e6ad6242"} Sep 08 10:09:51.757313 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.757230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"eb5e28a9aa0ca4ae98aa62e2d18d5217dee56a90abf000e9316afebc69570726"} Sep 08 10:09:51.758271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.758233 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" event={"ID":"93fe7e4e-b8dc-458a-b72e-fe142ff22245","Type":"ContainerStarted","Data":"5d24706a4666d07c1d0cda80741e7b3fdaf475a4f8cbfcd9f1b325ece710a3e9"} Sep 08 10:09:51.759261 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.759241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" event={"ID":"c6098c37-7102-4f9a-9eec-bd4b4d36c710","Type":"ContainerStarted","Data":"c3f90db74be0ece7d06a6023a6f49203ecf19552c1ec621e46c00e4252cff1f3"} Sep 08 10:09:51.760340 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:51.760320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" event={"ID":"43d811e9-a765-495d-ad2e-94c190d8e817","Type":"ContainerStarted","Data":"0da59f5564119d347e5ebba10af67c574b6a0125ded02132895a6a82630b870e"} Sep 08 10:09:52.678690 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:52.678655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:09:52.774402 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:52.772004 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"845ff52b6d2059f1bba18de8087ebdfdb8e1cb71ed5205d410777881f8b0a8ea"} Sep 08 10:09:52.774402 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:52.772095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"e7dce592dddd3d3af7e336896e3540eeab23373f260d65bb2b2acc238c38795f"} Sep 08 10:09:52.774402 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:52.772142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" event={"ID":"d2992574-ce43-4e6f-a6e5-4b5bb0fbede8","Type":"ContainerStarted","Data":"636af929f2ebd54d07d83fc70314d3ababad74a780d176423092b07212473eb8"} Sep 08 10:09:52.774402 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:52.772409 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:54.783382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.783284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" event={"ID":"93fe7e4e-b8dc-458a-b72e-fe142ff22245","Type":"ContainerStarted","Data":"a4bd2c3897f051e9db73e7e748dc4f60231de6dc2891807588a0a80ce8decb92"} Sep 08 10:09:54.785240 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.785212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" event={"ID":"c6098c37-7102-4f9a-9eec-bd4b4d36c710","Type":"ContainerStarted","Data":"e332762d6032e470c4ea1a95cee837da8b5682337644e3bcbbcb5205313228d2"} Sep 08 10:09:54.786852 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.786826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" event={"ID":"43d811e9-a765-495d-ad2e-94c190d8e817","Type":"ContainerStarted","Data":"10cbaca56ce76e8c679e85bcce3f686ae587a7e838bc8e7331c32f15bd79bf68"} Sep 08 10:09:54.787060 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.787042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:54.792704 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.792682 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" Sep 08 10:09:54.803353 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.803298 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" podStartSLOduration=2.299179035 podStartE2EDuration="4.803271002s" totalImagesPullingTime="2.504091967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:54.803106821 +0000 UTC m=+196.207969268" watchObservedRunningTime="2026-09-08 10:09:54.803271002 +0000 UTC m=+196.208133452" Sep 08 10:09:54.804375 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.804336 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" podStartSLOduration=4.348069882 podStartE2EDuration="7.804325933s" totalImagesPullingTime="3.456256051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:52.796077393 +0000 UTC m=+194.200939842" watchObservedRunningTime="2026-09-08 10:09:54.804325933 +0000 UTC m=+196.209188425" Sep 08 10:09:54.819093 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.819050 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-4srrt" podStartSLOduration=2.312722004 podStartE2EDuration="4.819033003s" totalImagesPullingTime="2.506310999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:54.81776767 +0000 UTC m=+196.222630118" watchObservedRunningTime="2026-09-08 10:09:54.819033003 +0000 UTC m=+196.223895451" Sep 08 10:09:54.992621 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:54.992577 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:55.058343 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:55.058260 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:55.792471 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:55.792431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" event={"ID":"c6098c37-7102-4f9a-9eec-bd4b4d36c710","Type":"ContainerStarted","Data":"dd3cffa376d1b377e3a03180192a57be6a02e9f2a670d0204c2058d4040679e3"} Sep 08 10:09:55.792980 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:55.792508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" event={"ID":"c6098c37-7102-4f9a-9eec-bd4b4d36c710","Type":"ContainerStarted","Data":"4e2622a867dcbc89a26090b1f0675b40ea9a60c4afee2caecac75806b8fe284e"} Sep 08 10:09:55.813491 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:55.813446 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7954d4b98d-k6lzn" podStartSLOduration=1.439812896 podStartE2EDuration="4.813433818s" totalImagesPullingTime="3.373620922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:09:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:55.813175399 +0000 UTC m=+197.218037846" watchObservedRunningTime="2026-09-08 10:09:55.813433818 +0000 UTC m=+197.218296265" Sep 08 10:09:58.783188 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:58.783158 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7bb8dbf8c4-zfnlq" Sep 08 10:09:59.171599 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:59.171512 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68cdf78ffc-wdptn"] Sep 08 10:09:59.327949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:59.327915 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:59.451922 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:59.451833 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:09:59.548522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:09:59.548484 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:00.210364 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:00.210328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:00.311777 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:00.311727 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:00.648267 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:00.648227 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:00.756386 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:00.756352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:05.645750 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:05.645687 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:05.710723 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:05.710684 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:06.237312 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:06.237275 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:06.340924 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:06.340888 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:06.987351 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:06.987314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:07.082441 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:07.082410 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:10.660165 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:10.660127 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:10:10.660519 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:10.660228 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:10:11.176664 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:11.176629 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bf66bc975-4rgmx"] Sep 08 10:10:11.331518 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:11.331483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:11.432365 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:11.432279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:11.535641 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:11.535601 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:19.150114 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:19.150079 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:21.969484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:21.969444 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" podUID="836e790a-95ff-469d-aa16-af7cf1e11907" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 10:10:21.975521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:21.975482 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:22.074505 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:22.074474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:24.191958 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.191917 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" podUID="1d76450c-2824-4337-9bf8-11dc16b10c2f" containerName="registry" containerID="cri-o://550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5" gracePeriod=30 Sep 08 10:10:24.435798 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.435774 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:10:24.513002 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.512974 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513198 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513015 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-certificates\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513198 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513068 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-image-registry-private-configuration\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513198 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513090 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d76450c-2824-4337-9bf8-11dc16b10c2f-ca-trust-extracted\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513198 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513129 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-bound-sa-token\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513198 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513160 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-trusted-ca\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513198 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513190 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl6vw\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-kube-api-access-xl6vw\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513426 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513221 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-installation-pull-secrets\") pod \"1d76450c-2824-4337-9bf8-11dc16b10c2f\" (UID: \"1d76450c-2824-4337-9bf8-11dc16b10c2f\") " Sep 08 10:10:24.513603 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.513541 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:10:24.514083 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.514057 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:10:24.515894 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.515861 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:10:24.516001 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.515946 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:10:24.516121 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.516089 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:10:24.516203 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.516138 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:10:24.516242 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.516209 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-kube-api-access-xl6vw" (OuterVolumeSpecName: "kube-api-access-xl6vw") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "kube-api-access-xl6vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:10:24.521395 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.521367 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d76450c-2824-4337-9bf8-11dc16b10c2f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1d76450c-2824-4337-9bf8-11dc16b10c2f" (UID: "1d76450c-2824-4337-9bf8-11dc16b10c2f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:10:24.614755 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614682 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-image-registry-private-configuration\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.614755 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614727 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d76450c-2824-4337-9bf8-11dc16b10c2f-ca-trust-extracted\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.614755 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614762 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-bound-sa-token\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.614755 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614771 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-trusted-ca\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.615013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614779 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl6vw\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-kube-api-access-xl6vw\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.615013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614788 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d76450c-2824-4337-9bf8-11dc16b10c2f-installation-pull-secrets\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.615013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614796 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.615013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.614804 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d76450c-2824-4337-9bf8-11dc16b10c2f-registry-certificates\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:24.899539 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.899447 2577 generic.go:356] "Generic (PLEG): container finished" podID="1d76450c-2824-4337-9bf8-11dc16b10c2f" containerID="550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5" exitCode=0 Sep 08 10:10:24.899539 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.899492 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" Sep 08 10:10:24.899761 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.899536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" event={"ID":"1d76450c-2824-4337-9bf8-11dc16b10c2f","Type":"ContainerDied","Data":"550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5"} Sep 08 10:10:24.899761 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.899588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cdf78ffc-wdptn" event={"ID":"1d76450c-2824-4337-9bf8-11dc16b10c2f","Type":"ContainerDied","Data":"f4993ccb6677be355b749960a80e2eb749a3eebbf83eca3ca5eeca1d66878b64"} Sep 08 10:10:24.899761 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.899608 2577 scope.go:117] "RemoveContainer" containerID="550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5" Sep 08 10:10:24.908052 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.908030 2577 scope.go:117] "RemoveContainer" containerID="550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5" Sep 08 10:10:24.908321 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:10:24.908301 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5\": container with ID starting with 550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5 not found: ID does not exist" containerID="550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5" Sep 08 10:10:24.908368 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.908328 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5"} err="failed to get container status \"550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5\": rpc error: code = NotFound desc = could not find container \"550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5\": container with ID starting with 550efef41496ea0d4f38025b12c54253b5b4134476365e84bd4397606aff85e5 not found: ID does not exist" Sep 08 10:10:24.924631 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.924602 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68cdf78ffc-wdptn"] Sep 08 10:10:24.932512 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:24.932487 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68cdf78ffc-wdptn"] Sep 08 10:10:25.047833 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:25.047804 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d76450c-2824-4337-9bf8-11dc16b10c2f" path="/var/lib/kubelet/pods/1d76450c-2824-4337-9bf8-11dc16b10c2f/volumes" Sep 08 10:10:30.664694 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:30.664662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:10:30.668686 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:30.668662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5784dcb644-gbnwz" Sep 08 10:10:31.969559 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:31.969523 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" podUID="836e790a-95ff-469d-aa16-af7cf1e11907" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 10:10:36.198007 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.197964 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bf66bc975-4rgmx" podUID="4d645889-867d-4293-bdf1-735661ca32e9" containerName="console" containerID="cri-o://7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927" gracePeriod=15 Sep 08 10:10:36.436526 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.436503 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:10:36.618842 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.618804 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkjcx\" (UniqueName: \"kubernetes.io/projected/4d645889-867d-4293-bdf1-735661ca32e9-kube-api-access-rkjcx\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.618851 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-oauth-serving-cert\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.618896 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-serving-cert\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.618913 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-oauth-config\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.618968 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-service-ca\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.618991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-trusted-ca-bundle\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619273 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.619017 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-console-config\") pod \"4d645889-867d-4293-bdf1-735661ca32e9\" (UID: \"4d645889-867d-4293-bdf1-735661ca32e9\") " Sep 08 10:10:36.619428 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.619399 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:10:36.619545 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.619425 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:10:36.619545 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.619456 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-console-config" (OuterVolumeSpecName: "console-config") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:10:36.619860 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.619708 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:10:36.621274 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.621246 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d645889-867d-4293-bdf1-735661ca32e9-kube-api-access-rkjcx" (OuterVolumeSpecName: "kube-api-access-rkjcx") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "kube-api-access-rkjcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:10:36.621355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.621270 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:10:36.621355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.621288 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d645889-867d-4293-bdf1-735661ca32e9" (UID: "4d645889-867d-4293-bdf1-735661ca32e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:10:36.719994 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.719937 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-oauth-serving-cert\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.719994 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.719985 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-serving-cert\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.719994 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.719999 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d645889-867d-4293-bdf1-735661ca32e9-console-oauth-config\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.719994 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.720012 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-service-ca\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.720260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.720024 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-trusted-ca-bundle\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.720260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.720035 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d645889-867d-4293-bdf1-735661ca32e9-console-config\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.720260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.720046 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkjcx\" (UniqueName: \"kubernetes.io/projected/4d645889-867d-4293-bdf1-735661ca32e9-kube-api-access-rkjcx\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:10:36.946449 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.946356 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d645889-867d-4293-bdf1-735661ca32e9" containerID="7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927" exitCode=0 Sep 08 10:10:36.946449 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.946399 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf66bc975-4rgmx" Sep 08 10:10:36.946449 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.946440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf66bc975-4rgmx" event={"ID":"4d645889-867d-4293-bdf1-735661ca32e9","Type":"ContainerDied","Data":"7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927"} Sep 08 10:10:36.946687 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.946492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf66bc975-4rgmx" event={"ID":"4d645889-867d-4293-bdf1-735661ca32e9","Type":"ContainerDied","Data":"7af59de0e1d21e3ab58c1c015d35d2072d0caad864ade23ca5a2e2836191f0a1"} Sep 08 10:10:36.946687 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.946512 2577 scope.go:117] "RemoveContainer" containerID="7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927" Sep 08 10:10:36.955718 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.955698 2577 scope.go:117] "RemoveContainer" containerID="7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927" Sep 08 10:10:36.956040 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:10:36.956022 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927\": container with ID starting with 7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927 not found: ID does not exist" containerID="7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927" Sep 08 10:10:36.956096 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.956046 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927"} err="failed to get container status \"7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927\": rpc error: code = NotFound desc = could not find container \"7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927\": container with ID starting with 7c173ccf17a9046a32ae16d24c76c008a8436ac4f92d5884648a9d82420b7927 not found: ID does not exist" Sep 08 10:10:36.969859 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.969831 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bf66bc975-4rgmx"] Sep 08 10:10:36.974219 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.974192 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bf66bc975-4rgmx"] Sep 08 10:10:36.981392 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:36.981369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:37.047117 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:37.047081 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d645889-867d-4293-bdf1-735661ca32e9" path="/var/lib/kubelet/pods/4d645889-867d-4293-bdf1-735661ca32e9/volumes" Sep 08 10:10:37.073616 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:37.073589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:41.969574 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:41.969523 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" podUID="836e790a-95ff-469d-aa16-af7cf1e11907" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 10:10:41.970051 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:41.969600 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" Sep 08 10:10:41.970215 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:41.970191 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4a0a236cf2764c85ef47062042ca31724fda1c60c20a4ab2c05c7f49b77f0bb7"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 08 10:10:41.970276 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:41.970243 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" podUID="836e790a-95ff-469d-aa16-af7cf1e11907" containerName="service-proxy" containerID="cri-o://4a0a236cf2764c85ef47062042ca31724fda1c60c20a4ab2c05c7f49b77f0bb7" gracePeriod=30 Sep 08 10:10:42.976758 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:42.976701 2577 generic.go:356] "Generic (PLEG): container finished" podID="836e790a-95ff-469d-aa16-af7cf1e11907" containerID="4a0a236cf2764c85ef47062042ca31724fda1c60c20a4ab2c05c7f49b77f0bb7" exitCode=2 Sep 08 10:10:42.977196 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:42.976774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" event={"ID":"836e790a-95ff-469d-aa16-af7cf1e11907","Type":"ContainerDied","Data":"4a0a236cf2764c85ef47062042ca31724fda1c60c20a4ab2c05c7f49b77f0bb7"} Sep 08 10:10:42.977196 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:42.976824 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ddd7cc76-vzwgh" event={"ID":"836e790a-95ff-469d-aa16-af7cf1e11907","Type":"ContainerStarted","Data":"c050a87ddab6e7477fd31f1fe7e8479d634cf0f93fb9161f667826f2205918cb"} Sep 08 10:10:50.932100 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:50.932051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:10:50.934521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:50.934497 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f888f945-1538-4b99-9cc4-fc69c518a469-metrics-certs\") pod \"network-metrics-daemon-8s9q4\" (UID: \"f888f945-1538-4b99-9cc4-fc69c518a469\") " pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:10:51.046327 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:51.046290 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm4jr\"" Sep 08 10:10:51.054455 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:51.054434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8s9q4" Sep 08 10:10:51.328541 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:51.328520 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8s9q4"] Sep 08 10:10:51.331108 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:10:51.331080 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf888f945_1538_4b99_9cc4_fc69c518a469.slice/crio-3ae7eeabc530cf2d0d92ad611761aa9acfee5e170808662a05277b4d9d668728 WatchSource:0}: Error finding container 3ae7eeabc530cf2d0d92ad611761aa9acfee5e170808662a05277b4d9d668728: Status 404 returned error can't find the container with id 3ae7eeabc530cf2d0d92ad611761aa9acfee5e170808662a05277b4d9d668728 Sep 08 10:10:52.007181 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:52.007143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8s9q4" event={"ID":"f888f945-1538-4b99-9cc4-fc69c518a469","Type":"ContainerStarted","Data":"3ae7eeabc530cf2d0d92ad611761aa9acfee5e170808662a05277b4d9d668728"} Sep 08 10:10:54.018519 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:54.018479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8s9q4" event={"ID":"f888f945-1538-4b99-9cc4-fc69c518a469","Type":"ContainerStarted","Data":"8ab778ea3fdf24a19d1c24e38ef2b27483f158d0368081a2400cbf71e154fd76"} Sep 08 10:10:54.019016 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:54.018547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8s9q4" event={"ID":"f888f945-1538-4b99-9cc4-fc69c518a469","Type":"ContainerStarted","Data":"5d91c65dbe33cc5ff7970fc86900383730a0411c3c64645604b43cb4ab0ab26b"} Sep 08 10:10:54.038273 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:54.038224 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8s9q4" podStartSLOduration=252.409817134 podStartE2EDuration="4m14.038208047s" totalImagesPullingTime="1.628390913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:10:54.037094165 +0000 UTC m=+255.441956613" watchObservedRunningTime="2026-09-08 10:10:54.038208047 +0000 UTC m=+255.443070493" Sep 08 10:10:54.164482 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:54.164446 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:10:54.259678 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:10:54.259644 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:05.110869 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:05.110831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:05.203061 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:05.203014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:09.629813 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:09.629779 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:09.771500 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:09.771464 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:11.582308 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:11.582262 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:11.927510 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:11.927427 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:14.218518 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:14.218469 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:14.502224 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:14.502193 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:21.994907 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:21.994864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:22.103666 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:22.103630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:22.399827 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:22.399743 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:22.724840 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:22.724756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:22.844567 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:22.844532 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:38.960214 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:38.960185 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:11:38.961197 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:38.961174 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:11:38.971239 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:38.971218 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 10:11:57.328603 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:57.328568 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:11:57.396857 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:11:57.396827 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:13:09.629086 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:13:09.629051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:13:45.659478 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:13:45.659438 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:13:45.759460 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:13:45.759423 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:13:46.513605 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:13:46.513566 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:25.700011 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:25.699974 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:25.805092 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:25.805054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:26.304083 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:26.304050 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:26.400310 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:26.400279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:26.669155 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:26.669023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:26.772454 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:26.772419 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:29.304657 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:29.304620 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:29.375252 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:29.375215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:39.218262 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218220 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c57f87c7f-hj6j5"] Sep 08 10:14:39.218707 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218594 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d645889-867d-4293-bdf1-735661ca32e9" containerName="console" Sep 08 10:14:39.218707 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218611 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d645889-867d-4293-bdf1-735661ca32e9" containerName="console" Sep 08 10:14:39.218707 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218636 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d76450c-2824-4337-9bf8-11dc16b10c2f" containerName="registry" Sep 08 10:14:39.218707 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218644 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d76450c-2824-4337-9bf8-11dc16b10c2f" containerName="registry" Sep 08 10:14:39.218961 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218711 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d76450c-2824-4337-9bf8-11dc16b10c2f" containerName="registry" Sep 08 10:14:39.218961 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.218724 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d645889-867d-4293-bdf1-735661ca32e9" containerName="console" Sep 08 10:14:39.221702 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.221678 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.225090 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.225069 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 10:14:39.225201 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.225134 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 10:14:39.225201 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.225076 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfcqc\"" Sep 08 10:14:39.225709 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.225689 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 10:14:39.225803 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.225710 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 10:14:39.225803 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.225763 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 10:14:39.226792 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.226641 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 10:14:39.226928 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.226784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 10:14:39.230357 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.230339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 10:14:39.235610 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.235588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c57f87c7f-hj6j5"] Sep 08 10:14:39.266896 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.266862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-trusted-ca-bundle\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.267032 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.266906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-oauth-config\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.267032 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.266979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmb58\" (UniqueName: \"kubernetes.io/projected/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-kube-api-access-zmb58\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.267032 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.266996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-service-ca\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.267032 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.267027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-config\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.267161 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.267044 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-serving-cert\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.267161 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.267064 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-oauth-serving-cert\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.279592 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.279559 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:39.367785 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmb58\" (UniqueName: \"kubernetes.io/projected/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-kube-api-access-zmb58\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.367962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-service-ca\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.367962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-config\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.367962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-serving-cert\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.367962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-oauth-serving-cert\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.367962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-trusted-ca-bundle\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.367962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.367945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-oauth-config\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.368590 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.368558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-config\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.368711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.368559 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-service-ca\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.368711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.368652 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-oauth-serving-cert\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.368834 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.368814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-trusted-ca-bundle\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.370534 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.370507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-oauth-config\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.370611 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.370568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-console-serving-cert\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.376144 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.376124 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmb58\" (UniqueName: \"kubernetes.io/projected/591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7-kube-api-access-zmb58\") pod \"console-5c57f87c7f-hj6j5\" (UID: \"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7\") " pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.531891 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.531853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:39.804562 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:39.804483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c57f87c7f-hj6j5"] Sep 08 10:14:39.807516 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:14:39.807488 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591d8ec0_4b3e_45ae_aa67_f671ec3f7cb7.slice/crio-71aec071ba4264e1e95c2e9fd4e654ee253b5436cf3cf750b5eff13514bd3eec WatchSource:0}: Error finding container 71aec071ba4264e1e95c2e9fd4e654ee253b5436cf3cf750b5eff13514bd3eec: Status 404 returned error can't find the container with id 71aec071ba4264e1e95c2e9fd4e654ee253b5436cf3cf750b5eff13514bd3eec Sep 08 10:14:40.814499 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:40.814462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c57f87c7f-hj6j5" event={"ID":"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7","Type":"ContainerStarted","Data":"0f87cc3f48748fa54a6b35baab2bdef213963ce2e6309946b3de66fb63a34558"} Sep 08 10:14:40.814893 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:40.814514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c57f87c7f-hj6j5" event={"ID":"591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7","Type":"ContainerStarted","Data":"71aec071ba4264e1e95c2e9fd4e654ee253b5436cf3cf750b5eff13514bd3eec"} Sep 08 10:14:40.838808 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:40.838748 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c57f87c7f-hj6j5" podStartSLOduration=1.838711129 podStartE2EDuration="1.838711129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:40.838330009 +0000 UTC m=+482.243192456" watchObservedRunningTime="2026-09-08 10:14:40.838711129 +0000 UTC m=+482.243573566" Sep 08 10:14:41.009859 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:41.009832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:49.532807 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:49.532757 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:49.533203 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:49.532824 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:49.537527 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:49.537504 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:49.851708 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:49.851635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c57f87c7f-hj6j5" Sep 08 10:14:50.010301 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:50.010247 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:50.064391 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:50.064362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:14:50.120157 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:14:50.120067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:15:15.810395 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:15:15.810351 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:15:22.340148 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:15:22.340096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:16:16.701673 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:16:16.701634 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:16:18.953592 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:16:18.953551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:16:22.248931 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:16:22.248893 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:16:38.989371 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:16:38.989339 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:16:38.989829 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:16:38.989593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:16:39.005361 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:16:39.005331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:41.740666 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:41.740625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:41.843179 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:41.843149 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:42.203454 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:42.203372 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:42.297554 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:42.297519 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:42.399115 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:42.399081 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:42.466393 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:42.466304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:42.717769 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:42.717673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:50.272251 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:17:50.272206 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:28.577248 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:18:28.577212 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:28.726002 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:19:28.725960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:32.257013 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:19:32.256976 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:32.358437 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:19:32.358391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:34.048290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:19:34.048255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:11.252715 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:11.252677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:12.358530 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.358499 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-n7rcf"] Sep 08 10:20:12.361700 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.361680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:20:12.364010 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.363980 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 10:20:12.364118 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.364016 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 10:20:12.364118 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.364085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-qlgmz\"" Sep 08 10:20:12.372645 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.372612 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n7rcf"] Sep 08 10:20:12.482609 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.482568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpjp2\" (UniqueName: \"kubernetes.io/projected/3c2bb450-718c-4c16-963b-8782588e04f0-kube-api-access-vpjp2\") pod \"redis-69bbd798b6-n7rcf\" (UID: \"3c2bb450-718c-4c16-963b-8782588e04f0\") " pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:20:12.583593 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.583552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpjp2\" (UniqueName: \"kubernetes.io/projected/3c2bb450-718c-4c16-963b-8782588e04f0-kube-api-access-vpjp2\") pod \"redis-69bbd798b6-n7rcf\" (UID: \"3c2bb450-718c-4c16-963b-8782588e04f0\") " pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:20:12.593634 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.593604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpjp2\" (UniqueName: \"kubernetes.io/projected/3c2bb450-718c-4c16-963b-8782588e04f0-kube-api-access-vpjp2\") pod \"redis-69bbd798b6-n7rcf\" (UID: \"3c2bb450-718c-4c16-963b-8782588e04f0\") " pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:20:12.670288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.670205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:20:12.950214 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.950127 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n7rcf"] Sep 08 10:20:12.953437 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:20:12.953399 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c2bb450_718c_4c16_963b_8782588e04f0.slice/crio-534e656606e91e5ec69cc628d0daf2252412e9b2d5c255c40596daf6438b9d80 WatchSource:0}: Error finding container 534e656606e91e5ec69cc628d0daf2252412e9b2d5c255c40596daf6438b9d80: Status 404 returned error can't find the container with id 534e656606e91e5ec69cc628d0daf2252412e9b2d5c255c40596daf6438b9d80 Sep 08 10:20:12.955406 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:12.955392 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:20:13.015998 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:13.015963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n7rcf" event={"ID":"3c2bb450-718c-4c16-963b-8782588e04f0","Type":"ContainerStarted","Data":"534e656606e91e5ec69cc628d0daf2252412e9b2d5c255c40596daf6438b9d80"} Sep 08 10:20:14.923935 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:14.923901 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:18.037342 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:18.037307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n7rcf" event={"ID":"3c2bb450-718c-4c16-963b-8782588e04f0","Type":"ContainerStarted","Data":"4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a"} Sep 08 10:20:18.052123 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:18.052078 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-n7rcf" podStartSLOduration=1.545301964 podStartE2EDuration="6.052063973s" totalImagesPullingTime="4.506762009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:20:18.050810358 +0000 UTC m=+819.455672818" watchObservedRunningTime="2026-09-08 10:20:18.052063973 +0000 UTC m=+819.456926420" Sep 08 10:20:23.115620 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:23.115589 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:23.219474 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:23.219435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:23.408468 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:23.408384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:23.508858 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:23.508820 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:23.609498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:23.609466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:47.913639 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:47.913602 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:49.994245 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:49.994206 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-x9l5n"] Sep 08 10:20:49.999384 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:49.999358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:20:50.001912 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.001891 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 08 10:20:50.002040 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.001892 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-trmrd\"" Sep 08 10:20:50.006870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.006848 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-x9l5n"] Sep 08 10:20:50.038975 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.038934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wht8\" (UniqueName: \"kubernetes.io/projected/c9b48399-2b33-4768-894b-8acd2e6ea30f-kube-api-access-2wht8\") pod \"feast-test-apply-x9l5n\" (UID: \"c9b48399-2b33-4768-894b-8acd2e6ea30f\") " pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:20:50.139634 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.139582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wht8\" (UniqueName: \"kubernetes.io/projected/c9b48399-2b33-4768-894b-8acd2e6ea30f-kube-api-access-2wht8\") pod \"feast-test-apply-x9l5n\" (UID: \"c9b48399-2b33-4768-894b-8acd2e6ea30f\") " pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:20:50.149572 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.149534 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wht8\" (UniqueName: \"kubernetes.io/projected/c9b48399-2b33-4768-894b-8acd2e6ea30f-kube-api-access-2wht8\") pod \"feast-test-apply-x9l5n\" (UID: \"c9b48399-2b33-4768-894b-8acd2e6ea30f\") " pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:20:50.308546 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.308466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:20:50.582348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:50.582273 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-x9l5n"] Sep 08 10:20:50.585464 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:20:50.585438 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9b48399_2b33_4768_894b_8acd2e6ea30f.slice/crio-f012b7a85b22d9496172163d6e4e3141274f3666fbf7a7d006a344c9ed8f94d2 WatchSource:0}: Error finding container f012b7a85b22d9496172163d6e4e3141274f3666fbf7a7d006a344c9ed8f94d2: Status 404 returned error can't find the container with id f012b7a85b22d9496172163d6e4e3141274f3666fbf7a7d006a344c9ed8f94d2 Sep 08 10:20:51.035274 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:51.035241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:51.162989 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:51.162955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-x9l5n" event={"ID":"c9b48399-2b33-4768-894b-8acd2e6ea30f","Type":"ContainerStarted","Data":"f012b7a85b22d9496172163d6e4e3141274f3666fbf7a7d006a344c9ed8f94d2"} Sep 08 10:20:56.185195 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:20:56.185155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-x9l5n" event={"ID":"c9b48399-2b33-4768-894b-8acd2e6ea30f","Type":"ContainerStarted","Data":"bdadcf2da775bec11c7b3685064e041942539ca73649afe4686b5279e8e58007"} Sep 08 10:21:03.212253 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:03.212218 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerID="bdadcf2da775bec11c7b3685064e041942539ca73649afe4686b5279e8e58007" exitCode=0 Sep 08 10:21:03.212663 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:03.212295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-x9l5n" event={"ID":"c9b48399-2b33-4768-894b-8acd2e6ea30f","Type":"ContainerDied","Data":"bdadcf2da775bec11c7b3685064e041942539ca73649afe4686b5279e8e58007"} Sep 08 10:21:04.217454 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:04.217415 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-x9l5n" event={"ID":"c9b48399-2b33-4768-894b-8acd2e6ea30f","Type":"ContainerStarted","Data":"c4f624253111ea074872c83d141b9dbe52015404e69ba4484f382a4c6207280f"} Sep 08 10:21:04.244313 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:04.244262 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-x9l5n" podStartSLOduration=3.644766418 podStartE2EDuration="15.244246757s" totalImagesPullingTime="5.034058757s" totalInitContainerRuntime="6.565421582s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:21:04.243026695 +0000 UTC m=+865.647889142" watchObservedRunningTime="2026-09-08 10:21:04.244246757 +0000 UTC m=+865.649109203" Sep 08 10:21:13.253206 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:13.253169 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerID="c4f624253111ea074872c83d141b9dbe52015404e69ba4484f382a4c6207280f" exitCode=0 Sep 08 10:21:13.253636 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:13.253239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-x9l5n" event={"ID":"c9b48399-2b33-4768-894b-8acd2e6ea30f","Type":"ContainerDied","Data":"c4f624253111ea074872c83d141b9dbe52015404e69ba4484f382a4c6207280f"} Sep 08 10:21:14.378681 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:14.378654 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:21:14.428591 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:14.428558 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wht8\" (UniqueName: \"kubernetes.io/projected/c9b48399-2b33-4768-894b-8acd2e6ea30f-kube-api-access-2wht8\") pod \"c9b48399-2b33-4768-894b-8acd2e6ea30f\" (UID: \"c9b48399-2b33-4768-894b-8acd2e6ea30f\") " Sep 08 10:21:14.430810 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:14.430788 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b48399-2b33-4768-894b-8acd2e6ea30f-kube-api-access-2wht8" (OuterVolumeSpecName: "kube-api-access-2wht8") pod "c9b48399-2b33-4768-894b-8acd2e6ea30f" (UID: "c9b48399-2b33-4768-894b-8acd2e6ea30f"). InnerVolumeSpecName "kube-api-access-2wht8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:21:14.529616 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:14.529535 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wht8\" (UniqueName: \"kubernetes.io/projected/c9b48399-2b33-4768-894b-8acd2e6ea30f-kube-api-access-2wht8\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:21:15.261716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:15.261688 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-x9l5n" Sep 08 10:21:15.261888 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:15.261697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-x9l5n" event={"ID":"c9b48399-2b33-4768-894b-8acd2e6ea30f","Type":"ContainerDied","Data":"f012b7a85b22d9496172163d6e4e3141274f3666fbf7a7d006a344c9ed8f94d2"} Sep 08 10:21:15.261888 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:15.261787 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f012b7a85b22d9496172163d6e4e3141274f3666fbf7a7d006a344c9ed8f94d2" Sep 08 10:21:15.443062 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:15.442995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-x9l5n_c9b48399-2b33-4768-894b-8acd2e6ea30f/feast-0/0.log" Sep 08 10:21:15.449242 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:15.449223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-x9l5n_c9b48399-2b33-4768-894b-8acd2e6ea30f/feast-1/0.log" Sep 08 10:21:39.017329 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:39.017298 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:21:39.019500 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:39.019480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:21:47.041180 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:47.041137 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:21:52.007983 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.007944 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-x9l5n"] Sep 08 10:21:52.018577 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.018550 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-x9l5n"] Sep 08 10:21:52.028438 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.028412 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n7rcf"] Sep 08 10:21:52.028590 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.028570 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-n7rcf" podUID="3c2bb450-718c-4c16-963b-8782588e04f0" containerName="redis" containerID="cri-o://4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a" gracePeriod=30 Sep 08 10:21:52.149622 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.149596 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:21:52.265091 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.265035 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:21:52.406807 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.406776 2577 generic.go:356] "Generic (PLEG): container finished" podID="3c2bb450-718c-4c16-963b-8782588e04f0" containerID="4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a" exitCode=0 Sep 08 10:21:52.406968 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.406819 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-n7rcf" Sep 08 10:21:52.406968 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.406846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n7rcf" event={"ID":"3c2bb450-718c-4c16-963b-8782588e04f0","Type":"ContainerDied","Data":"4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a"} Sep 08 10:21:52.406968 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.406876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-n7rcf" event={"ID":"3c2bb450-718c-4c16-963b-8782588e04f0","Type":"ContainerDied","Data":"534e656606e91e5ec69cc628d0daf2252412e9b2d5c255c40596daf6438b9d80"} Sep 08 10:21:52.406968 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.406892 2577 scope.go:117] "RemoveContainer" containerID="4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a" Sep 08 10:21:52.414785 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.414764 2577 scope.go:117] "RemoveContainer" containerID="4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a" Sep 08 10:21:52.415032 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:21:52.415015 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a\": container with ID starting with 4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a not found: ID does not exist" containerID="4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a" Sep 08 10:21:52.415100 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.415041 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a"} err="failed to get container status \"4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a\": rpc error: code = NotFound desc = could not find container \"4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a\": container with ID starting with 4e53b87418befc16a9f45586afbe572a3da645fef612e46ae481cf98c338ab0a not found: ID does not exist" Sep 08 10:21:52.425388 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.425368 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpjp2\" (UniqueName: \"kubernetes.io/projected/3c2bb450-718c-4c16-963b-8782588e04f0-kube-api-access-vpjp2\") pod \"3c2bb450-718c-4c16-963b-8782588e04f0\" (UID: \"3c2bb450-718c-4c16-963b-8782588e04f0\") " Sep 08 10:21:52.427383 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.427356 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2bb450-718c-4c16-963b-8782588e04f0-kube-api-access-vpjp2" (OuterVolumeSpecName: "kube-api-access-vpjp2") pod "3c2bb450-718c-4c16-963b-8782588e04f0" (UID: "3c2bb450-718c-4c16-963b-8782588e04f0"). InnerVolumeSpecName "kube-api-access-vpjp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:21:52.525978 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.525887 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpjp2\" (UniqueName: \"kubernetes.io/projected/3c2bb450-718c-4c16-963b-8782588e04f0-kube-api-access-vpjp2\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:21:52.726041 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.726005 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n7rcf"] Sep 08 10:21:52.732264 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:52.732241 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-n7rcf"] Sep 08 10:21:53.046873 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:53.046838 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c2bb450-718c-4c16-963b-8782588e04f0" path="/var/lib/kubelet/pods/3c2bb450-718c-4c16-963b-8782588e04f0/volumes" Sep 08 10:21:53.047228 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:21:53.047143 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b48399-2b33-4768-894b-8acd2e6ea30f" path="/var/lib/kubelet/pods/c9b48399-2b33-4768-894b-8acd2e6ea30f/volumes" Sep 08 10:22:29.659551 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:22:29.659513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:22:29.761022 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:22:29.760991 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:22:30.362916 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:22:30.362886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:22:30.487291 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:22:30.487253 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:40.773232 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:40.773143 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:40.828553 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:40.828520 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:40.950050 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:40.950016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:46.421811 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:46.421780 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:51.909868 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:51.909812 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:51.994413 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:51.994379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:52.075517 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:52.075473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:52.177847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:24:52.177768 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:13.656866 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:25:13.656822 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:17.850351 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:25:17.850304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:17.961474 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:25:17.961445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:18.031638 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:25:18.031606 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:26:23.009160 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:26:23.009122 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:26:39.041356 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:26:39.041317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:26:39.043811 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:26:39.043786 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:26:58.196962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:26:58.196929 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:00.250916 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:00.250871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:00.625543 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:00.625461 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:00.878093 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:00.877999 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:01.022806 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:01.022758 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:03.208719 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:03.208684 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:05.801359 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:05.801306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:05.906991 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:05.906957 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:11.513400 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:11.513359 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:11.890913 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:11.890824 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:12.220602 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.220522 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:12.231034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231003 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t"] Sep 08 10:27:12.231334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231316 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerName="feast-0" Sep 08 10:27:12.231415 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231337 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerName="feast-0" Sep 08 10:27:12.231415 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231350 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerName="feast-1" Sep 08 10:27:12.231415 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231358 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerName="feast-1" Sep 08 10:27:12.231415 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231372 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2bb450-718c-4c16-963b-8782588e04f0" containerName="redis" Sep 08 10:27:12.231415 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231381 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2bb450-718c-4c16-963b-8782588e04f0" containerName="redis" Sep 08 10:27:12.231640 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231475 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2bb450-718c-4c16-963b-8782588e04f0" containerName="redis" Sep 08 10:27:12.231640 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.231487 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b48399-2b33-4768-894b-8acd2e6ea30f" containerName="feast-1" Sep 08 10:27:12.234310 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.234292 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:12.236780 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.236756 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 10:27:12.236780 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.236776 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 10:27:12.236942 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.236826 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-ql88d\"" Sep 08 10:27:12.253165 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.253137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t"] Sep 08 10:27:12.316659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.316627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfsg\" (UniqueName: \"kubernetes.io/projected/910fe1a9-cd92-4938-9c3d-db536233e592-kube-api-access-2kfsg\") pod \"feast-operator-controller-manager-689b877b4b-xcd9t\" (UID: \"910fe1a9-cd92-4938-9c3d-db536233e592\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:12.417435 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.417398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfsg\" (UniqueName: \"kubernetes.io/projected/910fe1a9-cd92-4938-9c3d-db536233e592-kube-api-access-2kfsg\") pod \"feast-operator-controller-manager-689b877b4b-xcd9t\" (UID: \"910fe1a9-cd92-4938-9c3d-db536233e592\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:12.428086 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.428059 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfsg\" (UniqueName: \"kubernetes.io/projected/910fe1a9-cd92-4938-9c3d-db536233e592-kube-api-access-2kfsg\") pod \"feast-operator-controller-manager-689b877b4b-xcd9t\" (UID: \"910fe1a9-cd92-4938-9c3d-db536233e592\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:12.543890 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.543849 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:12.815958 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.815710 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t"] Sep 08 10:27:12.818882 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:27:12.818853 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910fe1a9_cd92_4938_9c3d_db536233e592.slice/crio-409011d24d9364db370d16b6b9e76f2d4420fc1466d7290a409ae47c22b1b07b WatchSource:0}: Error finding container 409011d24d9364db370d16b6b9e76f2d4420fc1466d7290a409ae47c22b1b07b: Status 404 returned error can't find the container with id 409011d24d9364db370d16b6b9e76f2d4420fc1466d7290a409ae47c22b1b07b Sep 08 10:27:12.821155 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:12.821137 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:27:13.586038 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:13.585996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" event={"ID":"910fe1a9-cd92-4938-9c3d-db536233e592","Type":"ContainerStarted","Data":"409011d24d9364db370d16b6b9e76f2d4420fc1466d7290a409ae47c22b1b07b"} Sep 08 10:27:14.592466 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:14.592425 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" event={"ID":"910fe1a9-cd92-4938-9c3d-db536233e592","Type":"ContainerStarted","Data":"1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060"} Sep 08 10:27:14.592887 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:14.592528 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:14.612535 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:14.612486 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" podStartSLOduration=1.025374216 podStartE2EDuration="2.61247283s" totalImagesPullingTime="1.587098614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:27:14.611505502 +0000 UTC m=+1236.016367951" watchObservedRunningTime="2026-09-08 10:27:14.61247283 +0000 UTC m=+1236.017335291" Sep 08 10:27:25.598656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:25.598623 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:27:26.466190 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:26.466157 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:26.567058 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:26.567021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:27.044651 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.044609 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:27.165606 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.165570 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg"] Sep 08 10:27:27.169239 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.169221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.171663 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.171639 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 10:27:27.172054 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.172031 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 10:27:27.172166 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.172107 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 10:27:27.172166 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.172149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-zxnhc\"" Sep 08 10:27:27.172345 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.172168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 10:27:27.173120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.173102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 10:27:27.173219 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.173203 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 10:27:27.187986 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.187953 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg"] Sep 08 10:27:27.242052 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.242004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv8ct\" (UniqueName: \"kubernetes.io/projected/a6e45ab0-11a2-49a7-af12-422d30b6c33e-kube-api-access-rv8ct\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.242220 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.242126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.242220 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.242199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.242359 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.242227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.242359 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.242247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.242359 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.242275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e45ab0-11a2-49a7-af12-422d30b6c33e-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.342791 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.342683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.342791 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.342756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.342791 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.342780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.342800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.342821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e45ab0-11a2-49a7-af12-422d30b6c33e-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.342859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv8ct\" (UniqueName: \"kubernetes.io/projected/a6e45ab0-11a2-49a7-af12-422d30b6c33e-kube-api-access-rv8ct\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:27:27.342908 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:27:27.342933 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:27:27.342979 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls podName:a6e45ab0-11a2-49a7-af12-422d30b6c33e nodeName:}" failed. No retries permitted until 2026-09-08 10:27:27.842956575 +0000 UTC m=+1249.247819003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls") pod "feast-simple-feast-setup-57576b8fcf-wm5wg" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:27:27.342909 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:27:27.343011 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls podName:a6e45ab0-11a2-49a7-af12-422d30b6c33e nodeName:}" failed. No retries permitted until 2026-09-08 10:27:27.842992917 +0000 UTC m=+1249.247855346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-wm5wg" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:27:27.343074 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:27:27.343064 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls podName:a6e45ab0-11a2-49a7-af12-422d30b6c33e nodeName:}" failed. No retries permitted until 2026-09-08 10:27:27.843045539 +0000 UTC m=+1249.247907967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-wm5wg" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:27:27.343369 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.343295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e45ab0-11a2-49a7-af12-422d30b6c33e-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.345295 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.345276 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.354311 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.354291 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv8ct\" (UniqueName: \"kubernetes.io/projected/a6e45ab0-11a2-49a7-af12-422d30b6c33e-kube-api-access-rv8ct\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.848362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.848321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.848362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.848372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.848362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.848402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.851099 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.851071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.851249 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.851072 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:27.851249 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:27.851158 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wm5wg\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:28.078446 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:28.078405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:28.357499 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:28.357472 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg"] Sep 08 10:27:28.359373 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:27:28.359337 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6e45ab0_11a2_49a7_af12_422d30b6c33e.slice/crio-8dfe424cc21f1ce99dba7eea10ff4a2dfcad8eafdd52e2cb698356bd3b42d86e WatchSource:0}: Error finding container 8dfe424cc21f1ce99dba7eea10ff4a2dfcad8eafdd52e2cb698356bd3b42d86e: Status 404 returned error can't find the container with id 8dfe424cc21f1ce99dba7eea10ff4a2dfcad8eafdd52e2cb698356bd3b42d86e Sep 08 10:27:28.628958 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:28.628924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:28.648926 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:28.646863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"8dfe424cc21f1ce99dba7eea10ff4a2dfcad8eafdd52e2cb698356bd3b42d86e"} Sep 08 10:27:28.729923 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:28.729889 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:39.064599 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:39.064517 2577 scope.go:117] "RemoveContainer" containerID="c4f624253111ea074872c83d141b9dbe52015404e69ba4484f382a4c6207280f" Sep 08 10:27:40.672675 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:40.672625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:40.773223 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:40.773180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:41.193478 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:41.193433 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:43.131407 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:43.131265 2577 scope.go:117] "RemoveContainer" containerID="bdadcf2da775bec11c7b3685064e041942539ca73649afe4686b5279e8e58007" Sep 08 10:27:43.718196 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:43.718155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"3caf1260d10db26d44e0bb6fcc4645a1956476ea0677296964e6210bdeab032a"} Sep 08 10:27:48.739136 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:48.739096 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerID="3caf1260d10db26d44e0bb6fcc4645a1956476ea0677296964e6210bdeab032a" exitCode=0 Sep 08 10:27:48.739563 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:48.739135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"3caf1260d10db26d44e0bb6fcc4645a1956476ea0677296964e6210bdeab032a"} Sep 08 10:27:49.745217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:49.745177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"047c3a34a441ba1fcf0f93d70962bcd71112d3f561e76199c2190f6f3d331d2f"} Sep 08 10:27:54.765599 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:54.765563 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerID="047c3a34a441ba1fcf0f93d70962bcd71112d3f561e76199c2190f6f3d331d2f" exitCode=0 Sep 08 10:27:54.765971 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:54.765610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"047c3a34a441ba1fcf0f93d70962bcd71112d3f561e76199c2190f6f3d331d2f"} Sep 08 10:27:55.775951 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:55.775906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"8847af11026972affd9bfe5bba25e559fc21c7e62705300daef1e40594b1f693"} Sep 08 10:27:55.776433 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:55.775975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"bdd11fd0f9a311635390e0cb3b96c71b0643e0478863e7f9fc4846df4ab51e4c"} Sep 08 10:27:55.776433 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:55.775997 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"e19ae6e9cafe5d02c8bde7d602d238ab72a25ada720b3c49f9408d17f2fc5635"} Sep 08 10:27:55.776433 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:55.776016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerStarted","Data":"10117727fccdbdc052d0b8fe4d8674467e754d67956dfcca37bd962c7674acd3"} Sep 08 10:27:55.801354 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:55.801288 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podStartSLOduration=13.950489093 podStartE2EDuration="28.801241234s" totalImagesPullingTime="14.850752141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:27:55.800765995 +0000 UTC m=+1277.205628445" watchObservedRunningTime="2026-09-08 10:27:55.801241234 +0000 UTC m=+1277.206103685" Sep 08 10:27:58.078789 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.078719 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.079299 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.078812 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.079299 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.078833 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.079299 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.078852 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.079299 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.078870 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.079821 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.079797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.079990 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.079976 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.080127 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.080105 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:27:58.080922 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.080816 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 08 10:27:58.080922 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.080852 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused" Sep 08 10:27:58.080922 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.080867 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 08 10:27:58.081160 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:27:58.080874 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Sep 08 10:28:01.079387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:01.079334 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 08 10:28:01.080016 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:01.079334 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Sep 08 10:28:01.080016 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:01.079340 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused" Sep 08 10:28:01.080016 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:01.079887 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 08 10:28:04.080059 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.079999 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.080510 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.080184 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.080510 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.080430 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.081028 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.081006 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.081119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.081064 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.081119 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.081096 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.085437 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.085419 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:28:04.826205 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:28:04.826166 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:29:07.590035 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:07.589996 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg"] Sep 08 10:29:07.590659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:07.590226 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="registry" containerID="cri-o://10117727fccdbdc052d0b8fe4d8674467e754d67956dfcca37bd962c7674acd3" gracePeriod=30 Sep 08 10:29:07.590659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:07.590333 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="offline" containerID="cri-o://bdd11fd0f9a311635390e0cb3b96c71b0643e0478863e7f9fc4846df4ab51e4c" gracePeriod=30 Sep 08 10:29:07.590659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:07.590358 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" containerID="cri-o://8847af11026972affd9bfe5bba25e559fc21c7e62705300daef1e40594b1f693" gracePeriod=30 Sep 08 10:29:07.590659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:07.590386 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" containerID="cri-o://e19ae6e9cafe5d02c8bde7d602d238ab72a25ada720b3c49f9408d17f2fc5635" gracePeriod=30 Sep 08 10:29:08.143248 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.143201 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462"] Sep 08 10:29:08.146660 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.146640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.149675 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.149645 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-cmmkg\"" Sep 08 10:29:08.164605 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.164572 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462"] Sep 08 10:29:08.197203 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.197161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.197381 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.197223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.197381 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.197324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.197381 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.197369 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np8zh\" (UniqueName: \"kubernetes.io/projected/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-kube-api-access-np8zh\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.197510 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.197446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.197510 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.197481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298209 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298209 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298441 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np8zh\" (UniqueName: \"kubernetes.io/projected/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-kube-api-access-np8zh\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298441 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298441 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298441 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:29:08.298353 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 10:29:08.298441 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.298441 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:29:08.298437 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls podName:4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b nodeName:}" failed. No retries permitted until 2026-09-08 10:29:08.798413764 +0000 UTC m=+1350.203276210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls") pod "feast-simple-feast-setup-57576b8fcf-f6462" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 10:29:08.298786 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:29:08.298636 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:29:08.298849 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:29:08.298785 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls podName:4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b nodeName:}" failed. No retries permitted until 2026-09-08 10:29:08.798722221 +0000 UTC m=+1350.203584662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-f6462" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:29:08.298966 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.298942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.300998 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.300971 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.301171 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.301148 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.306897 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.306868 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np8zh\" (UniqueName: \"kubernetes.io/projected/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-kube-api-access-np8zh\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.803663 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.803623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.804073 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.803708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.806211 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.806190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:08.806280 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:08.806256 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f6462\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:09.058102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:09.058020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:09.066577 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:09.066549 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerID="8847af11026972affd9bfe5bba25e559fc21c7e62705300daef1e40594b1f693" exitCode=0 Sep 08 10:29:09.066577 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:09.066573 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerID="e19ae6e9cafe5d02c8bde7d602d238ab72a25ada720b3c49f9408d17f2fc5635" exitCode=0 Sep 08 10:29:09.066792 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:09.066618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"8847af11026972affd9bfe5bba25e559fc21c7e62705300daef1e40594b1f693"} Sep 08 10:29:09.066792 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:09.066655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"e19ae6e9cafe5d02c8bde7d602d238ab72a25ada720b3c49f9408d17f2fc5635"} Sep 08 10:29:09.339819 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:09.339792 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462"] Sep 08 10:29:09.340321 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:29:09.340287 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e7b0d76_c91e_4ec4_98ab_761a4a4c5e7b.slice/crio-83b154c9e4ab81388278a38e512423120469ff53d37c46965ce53185f2dc1b6a WatchSource:0}: Error finding container 83b154c9e4ab81388278a38e512423120469ff53d37c46965ce53185f2dc1b6a: Status 404 returned error can't find the container with id 83b154c9e4ab81388278a38e512423120469ff53d37c46965ce53185f2dc1b6a Sep 08 10:29:10.073507 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:10.073474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"f3db4725d92bc46b6898c1cd0cb469a9177438a9571018dff5039dfeaea99897"} Sep 08 10:29:10.073991 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:10.073526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"83b154c9e4ab81388278a38e512423120469ff53d37c46965ce53185f2dc1b6a"} Sep 08 10:29:11.710583 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:11.710544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:11.811515 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:11.811477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:14.081884 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:14.081835 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 08 10:29:14.823297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:14.823245 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 08 10:29:15.096162 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:15.096081 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerID="f3db4725d92bc46b6898c1cd0cb469a9177438a9571018dff5039dfeaea99897" exitCode=0 Sep 08 10:29:15.096162 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:15.096141 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"f3db4725d92bc46b6898c1cd0cb469a9177438a9571018dff5039dfeaea99897"} Sep 08 10:29:16.101695 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:16.101662 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"aa98db4c35e08a556e47464f9330c9e455c8a4b97a9ff67835d04e9cfc3a91b1"} Sep 08 10:29:21.123406 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:21.123362 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerID="aa98db4c35e08a556e47464f9330c9e455c8a4b97a9ff67835d04e9cfc3a91b1" exitCode=0 Sep 08 10:29:21.123406 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:21.123407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"aa98db4c35e08a556e47464f9330c9e455c8a4b97a9ff67835d04e9cfc3a91b1"} Sep 08 10:29:22.133401 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:22.133361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"51b9962399e25ba32db8789ebb9b48383bf9b92b3c286578358fd2630177cefe"} Sep 08 10:29:22.133904 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:22.133422 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"97db65c52a05f6de72cbc6e45d91e76c9d56068907a1e902fcc25a665ea5b156"} Sep 08 10:29:22.133904 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:22.133442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"1370326c9c98a3f72dc174717b6649154caaab951bf717f309a9d3e98edbe39c"} Sep 08 10:29:22.133904 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:22.133459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerStarted","Data":"82fd85bddaef9b9250d96f2f4b743feb5702bd4f132e329998ac633eaa61e25d"} Sep 08 10:29:22.165218 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:22.165142 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podStartSLOduration=14.165112449 podStartE2EDuration="14.165112449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:29:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:29:22.16012228 +0000 UTC m=+1363.564984728" watchObservedRunningTime="2026-09-08 10:29:22.165112449 +0000 UTC m=+1363.569974901" Sep 08 10:29:24.059314 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.059278 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:24.059892 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.059860 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:24.059892 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.059896 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:24.060078 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.059915 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:24.061467 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.061433 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 08 10:29:24.061711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.061458 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused" Sep 08 10:29:24.061852 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.061476 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Sep 08 10:29:24.061852 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.061563 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 08 10:29:24.081280 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.081221 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 08 10:29:24.823842 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:24.823781 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 08 10:29:27.059348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:27.059254 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 08 10:29:27.059348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:27.059316 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused" Sep 08 10:29:27.059899 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:27.059313 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 08 10:29:27.059899 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:27.059316 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Sep 08 10:29:29.058926 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:29.058887 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:29.059288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:29.058953 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:29.059288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:29.058976 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:29.059288 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:29.058999 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.060068 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.060033 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.060484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.060273 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.060484 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.060376 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.065234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.065211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.180870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.180840 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.181026 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.180926 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.181110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.181092 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:30.183518 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:30.183500 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:29:34.081622 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:34.081578 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused" Sep 08 10:29:34.082105 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:34.081758 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:29:34.823443 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:34.823391 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 08 10:29:34.823619 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:34.823544 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:29:38.215121 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.215087 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerID="bdd11fd0f9a311635390e0cb3b96c71b0643e0478863e7f9fc4846df4ab51e4c" exitCode=137 Sep 08 10:29:38.215121 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.215117 2577 generic.go:356] "Generic (PLEG): container finished" podID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerID="10117727fccdbdc052d0b8fe4d8674467e754d67956dfcca37bd962c7674acd3" exitCode=137 Sep 08 10:29:38.215539 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.215164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"bdd11fd0f9a311635390e0cb3b96c71b0643e0478863e7f9fc4846df4ab51e4c"} Sep 08 10:29:38.215539 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.215222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"10117727fccdbdc052d0b8fe4d8674467e754d67956dfcca37bd962c7674acd3"} Sep 08 10:29:38.236656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.236626 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:29:38.264851 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.264806 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls\") pod \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " Sep 08 10:29:38.264851 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.264840 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls\") pod \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " Sep 08 10:29:38.265429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.264878 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls\") pod \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " Sep 08 10:29:38.265429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.264945 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e45ab0-11a2-49a7-af12-422d30b6c33e-feast-data\") pod \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " Sep 08 10:29:38.265429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.264981 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv8ct\" (UniqueName: \"kubernetes.io/projected/a6e45ab0-11a2-49a7-af12-422d30b6c33e-kube-api-access-rv8ct\") pod \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " Sep 08 10:29:38.265689 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.265621 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6e45ab0-11a2-49a7-af12-422d30b6c33e-feast-data" (OuterVolumeSpecName: "feast-data") pod "a6e45ab0-11a2-49a7-af12-422d30b6c33e" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:29:38.268333 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.268272 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6e45ab0-11a2-49a7-af12-422d30b6c33e-kube-api-access-rv8ct" (OuterVolumeSpecName: "kube-api-access-rv8ct") pod "a6e45ab0-11a2-49a7-af12-422d30b6c33e" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e"). InnerVolumeSpecName "kube-api-access-rv8ct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:29:38.268612 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.268592 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls" (OuterVolumeSpecName: "online-tls") pod "a6e45ab0-11a2-49a7-af12-422d30b6c33e" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:29:38.270254 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.270224 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a6e45ab0-11a2-49a7-af12-422d30b6c33e" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:29:38.270503 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.270473 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a6e45ab0-11a2-49a7-af12-422d30b6c33e" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:29:38.365978 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.365891 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-offline-tls\") pod \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\" (UID: \"a6e45ab0-11a2-49a7-af12-422d30b6c33e\") " Sep 08 10:29:38.366120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.366023 2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a6e45ab0-11a2-49a7-af12-422d30b6c33e-feast-data\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:29:38.366120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.366034 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv8ct\" (UniqueName: \"kubernetes.io/projected/a6e45ab0-11a2-49a7-af12-422d30b6c33e-kube-api-access-rv8ct\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:29:38.366120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.366043 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:29:38.366120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.366051 2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-ui-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:29:38.366120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.366058 2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-online-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:29:38.367994 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.367969 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a6e45ab0-11a2-49a7-af12-422d30b6c33e" (UID: "a6e45ab0-11a2-49a7-af12-422d30b6c33e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:29:38.466964 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:38.466933 2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a6e45ab0-11a2-49a7-af12-422d30b6c33e-offline-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:29:39.222275 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.222251 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" Sep 08 10:29:39.222660 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.222252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg" event={"ID":"a6e45ab0-11a2-49a7-af12-422d30b6c33e","Type":"ContainerDied","Data":"8dfe424cc21f1ce99dba7eea10ff4a2dfcad8eafdd52e2cb698356bd3b42d86e"} Sep 08 10:29:39.222660 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.222379 2577 scope.go:117] "RemoveContainer" containerID="8847af11026972affd9bfe5bba25e559fc21c7e62705300daef1e40594b1f693" Sep 08 10:29:39.230537 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.230517 2577 scope.go:117] "RemoveContainer" containerID="bdd11fd0f9a311635390e0cb3b96c71b0643e0478863e7f9fc4846df4ab51e4c" Sep 08 10:29:39.238311 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.238287 2577 scope.go:117] "RemoveContainer" containerID="e19ae6e9cafe5d02c8bde7d602d238ab72a25ada720b3c49f9408d17f2fc5635" Sep 08 10:29:39.241358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.241335 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg"] Sep 08 10:29:39.244605 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.244583 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wm5wg"] Sep 08 10:29:39.246519 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.246505 2577 scope.go:117] "RemoveContainer" containerID="10117727fccdbdc052d0b8fe4d8674467e754d67956dfcca37bd962c7674acd3" Sep 08 10:29:39.253866 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.253849 2577 scope.go:117] "RemoveContainer" containerID="047c3a34a441ba1fcf0f93d70962bcd71112d3f561e76199c2190f6f3d331d2f" Sep 08 10:29:39.260653 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:39.260637 2577 scope.go:117] "RemoveContainer" containerID="3caf1260d10db26d44e0bb6fcc4645a1956476ea0677296964e6210bdeab032a" Sep 08 10:29:41.048075 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:29:41.048037 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" path="/var/lib/kubelet/pods/a6e45ab0-11a2-49a7-af12-422d30b6c33e/volumes" Sep 08 10:30:32.602382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:32.602306 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:30:33.068153 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068119 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc"] Sep 08 10:30:33.068397 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068385 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="feast-init" Sep 08 10:30:33.068439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068401 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="feast-init" Sep 08 10:30:33.068439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068418 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="offline" Sep 08 10:30:33.068439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068423 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="offline" Sep 08 10:30:33.068439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068429 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" Sep 08 10:30:33.068439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068435 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068443 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="feast-apply" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068449 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="feast-apply" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068454 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="registry" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068459 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="registry" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068473 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068478 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068525 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="offline" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068533 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="ui" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068540 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="online" Sep 08 10:30:33.068584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.068545 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6e45ab0-11a2-49a7-af12-422d30b6c33e" containerName="registry" Sep 08 10:30:33.071915 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.071896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.074293 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.074266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 10:30:33.074405 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.074314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 10:30:33.074405 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.074311 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 10:30:33.074793 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.074776 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 10:30:33.074979 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.074964 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 10:30:33.075056 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.074972 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-49ws6\"" Sep 08 10:30:33.075056 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.075034 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:30:33.085233 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.085206 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc"] Sep 08 10:30:33.216202 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.216158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rll5v\" (UniqueName: \"kubernetes.io/projected/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-kube-api-access-rll5v\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.216202 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.216203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.216410 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.216234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.216410 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.216292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.216410 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.216358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.216410 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.216383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.316976 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.316944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.317139 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.316981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.317139 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.317116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.317256 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.317168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.317256 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.317225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rll5v\" (UniqueName: \"kubernetes.io/projected/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-kube-api-access-rll5v\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.317256 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.317249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.317595 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.317562 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.318226 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.318169 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.319604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.319584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.319696 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.319636 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.319696 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.319681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.325309 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.325278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rll5v\" (UniqueName: \"kubernetes.io/projected/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-kube-api-access-rll5v\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-z5vnc\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.381286 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.381245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:30:33.658190 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:33.658164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc"] Sep 08 10:30:33.660878 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:30:33.660846 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca2d7ef8_e69f_4646_bbaf_7d80aee7fdd8.slice/crio-90cb843a87c635e26ebc0bc4dd439f19bfe920806e538f5835d6491c96aab51e WatchSource:0}: Error finding container 90cb843a87c635e26ebc0bc4dd439f19bfe920806e538f5835d6491c96aab51e: Status 404 returned error can't find the container with id 90cb843a87c635e26ebc0bc4dd439f19bfe920806e538f5835d6491c96aab51e Sep 08 10:30:34.436814 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:34.436772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerStarted","Data":"020cebc1275e874c1d61a85f5d854e85a30b80d772f90abb2521c9fd2cccd219"} Sep 08 10:30:34.437020 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:34.436831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerStarted","Data":"90cb843a87c635e26ebc0bc4dd439f19bfe920806e538f5835d6491c96aab51e"} Sep 08 10:30:35.297414 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:35.297376 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:30:39.460725 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:39.460675 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerID="020cebc1275e874c1d61a85f5d854e85a30b80d772f90abb2521c9fd2cccd219" exitCode=0 Sep 08 10:30:39.460725 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:39.460708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerDied","Data":"020cebc1275e874c1d61a85f5d854e85a30b80d772f90abb2521c9fd2cccd219"} Sep 08 10:30:40.467263 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:30:40.467223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerStarted","Data":"fe1c6d7951406db17d83fc36f33f121cbb3c05b0665452e5b537209572c0780f"} Sep 08 10:31:02.562264 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:02.562228 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerID="fe1c6d7951406db17d83fc36f33f121cbb3c05b0665452e5b537209572c0780f" exitCode=0 Sep 08 10:31:02.562696 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:02.562301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerDied","Data":"fe1c6d7951406db17d83fc36f33f121cbb3c05b0665452e5b537209572c0780f"} Sep 08 10:31:03.571697 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:03.571660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerStarted","Data":"1b1286763aaa9e4b684ee80bcbb6f78b94a81627f1f0bc6871035427c1b79650"} Sep 08 10:31:03.572110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:03.571720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerStarted","Data":"f9ad3da98c1d510a00543e6ad864b2e8b337bdd1ecbd988468b51fa0ee880a24"} Sep 08 10:31:03.572110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:03.571775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerStarted","Data":"d0fe21d7feb72bb5696723af7721bc5b4d15d377d9fd42d879eebb8da62e283b"} Sep 08 10:31:03.597348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:03.597285 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podStartSLOduration=30.597264916 podStartE2EDuration="30.597264916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:31:03.596205496 +0000 UTC m=+1465.001067956" watchObservedRunningTime="2026-09-08 10:31:03.597264916 +0000 UTC m=+1465.002127364" Sep 08 10:31:06.381921 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:06.381876 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:06.382522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:06.382487 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:06.382522 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:06.382517 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:06.383537 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:06.383502 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Sep 08 10:31:06.383537 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:06.383518 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 08 10:31:06.383720 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:06.383561 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 08 10:31:09.382587 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:09.382546 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Sep 08 10:31:09.383078 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:09.382569 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 08 10:31:09.383078 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:09.382613 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 08 10:31:12.382894 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:12.382858 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:12.383309 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:12.383070 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:12.383498 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:12.383466 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:12.383621 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:12.383513 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:12.383717 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:12.383622 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:12.383851 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:12.383834 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:13.381440 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:13.381402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:13.386852 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:13.386818 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 08 10:31:16.100285 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:16.100254 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:16.824430 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:16.824398 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:31:37.105912 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:37.105863 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 10:31:39.068162 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:39.068135 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:31:39.071275 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:31:39.071248 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:32:19.650703 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.650669 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc"] Sep 08 10:32:19.651280 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.650929 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" containerID="cri-o://d0fe21d7feb72bb5696723af7721bc5b4d15d377d9fd42d879eebb8da62e283b" gracePeriod=30 Sep 08 10:32:19.651280 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.650973 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="offline" containerID="cri-o://f9ad3da98c1d510a00543e6ad864b2e8b337bdd1ecbd988468b51fa0ee880a24" gracePeriod=30 Sep 08 10:32:19.651280 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.651269 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" containerID="cri-o://1b1286763aaa9e4b684ee80bcbb6f78b94a81627f1f0bc6871035427c1b79650" gracePeriod=30 Sep 08 10:32:19.690132 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.690096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:32:19.746254 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.746196 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:32:19.834111 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.834078 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462"] Sep 08 10:32:19.834618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.834357 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" containerID="cri-o://82fd85bddaef9b9250d96f2f4b743feb5702bd4f132e329998ac633eaa61e25d" gracePeriod=30 Sep 08 10:32:19.834618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.834431 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" containerID="cri-o://51b9962399e25ba32db8789ebb9b48383bf9b92b3c286578358fd2630177cefe" gracePeriod=30 Sep 08 10:32:19.834618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.834431 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" containerID="cri-o://97db65c52a05f6de72cbc6e45d91e76c9d56068907a1e902fcc25a665ea5b156" gracePeriod=30 Sep 08 10:32:19.834618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.834452 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" containerID="cri-o://1370326c9c98a3f72dc174717b6649154caaab951bf717f309a9d3e98edbe39c" gracePeriod=30 Sep 08 10:32:19.936904 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:19.936785 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:32:20.181449 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.181399 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 08 10:32:20.181644 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.181413 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 08 10:32:20.200348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.200244 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:32:20.883879 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.883845 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerID="51b9962399e25ba32db8789ebb9b48383bf9b92b3c286578358fd2630177cefe" exitCode=0 Sep 08 10:32:20.883879 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.883874 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerID="1370326c9c98a3f72dc174717b6649154caaab951bf717f309a9d3e98edbe39c" exitCode=0 Sep 08 10:32:20.884339 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.883921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"51b9962399e25ba32db8789ebb9b48383bf9b92b3c286578358fd2630177cefe"} Sep 08 10:32:20.884339 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.883969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"1370326c9c98a3f72dc174717b6649154caaab951bf717f309a9d3e98edbe39c"} Sep 08 10:32:20.886716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.886692 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerID="1b1286763aaa9e4b684ee80bcbb6f78b94a81627f1f0bc6871035427c1b79650" exitCode=0 Sep 08 10:32:20.886716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.886713 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerID="d0fe21d7feb72bb5696723af7721bc5b4d15d377d9fd42d879eebb8da62e283b" exitCode=0 Sep 08 10:32:20.886873 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.886767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerDied","Data":"1b1286763aaa9e4b684ee80bcbb6f78b94a81627f1f0bc6871035427c1b79650"} Sep 08 10:32:20.886873 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:20.886801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerDied","Data":"d0fe21d7feb72bb5696723af7721bc5b4d15d377d9fd42d879eebb8da62e283b"} Sep 08 10:32:22.384293 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:22.384243 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 08 10:32:24.999771 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:24.999709 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:32:26.101810 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:26.101767 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 08 10:32:30.181439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:30.181388 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 08 10:32:30.181439 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:30.181412 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 08 10:32:32.384338 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:32.384290 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 08 10:32:36.100846 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:36.100803 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 08 10:32:40.180480 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:40.180422 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 08 10:32:40.180480 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:40.180464 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 08 10:32:40.183003 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:40.180636 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:32:40.183003 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:40.180706 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:32:42.384434 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:42.384390 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 08 10:32:42.384914 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:42.384527 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:32:46.101657 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:46.101606 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 08 10:32:46.102117 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:46.101777 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:32:50.009334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.009301 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerID="97db65c52a05f6de72cbc6e45d91e76c9d56068907a1e902fcc25a665ea5b156" exitCode=137 Sep 08 10:32:50.009334 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.009329 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerID="82fd85bddaef9b9250d96f2f4b743feb5702bd4f132e329998ac633eaa61e25d" exitCode=137 Sep 08 10:32:50.009802 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.009376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"97db65c52a05f6de72cbc6e45d91e76c9d56068907a1e902fcc25a665ea5b156"} Sep 08 10:32:50.009802 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.009434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"82fd85bddaef9b9250d96f2f4b743feb5702bd4f132e329998ac633eaa61e25d"} Sep 08 10:32:50.012128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.012106 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerID="f9ad3da98c1d510a00543e6ad864b2e8b337bdd1ecbd988468b51fa0ee880a24" exitCode=137 Sep 08 10:32:50.012242 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.012147 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerDied","Data":"f9ad3da98c1d510a00543e6ad864b2e8b337bdd1ecbd988468b51fa0ee880a24"} Sep 08 10:32:50.181234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.181196 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused" Sep 08 10:32:50.181234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.181226 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Sep 08 10:32:50.181400 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.181218 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Sep 08 10:32:50.181400 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.181202 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Sep 08 10:32:50.286961 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.286934 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:32:50.354654 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.354635 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-ui-tls\") pod \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " Sep 08 10:32:50.354713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.354688 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-online-tls\") pod \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " Sep 08 10:32:50.354774 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.354715 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-registry-tls\") pod \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " Sep 08 10:32:50.354774 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.354767 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rll5v\" (UniqueName: \"kubernetes.io/projected/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-kube-api-access-rll5v\") pod \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " Sep 08 10:32:50.354858 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.354829 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-feast-data\") pod \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " Sep 08 10:32:50.354910 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.354856 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-offline-tls\") pod \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\" (UID: \"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8\") " Sep 08 10:32:50.355113 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.355086 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" (UID: "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:32:50.355494 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.355449 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-feast-data" (OuterVolumeSpecName: "feast-data") pod "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" (UID: "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:32:50.357249 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.357222 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-kube-api-access-rll5v" (OuterVolumeSpecName: "kube-api-access-rll5v") pod "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" (UID: "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8"). InnerVolumeSpecName "kube-api-access-rll5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:32:50.357353 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.357332 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" (UID: "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.357411 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.357366 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-online-tls" (OuterVolumeSpecName: "online-tls") pod "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" (UID: "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.357411 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.357381 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" (UID: "ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.455604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.455574 2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-online-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.455604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.455603 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.455798 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.455612 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rll5v\" (UniqueName: \"kubernetes.io/projected/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-kube-api-access-rll5v\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.455798 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.455622 2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-feast-data\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.455798 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.455630 2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-offline-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.455798 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.455637 2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8-ui-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.479174 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.479147 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:32:50.556247 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.556155 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np8zh\" (UniqueName: \"kubernetes.io/projected/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-kube-api-access-np8zh\") pod \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " Sep 08 10:32:50.556247 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.556200 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-offline-tls\") pod \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " Sep 08 10:32:50.556247 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.556225 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-ui-tls\") pod \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " Sep 08 10:32:50.556521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.556264 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls\") pod \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " Sep 08 10:32:50.556521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.556282 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls\") pod \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " Sep 08 10:32:50.556521 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.556355 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-feast-data\") pod \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\" (UID: \"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b\") " Sep 08 10:32:50.557227 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.557192 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-feast-data" (OuterVolumeSpecName: "feast-data") pod "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:32:50.558611 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.558579 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.558611 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.558600 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-kube-api-access-np8zh" (OuterVolumeSpecName: "kube-api-access-np8zh") pod "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b"). InnerVolumeSpecName "kube-api-access-np8zh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:32:50.558771 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.558622 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls" (OuterVolumeSpecName: "online-tls") pod "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.558891 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.558870 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.558996 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.558889 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" (UID: "4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:32:50.657647 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.657620 2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-ui-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.657647 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.657645 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.657908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.657654 2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-online-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.657908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.657664 2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-feast-data\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.657908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.657673 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np8zh\" (UniqueName: \"kubernetes.io/projected/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-kube-api-access-np8zh\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:50.657908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:50.657683 2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b-offline-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:32:51.018923 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.018897 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" Sep 08 10:32:51.018923 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.018910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc" event={"ID":"ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8","Type":"ContainerDied","Data":"90cb843a87c635e26ebc0bc4dd439f19bfe920806e538f5835d6491c96aab51e"} Sep 08 10:32:51.019399 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.018968 2577 scope.go:117] "RemoveContainer" containerID="1b1286763aaa9e4b684ee80bcbb6f78b94a81627f1f0bc6871035427c1b79650" Sep 08 10:32:51.021997 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.021968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" event={"ID":"4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b","Type":"ContainerDied","Data":"83b154c9e4ab81388278a38e512423120469ff53d37c46965ce53185f2dc1b6a"} Sep 08 10:32:51.022121 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.022037 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462" Sep 08 10:32:51.028848 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.028612 2577 scope.go:117] "RemoveContainer" containerID="f9ad3da98c1d510a00543e6ad864b2e8b337bdd1ecbd988468b51fa0ee880a24" Sep 08 10:32:51.036680 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.036664 2577 scope.go:117] "RemoveContainer" containerID="d0fe21d7feb72bb5696723af7721bc5b4d15d377d9fd42d879eebb8da62e283b" Sep 08 10:32:51.041361 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.041341 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc"] Sep 08 10:32:51.045545 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.045526 2577 scope.go:117] "RemoveContainer" containerID="fe1c6d7951406db17d83fc36f33f121cbb3c05b0665452e5b537209572c0780f" Sep 08 10:32:51.048066 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.048044 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-z5vnc"] Sep 08 10:32:51.052835 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.052818 2577 scope.go:117] "RemoveContainer" containerID="020cebc1275e874c1d61a85f5d854e85a30b80d772f90abb2521c9fd2cccd219" Sep 08 10:32:51.055340 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.055309 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462"] Sep 08 10:32:51.058742 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.058705 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f6462"] Sep 08 10:32:51.060790 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.060774 2577 scope.go:117] "RemoveContainer" containerID="51b9962399e25ba32db8789ebb9b48383bf9b92b3c286578358fd2630177cefe" Sep 08 10:32:51.067642 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.067622 2577 scope.go:117] "RemoveContainer" containerID="97db65c52a05f6de72cbc6e45d91e76c9d56068907a1e902fcc25a665ea5b156" Sep 08 10:32:51.074643 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.074625 2577 scope.go:117] "RemoveContainer" containerID="1370326c9c98a3f72dc174717b6649154caaab951bf717f309a9d3e98edbe39c" Sep 08 10:32:51.081718 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.081702 2577 scope.go:117] "RemoveContainer" containerID="82fd85bddaef9b9250d96f2f4b743feb5702bd4f132e329998ac633eaa61e25d" Sep 08 10:32:51.088829 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.088811 2577 scope.go:117] "RemoveContainer" containerID="aa98db4c35e08a556e47464f9330c9e455c8a4b97a9ff67835d04e9cfc3a91b1" Sep 08 10:32:51.095478 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:51.095464 2577 scope.go:117] "RemoveContainer" containerID="f3db4725d92bc46b6898c1cd0cb469a9177438a9571018dff5039dfeaea99897" Sep 08 10:32:53.048042 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:53.048008 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" path="/var/lib/kubelet/pods/4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b/volumes" Sep 08 10:32:53.048604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:32:53.048590 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" path="/var/lib/kubelet/pods/ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8/volumes" Sep 08 10:33:00.249667 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:00.249630 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:02.560087 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:02.560057 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:02.692302 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:02.692264 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:08.230995 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.230958 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:08.341991 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.341953 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:08.357487 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.357450 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t"] Sep 08 10:33:08.357672 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.357647 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" podUID="910fe1a9-cd92-4938-9c3d-db536233e592" containerName="manager" containerID="cri-o://1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060" gracePeriod=10 Sep 08 10:33:08.599044 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.599022 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:33:08.709006 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.708967 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kfsg\" (UniqueName: \"kubernetes.io/projected/910fe1a9-cd92-4938-9c3d-db536233e592-kube-api-access-2kfsg\") pod \"910fe1a9-cd92-4938-9c3d-db536233e592\" (UID: \"910fe1a9-cd92-4938-9c3d-db536233e592\") " Sep 08 10:33:08.711269 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.711230 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/910fe1a9-cd92-4938-9c3d-db536233e592-kube-api-access-2kfsg" (OuterVolumeSpecName: "kube-api-access-2kfsg") pod "910fe1a9-cd92-4938-9c3d-db536233e592" (UID: "910fe1a9-cd92-4938-9c3d-db536233e592"). InnerVolumeSpecName "kube-api-access-2kfsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:33:08.810206 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:08.810128 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kfsg\" (UniqueName: \"kubernetes.io/projected/910fe1a9-cd92-4938-9c3d-db536233e592-kube-api-access-2kfsg\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:33:09.092956 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.092863 2577 generic.go:356] "Generic (PLEG): container finished" podID="910fe1a9-cd92-4938-9c3d-db536233e592" containerID="1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060" exitCode=0 Sep 08 10:33:09.092956 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.092923 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" Sep 08 10:33:09.092956 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.092947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" event={"ID":"910fe1a9-cd92-4938-9c3d-db536233e592","Type":"ContainerDied","Data":"1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060"} Sep 08 10:33:09.093174 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.093001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t" event={"ID":"910fe1a9-cd92-4938-9c3d-db536233e592","Type":"ContainerDied","Data":"409011d24d9364db370d16b6b9e76f2d4420fc1466d7290a409ae47c22b1b07b"} Sep 08 10:33:09.093174 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.093022 2577 scope.go:117] "RemoveContainer" containerID="1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060" Sep 08 10:33:09.101179 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.101156 2577 scope.go:117] "RemoveContainer" containerID="1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060" Sep 08 10:33:09.101458 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:33:09.101441 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060\": container with ID starting with 1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060 not found: ID does not exist" containerID="1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060" Sep 08 10:33:09.101509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.101466 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060"} err="failed to get container status \"1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060\": rpc error: code = NotFound desc = could not find container \"1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060\": container with ID starting with 1e426e4ff5dff61a8c9a14692475ce591cf603b41912acd56fa06007d8c76060 not found: ID does not exist" Sep 08 10:33:09.108049 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.108026 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t"] Sep 08 10:33:09.111524 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:09.111498 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xcd9t"] Sep 08 10:33:11.047462 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:11.047430 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="910fe1a9-cd92-4938-9c3d-db536233e592" path="/var/lib/kubelet/pods/910fe1a9-cd92-4938-9c3d-db536233e592/volumes" Sep 08 10:33:13.006870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.006837 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6"] Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007120 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007135 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007147 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007153 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007160 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007167 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007173 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="feast-apply" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007178 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="feast-apply" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007187 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="feast-apply" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007192 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="feast-apply" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007199 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910fe1a9-cd92-4938-9c3d-db536233e592" containerName="manager" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007207 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="910fe1a9-cd92-4938-9c3d-db536233e592" containerName="manager" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007216 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="feast-init" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007222 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="feast-init" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007227 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007231 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007238 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="offline" Sep 08 10:33:13.007235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007254 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="offline" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007263 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="feast-init" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007268 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="feast-init" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007276 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007282 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007291 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007299 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007343 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="ui" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007350 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="offline" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007355 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="online" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007361 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="910fe1a9-cd92-4938-9c3d-db536233e592" containerName="manager" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007371 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="online" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007380 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="registry" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007385 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e7b0d76-c91e-4ec4-98ab-761a4a4c5e7b" containerName="offline" Sep 08 10:33:13.007831 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.007390 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2d7ef8-e69f-4646-bbaf-7d80aee7fdd8" containerName="ui" Sep 08 10:33:13.011492 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.011474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:13.016251 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.016224 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 10:33:13.016422 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.016386 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 10:33:13.016524 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.016417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-ql88d\"" Sep 08 10:33:13.037011 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.036985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6"] Sep 08 10:33:13.144024 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.143989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s2l6\" (UniqueName: \"kubernetes.io/projected/5d53d388-7364-490d-b654-9df9369feea1-kube-api-access-7s2l6\") pod \"feast-operator-controller-manager-689b877b4b-bgff6\" (UID: \"5d53d388-7364-490d-b654-9df9369feea1\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:13.244610 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.244568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s2l6\" (UniqueName: \"kubernetes.io/projected/5d53d388-7364-490d-b654-9df9369feea1-kube-api-access-7s2l6\") pod \"feast-operator-controller-manager-689b877b4b-bgff6\" (UID: \"5d53d388-7364-490d-b654-9df9369feea1\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:13.284556 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.284479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s2l6\" (UniqueName: \"kubernetes.io/projected/5d53d388-7364-490d-b654-9df9369feea1-kube-api-access-7s2l6\") pod \"feast-operator-controller-manager-689b877b4b-bgff6\" (UID: \"5d53d388-7364-490d-b654-9df9369feea1\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:13.321326 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.321263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:13.602308 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:13.602225 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6"] Sep 08 10:33:13.606166 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:33:13.606132 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d53d388_7364_490d_b654_9df9369feea1.slice/crio-2d0c16274daa84d94417e0860528c52cf582eeaf302f18324a75d671a2a34384 WatchSource:0}: Error finding container 2d0c16274daa84d94417e0860528c52cf582eeaf302f18324a75d671a2a34384: Status 404 returned error can't find the container with id 2d0c16274daa84d94417e0860528c52cf582eeaf302f18324a75d671a2a34384 Sep 08 10:33:14.118079 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:14.118034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" event={"ID":"5d53d388-7364-490d-b654-9df9369feea1","Type":"ContainerStarted","Data":"f114b2ed268f75d64f69d021a8c81d9d6c279d8bd1a726abb388370b8a0e63f8"} Sep 08 10:33:14.118504 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:14.118098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" event={"ID":"5d53d388-7364-490d-b654-9df9369feea1","Type":"ContainerStarted","Data":"2d0c16274daa84d94417e0860528c52cf582eeaf302f18324a75d671a2a34384"} Sep 08 10:33:14.118504 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:14.118193 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:14.157802 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:14.157725 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" podStartSLOduration=2.157708903 podStartE2EDuration="2.157708903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:33:14.156431839 +0000 UTC m=+1595.561294287" watchObservedRunningTime="2026-09-08 10:33:14.157708903 +0000 UTC m=+1595.562571350" Sep 08 10:33:25.124225 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:25.124191 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-bgff6" Sep 08 10:33:29.302664 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.302596 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:29.402387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.402350 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:29.863761 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.863650 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:29.959271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.959234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:29.963715 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.963686 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv"] Sep 08 10:33:29.967401 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.967370 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.969804 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.969772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 10:33:29.969926 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.969841 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 10:33:29.970000 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.969927 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 10:33:29.970000 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.969957 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 10:33:29.970000 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.969968 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6kk86\"" Sep 08 10:33:29.970483 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.970467 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 10:33:29.970917 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.970896 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 10:33:29.975637 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.975614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e480e1b-5a07-4658-9b8a-c0c31e29867f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.975757 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.975643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.975757 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.975678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.975861 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.975775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.975861 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.975807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.975861 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.975825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56zqz\" (UniqueName: \"kubernetes.io/projected/4e480e1b-5a07-4658-9b8a-c0c31e29867f-kube-api-access-56zqz\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:29.982694 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:29.982672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv"] Sep 08 10:33:30.059554 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.059516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:30.076716 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.076677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.076865 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.076725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.076865 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.076772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56zqz\" (UniqueName: \"kubernetes.io/projected/4e480e1b-5a07-4658-9b8a-c0c31e29867f-kube-api-access-56zqz\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.076865 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.076821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e480e1b-5a07-4658-9b8a-c0c31e29867f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.077178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.076958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.077178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.077005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.077178 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:33:30.077114 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:33:30.077410 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:33:30.077194 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls podName:4e480e1b-5a07-4658-9b8a-c0c31e29867f nodeName:}" failed. No retries permitted until 2026-09-08 10:33:30.577171215 +0000 UTC m=+1611.982033663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-9fhdv" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:33:30.077410 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.077218 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e480e1b-5a07-4658-9b8a-c0c31e29867f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.079476 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.079453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.079578 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.079478 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.079624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.079611 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.085175 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.085156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56zqz\" (UniqueName: \"kubernetes.io/projected/4e480e1b-5a07-4658-9b8a-c0c31e29867f-kube-api-access-56zqz\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.159364 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.159255 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:30.312052 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.312014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:30.582565 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.582480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.585270 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.585247 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-9fhdv\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:30.876394 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:30.876309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:31.152256 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:31.152231 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv"] Sep 08 10:33:31.153317 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:33:31.153297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e480e1b_5a07_4658_9b8a_c0c31e29867f.slice/crio-d6db17d6a3fda379edc9c91df47073204daa6304ba8d96898fe9edea67a04ef6 WatchSource:0}: Error finding container d6db17d6a3fda379edc9c91df47073204daa6304ba8d96898fe9edea67a04ef6: Status 404 returned error can't find the container with id d6db17d6a3fda379edc9c91df47073204daa6304ba8d96898fe9edea67a04ef6 Sep 08 10:33:31.181948 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:31.181921 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"d6db17d6a3fda379edc9c91df47073204daa6304ba8d96898fe9edea67a04ef6"} Sep 08 10:33:32.193197 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:32.193160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb"} Sep 08 10:33:36.210845 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:36.210811 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerID="746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb" exitCode=0 Sep 08 10:33:36.211217 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:36.210865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb"} Sep 08 10:33:37.216575 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:37.216536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93"} Sep 08 10:33:42.239358 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:42.239322 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerID="ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93" exitCode=0 Sep 08 10:33:42.239781 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:42.239399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93"} Sep 08 10:33:43.249916 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:43.249867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6"} Sep 08 10:33:43.250362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:43.249936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0"} Sep 08 10:33:43.250362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:43.249960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8"} Sep 08 10:33:43.250362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:43.249979 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerStarted","Data":"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763"} Sep 08 10:33:43.275854 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:43.275789 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podStartSLOduration=14.275768798 podStartE2EDuration="14.275768798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:33:43.273825054 +0000 UTC m=+1624.678687502" watchObservedRunningTime="2026-09-08 10:33:43.275768798 +0000 UTC m=+1624.680631246" Sep 08 10:33:45.876770 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.876708 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:45.877260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.876799 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:45.877260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.876818 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:45.877260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.876837 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:45.878859 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.878809 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 08 10:33:45.878859 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.878835 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 08 10:33:45.879067 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.878876 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 08 10:33:45.879067 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:45.878960 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 08 10:33:48.877387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:48.877252 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 08 10:33:48.877387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:48.877263 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 08 10:33:48.877387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:48.877261 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 08 10:33:48.877387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:48.877260 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 08 10:33:50.876658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:50.876603 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:50.877069 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:50.876678 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:50.877069 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:50.876691 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:50.877069 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:50.876702 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.877529 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.877493 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.878023 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.877635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.878023 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.877845 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.878526 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.878502 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.878645 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.878572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.878645 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.878619 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:51.883046 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:51.883025 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:52.297865 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:52.297827 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:33:52.587968 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:33:52.587881 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:53.982839 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:53.982775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:53.990234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:53.990204 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv"] Sep 08 10:34:53.990531 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:53.990483 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="registry" containerID="cri-o://fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763" gracePeriod=30 Sep 08 10:34:53.990658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:53.990553 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" containerID="cri-o://04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8" gracePeriod=30 Sep 08 10:34:53.990658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:53.990553 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" containerID="cri-o://a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6" gracePeriod=30 Sep 08 10:34:53.990658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:53.990543 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="offline" containerID="cri-o://be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0" gracePeriod=30 Sep 08 10:34:54.084174 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.084135 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:54.331626 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.331544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:54.429081 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.429020 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:54.430583 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.430558 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb"] Sep 08 10:34:54.435234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.435209 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.437290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.437265 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4sftb\"" Sep 08 10:34:54.445207 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.445181 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb"] Sep 08 10:34:54.504751 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.504707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.504949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.504793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77pr6\" (UniqueName: \"kubernetes.io/projected/3da5b1b8-57ee-413a-b10b-6c6673751f2f-kube-api-access-77pr6\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.504949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.504820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.504949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.504840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.504949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.504866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.504949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.504915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3da5b1b8-57ee-413a-b10b-6c6673751f2f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.565971 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.565930 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:54.606118 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606017 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.606118 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606062 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.606118 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3da5b1b8-57ee-413a-b10b-6c6673751f2f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:54.606174 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:54.606192 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:54.606250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls podName:3da5b1b8-57ee-413a-b10b-6c6673751f2f nodeName:}" failed. No retries permitted until 2026-09-08 10:34:55.10622802 +0000 UTC m=+1696.511090462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-wqnfb" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:54.606267 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls podName:3da5b1b8-57ee-413a-b10b-6c6673751f2f nodeName:}" failed. No retries permitted until 2026-09-08 10:34:55.106259019 +0000 UTC m=+1696.511121445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-wqnfb" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f") : secret "feast-simple-feast-setup-offline-tls" not found Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77pr6\" (UniqueName: \"kubernetes.io/projected/3da5b1b8-57ee-413a-b10b-6c6673751f2f-kube-api-access-77pr6\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.606408 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:54.606393 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 10:34:54.606825 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:54.606438 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls podName:3da5b1b8-57ee-413a-b10b-6c6673751f2f nodeName:}" failed. No retries permitted until 2026-09-08 10:34:55.106426953 +0000 UTC m=+1696.511289394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls") pod "feast-simple-feast-setup-57576b8fcf-wqnfb" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 10:34:54.606825 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.606577 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3da5b1b8-57ee-413a-b10b-6c6673751f2f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.608903 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.608875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.617102 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.617065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77pr6\" (UniqueName: \"kubernetes.io/projected/3da5b1b8-57ee-413a-b10b-6c6673751f2f-kube-api-access-77pr6\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:54.672879 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.672834 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:54.772726 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:54.772695 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:55.110071 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.110037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:55.110511 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.110081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:55.110511 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.110112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:55.110511 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:55.110307 2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 08 10:34:55.110511 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:34:55.110398 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls podName:3da5b1b8-57ee-413a-b10b-6c6673751f2f nodeName:}" failed. No retries permitted until 2026-09-08 10:34:56.110375783 +0000 UTC m=+1697.515238226 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-wqnfb" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f") : secret "feast-simple-feast-setup-offline-tls" not found Sep 08 10:34:55.112665 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.112639 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:55.112826 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.112699 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:55.370307 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.370219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:55.537341 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.537309 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerID="a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6" exitCode=0 Sep 08 10:34:55.537341 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.537333 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerID="04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8" exitCode=0 Sep 08 10:34:55.537552 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.537381 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6"} Sep 08 10:34:55.537552 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:55.537430 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8"} Sep 08 10:34:56.119407 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:56.119362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:56.121850 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:56.121830 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-wqnfb\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:56.245168 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:56.245124 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:34:56.522962 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:56.522936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb"] Sep 08 10:34:56.524883 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:34:56.524856 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da5b1b8_57ee_413a_b10b_6c6673751f2f.slice/crio-68d5124e7a93bdc79d19bba81e16bf41a66873c2e3b9bd2fef7c47cebcf8c6bd WatchSource:0}: Error finding container 68d5124e7a93bdc79d19bba81e16bf41a66873c2e3b9bd2fef7c47cebcf8c6bd: Status 404 returned error can't find the container with id 68d5124e7a93bdc79d19bba81e16bf41a66873c2e3b9bd2fef7c47cebcf8c6bd Sep 08 10:34:56.542128 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:56.542105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"68d5124e7a93bdc79d19bba81e16bf41a66873c2e3b9bd2fef7c47cebcf8c6bd"} Sep 08 10:34:57.547982 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:34:57.547942 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c"} Sep 08 10:35:01.565688 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:01.565652 2577 generic.go:356] "Generic (PLEG): container finished" podID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerID="25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c" exitCode=0 Sep 08 10:35:01.566069 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:01.565718 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c"} Sep 08 10:35:01.879157 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:01.879045 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 08 10:35:02.294917 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:02.294871 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 08 10:35:02.571845 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:02.571760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c"} Sep 08 10:35:07.598365 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:07.598333 2577 generic.go:356] "Generic (PLEG): container finished" podID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerID="e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c" exitCode=0 Sep 08 10:35:07.598721 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:07.598402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c"} Sep 08 10:35:08.608641 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:08.608595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075"} Sep 08 10:35:08.609141 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:08.608660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8"} Sep 08 10:35:08.609141 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:08.608681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e"} Sep 08 10:35:08.609141 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:08.608699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerStarted","Data":"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc"} Sep 08 10:35:08.636453 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:08.636383 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podStartSLOduration=14.636359357 podStartE2EDuration="14.636359357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:35:08.635027484 +0000 UTC m=+1710.039889924" watchObservedRunningTime="2026-09-08 10:35:08.636359357 +0000 UTC m=+1710.041221805" Sep 08 10:35:11.245597 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.245564 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:11.246186 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.246162 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:11.246271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.246199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:11.246271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.246218 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:11.247659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.247628 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Sep 08 10:35:11.247872 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.247664 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 08 10:35:11.248009 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.247642 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused" Sep 08 10:35:11.248009 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.247709 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 08 10:35:11.878751 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:11.878679 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 08 10:35:12.294835 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:12.294786 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 08 10:35:14.246110 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:14.246050 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Sep 08 10:35:14.246598 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:14.246112 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused" Sep 08 10:35:14.246598 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:14.246046 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 08 10:35:14.246598 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:14.246062 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 08 10:35:16.245605 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:16.245564 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:16.246153 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:16.245642 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:16.246153 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:16.245656 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:16.246153 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:16.245671 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.246399 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.246365 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.246908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.246824 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.247011 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.246995 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.251620 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.251598 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.655501 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.655401 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.655669 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.655647 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.655870 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.655851 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:17.658178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:17.658155 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:35:21.878269 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:21.878219 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 08 10:35:21.878714 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:21.878368 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:35:22.295074 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:22.295035 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 08 10:35:22.295254 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:22.295164 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:35:24.634925 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.634892 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:35:24.691348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691307 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerID="be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0" exitCode=137 Sep 08 10:35:24.691348 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691339 2577 generic.go:356] "Generic (PLEG): container finished" podID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerID="fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763" exitCode=137 Sep 08 10:35:24.691561 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691365 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0"} Sep 08 10:35:24.691561 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691384 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" Sep 08 10:35:24.691561 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763"} Sep 08 10:35:24.691561 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691430 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv" event={"ID":"4e480e1b-5a07-4658-9b8a-c0c31e29867f","Type":"ContainerDied","Data":"d6db17d6a3fda379edc9c91df47073204daa6304ba8d96898fe9edea67a04ef6"} Sep 08 10:35:24.691561 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.691454 2577 scope.go:117] "RemoveContainer" containerID="a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6" Sep 08 10:35:24.699950 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.699932 2577 scope.go:117] "RemoveContainer" containerID="be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0" Sep 08 10:35:24.707468 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.707447 2577 scope.go:117] "RemoveContainer" containerID="04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8" Sep 08 10:35:24.715344 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.715324 2577 scope.go:117] "RemoveContainer" containerID="fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763" Sep 08 10:35:24.723014 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.722993 2577 scope.go:117] "RemoveContainer" containerID="ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93" Sep 08 10:35:24.730556 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.730533 2577 scope.go:117] "RemoveContainer" containerID="746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb" Sep 08 10:35:24.739658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.739132 2577 scope.go:117] "RemoveContainer" containerID="a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6" Sep 08 10:35:24.739658 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:35:24.739610 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6\": container with ID starting with a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6 not found: ID does not exist" containerID="a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6" Sep 08 10:35:24.739658 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.739646 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6"} err="failed to get container status \"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6\": rpc error: code = NotFound desc = could not find container \"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6\": container with ID starting with a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6 not found: ID does not exist" Sep 08 10:35:24.739908 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.739671 2577 scope.go:117] "RemoveContainer" containerID="be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0" Sep 08 10:35:24.740067 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:35:24.740037 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0\": container with ID starting with be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0 not found: ID does not exist" containerID="be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0" Sep 08 10:35:24.740124 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.740066 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0"} err="failed to get container status \"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0\": rpc error: code = NotFound desc = could not find container \"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0\": container with ID starting with be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0 not found: ID does not exist" Sep 08 10:35:24.740124 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.740085 2577 scope.go:117] "RemoveContainer" containerID="04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8" Sep 08 10:35:24.740518 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:35:24.740499 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8\": container with ID starting with 04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8 not found: ID does not exist" containerID="04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8" Sep 08 10:35:24.740584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.740522 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8"} err="failed to get container status \"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8\": rpc error: code = NotFound desc = could not find container \"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8\": container with ID starting with 04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8 not found: ID does not exist" Sep 08 10:35:24.740584 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.740539 2577 scope.go:117] "RemoveContainer" containerID="fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763" Sep 08 10:35:24.740871 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:35:24.740844 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763\": container with ID starting with fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763 not found: ID does not exist" containerID="fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763" Sep 08 10:35:24.740951 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.740878 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763"} err="failed to get container status \"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763\": rpc error: code = NotFound desc = could not find container \"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763\": container with ID starting with fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763 not found: ID does not exist" Sep 08 10:35:24.740951 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.740899 2577 scope.go:117] "RemoveContainer" containerID="ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93" Sep 08 10:35:24.741166 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:35:24.741150 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93\": container with ID starting with ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93 not found: ID does not exist" containerID="ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93" Sep 08 10:35:24.741213 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.741171 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93"} err="failed to get container status \"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93\": rpc error: code = NotFound desc = could not find container \"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93\": container with ID starting with ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93 not found: ID does not exist" Sep 08 10:35:24.741213 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.741184 2577 scope.go:117] "RemoveContainer" containerID="746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb" Sep 08 10:35:24.741452 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:35:24.741425 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb\": container with ID starting with 746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb not found: ID does not exist" containerID="746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb" Sep 08 10:35:24.741452 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.741446 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb"} err="failed to get container status \"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb\": rpc error: code = NotFound desc = could not find container \"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb\": container with ID starting with 746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb not found: ID does not exist" Sep 08 10:35:24.741538 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.741459 2577 scope.go:117] "RemoveContainer" containerID="a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6" Sep 08 10:35:24.741711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.741675 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6"} err="failed to get container status \"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6\": rpc error: code = NotFound desc = could not find container \"a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6\": container with ID starting with a7b43756b0ca7ca47887583d7852d4fc027c6592d8c43ebcce875edf884899d6 not found: ID does not exist" Sep 08 10:35:24.741711 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.741701 2577 scope.go:117] "RemoveContainer" containerID="be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0" Sep 08 10:35:24.742034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742012 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0"} err="failed to get container status \"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0\": rpc error: code = NotFound desc = could not find container \"be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0\": container with ID starting with be790fc301ff0f9bedca512072edefaa00d5b92b34b60a908a74ea34117d45c0 not found: ID does not exist" Sep 08 10:35:24.742034 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742034 2577 scope.go:117] "RemoveContainer" containerID="04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8" Sep 08 10:35:24.742256 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742237 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8"} err="failed to get container status \"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8\": rpc error: code = NotFound desc = could not find container \"04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8\": container with ID starting with 04ace1a4ac6a2ea20ae90aa89f2aa79aafd1346f8cbd890338b6d625acac48d8 not found: ID does not exist" Sep 08 10:35:24.742365 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742263 2577 scope.go:117] "RemoveContainer" containerID="fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763" Sep 08 10:35:24.742483 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742447 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763"} err="failed to get container status \"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763\": rpc error: code = NotFound desc = could not find container \"fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763\": container with ID starting with fe03b776a51ce928138bb07170f7a7a107e0444cb302ee5dc84e26afb3381763 not found: ID does not exist" Sep 08 10:35:24.742483 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742462 2577 scope.go:117] "RemoveContainer" containerID="ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93" Sep 08 10:35:24.742661 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742641 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93"} err="failed to get container status \"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93\": rpc error: code = NotFound desc = could not find container \"ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93\": container with ID starting with ccabab2beca7cf238833fdabd6d9eb6f0eba5cb60f8ddca9a7cba865a55f4d93 not found: ID does not exist" Sep 08 10:35:24.742709 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742662 2577 scope.go:117] "RemoveContainer" containerID="746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb" Sep 08 10:35:24.742905 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.742887 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb"} err="failed to get container status \"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb\": rpc error: code = NotFound desc = could not find container \"746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb\": container with ID starting with 746c8c4f9eb3ce3a6208077756c6b3ba37b663c32e2441e67aea11af376274cb not found: ID does not exist" Sep 08 10:35:24.778234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778134 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-registry-tls\") pod \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " Sep 08 10:35:24.778234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778187 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-online-tls\") pod \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " Sep 08 10:35:24.778234 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778239 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e480e1b-5a07-4658-9b8a-c0c31e29867f-feast-data\") pod \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " Sep 08 10:35:24.778566 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778255 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls\") pod \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " Sep 08 10:35:24.778566 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778328 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-offline-tls\") pod \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " Sep 08 10:35:24.778566 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778368 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56zqz\" (UniqueName: \"kubernetes.io/projected/4e480e1b-5a07-4658-9b8a-c0c31e29867f-kube-api-access-56zqz\") pod \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\" (UID: \"4e480e1b-5a07-4658-9b8a-c0c31e29867f\") " Sep 08 10:35:24.778885 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.778855 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e480e1b-5a07-4658-9b8a-c0c31e29867f-feast-data" (OuterVolumeSpecName: "feast-data") pod "4e480e1b-5a07-4658-9b8a-c0c31e29867f" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:35:24.780767 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.780701 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4e480e1b-5a07-4658-9b8a-c0c31e29867f" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:35:24.780883 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.780760 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e480e1b-5a07-4658-9b8a-c0c31e29867f-kube-api-access-56zqz" (OuterVolumeSpecName: "kube-api-access-56zqz") pod "4e480e1b-5a07-4658-9b8a-c0c31e29867f" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f"). InnerVolumeSpecName "kube-api-access-56zqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:35:24.780883 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.780821 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e480e1b-5a07-4658-9b8a-c0c31e29867f" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:35:24.780976 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.780906 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-online-tls" (OuterVolumeSpecName: "online-tls") pod "4e480e1b-5a07-4658-9b8a-c0c31e29867f" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:35:24.780976 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.780934 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4e480e1b-5a07-4658-9b8a-c0c31e29867f" (UID: "4e480e1b-5a07-4658-9b8a-c0c31e29867f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:35:24.879502 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.879468 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56zqz\" (UniqueName: \"kubernetes.io/projected/4e480e1b-5a07-4658-9b8a-c0c31e29867f-kube-api-access-56zqz\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:35:24.879502 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.879501 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:35:24.879502 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.879511 2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-online-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:35:24.879790 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.879519 2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4e480e1b-5a07-4658-9b8a-c0c31e29867f-feast-data\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:35:24.879790 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.879527 2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-ui-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:35:24.879790 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:24.879534 2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4e480e1b-5a07-4658-9b8a-c0c31e29867f-offline-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:35:25.017816 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:25.017782 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv"] Sep 08 10:35:25.021268 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:25.021237 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-9fhdv"] Sep 08 10:35:25.048120 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:25.048054 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" path="/var/lib/kubelet/pods/4e480e1b-5a07-4658-9b8a-c0c31e29867f/volumes" Sep 08 10:35:27.485191 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:27.485138 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:35:27.539084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:35:27.539033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:17.120004 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:17.119963 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:19.147692 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147651 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p"] Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147944 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147955 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147976 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="feast-apply" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147981 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="feast-apply" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147987 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="offline" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147992 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="offline" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.147999 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="feast-init" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148004 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="feast-init" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148012 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148017 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148023 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="registry" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148027 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="registry" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148072 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="ui" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148080 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="online" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148087 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="registry" Sep 08 10:36:19.148085 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.148092 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e480e1b-5a07-4658-9b8a-c0c31e29867f" containerName="offline" Sep 08 10:36:19.150918 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.150898 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.153260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153229 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 10:36:19.153260 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153251 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 10:36:19.153429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 10:36:19.153429 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153356 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:36:19.153526 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 10:36:19.153574 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153565 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-t8pls\"" Sep 08 10:36:19.153612 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.153569 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 10:36:19.163293 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.163273 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p"] Sep 08 10:36:19.215227 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.215186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.215426 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.215246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zflts\" (UniqueName: \"kubernetes.io/projected/856fa9b7-7ce8-4637-b945-d7c6f86af900-kube-api-access-zflts\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.215426 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.215279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856fa9b7-7ce8-4637-b945-d7c6f86af900-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.215426 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.215316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.215426 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.215336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.215426 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.215393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/856fa9b7-7ce8-4637-b945-d7c6f86af900-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.315934 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.315899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.315934 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.315932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.316171 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.315956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/856fa9b7-7ce8-4637-b945-d7c6f86af900-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.316171 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.316005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.316171 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.316052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zflts\" (UniqueName: \"kubernetes.io/projected/856fa9b7-7ce8-4637-b945-d7c6f86af900-kube-api-access-zflts\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.316171 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:36:19.316063 2577 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 10:36:19.316171 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.316080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856fa9b7-7ce8-4637-b945-d7c6f86af900-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.316171 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:36:19.316137 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls podName:856fa9b7-7ce8-4637-b945-d7c6f86af900 nodeName:}" failed. No retries permitted until 2026-09-08 10:36:19.8161145 +0000 UTC m=+1781.220976926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 10:36:19.316490 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.316466 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856fa9b7-7ce8-4637-b945-d7c6f86af900-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.316792 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.316772 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/856fa9b7-7ce8-4637-b945-d7c6f86af900-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.318758 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.318717 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.318863 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.318768 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.324487 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.324466 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zflts\" (UniqueName: \"kubernetes.io/projected/856fa9b7-7ce8-4637-b945-d7c6f86af900-kube-api-access-zflts\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.820040 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.820001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:19.822665 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:19.822638 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vbj7p\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:20.060232 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:20.060180 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:20.327927 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:20.327841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:20.339800 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:20.339780 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p"] Sep 08 10:36:20.341508 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:36:20.341481 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod856fa9b7_7ce8_4637_b945_d7c6f86af900.slice/crio-103fa318294d105ef286426264e76958b5166b605f86ae9251e1e0ee1dc12536 WatchSource:0}: Error finding container 103fa318294d105ef286426264e76958b5166b605f86ae9251e1e0ee1dc12536: Status 404 returned error can't find the container with id 103fa318294d105ef286426264e76958b5166b605f86ae9251e1e0ee1dc12536 Sep 08 10:36:20.914455 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:20.914415 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerStarted","Data":"6526e0fcfd4df1ad43be9e0a844aef1b48a7a24e77d538d3306b9b7a586bc38c"} Sep 08 10:36:20.914455 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:20.914462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerStarted","Data":"103fa318294d105ef286426264e76958b5166b605f86ae9251e1e0ee1dc12536"} Sep 08 10:36:25.937591 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:25.937555 2577 generic.go:356] "Generic (PLEG): container finished" podID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerID="6526e0fcfd4df1ad43be9e0a844aef1b48a7a24e77d538d3306b9b7a586bc38c" exitCode=0 Sep 08 10:36:25.938004 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:25.937610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerDied","Data":"6526e0fcfd4df1ad43be9e0a844aef1b48a7a24e77d538d3306b9b7a586bc38c"} Sep 08 10:36:26.943209 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:26.943174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerStarted","Data":"eb6ec010b161249fbc31e0d41a830f02ea6e596912365f639ea2311b215c7184"} Sep 08 10:36:39.099944 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:39.099912 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:36:39.103443 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:39.103420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:36:49.031924 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:49.031887 2577 generic.go:356] "Generic (PLEG): container finished" podID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerID="eb6ec010b161249fbc31e0d41a830f02ea6e596912365f639ea2311b215c7184" exitCode=0 Sep 08 10:36:49.032336 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:49.031962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerDied","Data":"eb6ec010b161249fbc31e0d41a830f02ea6e596912365f639ea2311b215c7184"} Sep 08 10:36:50.040431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.040392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerStarted","Data":"9f8d473acf4a7c8a98b837282d2774bf4bb9eb38662c457fe82ced8ffec21008"} Sep 08 10:36:50.040945 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.040442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerStarted","Data":"15295d30c8dfdcd24f52530ca770410bcc053c5042830b1423bc92acf10e2a61"} Sep 08 10:36:50.040945 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.040454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerStarted","Data":"281f2267e4cdad2549daaa81f59a1b4baf70d2218f336adf350696a805942048"} Sep 08 10:36:50.061059 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.061001 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:50.061259 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.061129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:50.061259 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.061156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:50.061259 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.061176 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:50.061259 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.061192 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:50.061259 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.061204 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:50.063192 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.063157 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 08 10:36:50.063341 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.063238 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 08 10:36:50.063341 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.063209 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 08 10:36:50.064175 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:50.064130 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podStartSLOduration=31.064115549 podStartE2EDuration="31.064115549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:36:50.061880719 +0000 UTC m=+1811.466743166" watchObservedRunningTime="2026-09-08 10:36:50.064115549 +0000 UTC m=+1811.468977997" Sep 08 10:36:53.061370 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:53.061332 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 08 10:36:53.061840 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:53.061335 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 08 10:36:53.061840 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:53.061368 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 08 10:36:56.060810 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:56.060765 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 08 10:36:56.061276 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:56.060765 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 08 10:36:56.061276 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:56.060786 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 08 10:36:59.061629 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:59.061599 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:59.062017 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:59.061712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:59.062402 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:59.062381 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:36:59.062478 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:36:59.062430 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:37:00.063895 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:37:00.063854 2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 10:37:02.834786 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:37:02.834746 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:37:03.738287 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:37:03.738250 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:37:14.016655 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:37:14.016621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:37:14.073443 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:37:14.073404 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:06.409572 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.409531 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p"] Sep 08 10:38:06.412656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.409910 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" containerID="cri-o://281f2267e4cdad2549daaa81f59a1b4baf70d2218f336adf350696a805942048" gracePeriod=30 Sep 08 10:38:06.412656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.409916 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" containerID="cri-o://9f8d473acf4a7c8a98b837282d2774bf4bb9eb38662c457fe82ced8ffec21008" gracePeriod=30 Sep 08 10:38:06.412656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.409961 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" containerID="cri-o://15295d30c8dfdcd24f52530ca770410bcc053c5042830b1423bc92acf10e2a61" gracePeriod=30 Sep 08 10:38:06.414543 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.414512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:06.512949 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.512911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:06.618138 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.618103 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:06.630446 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.630411 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb"] Sep 08 10:38:06.630770 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.630722 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="registry" containerID="cri-o://1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc" gracePeriod=30 Sep 08 10:38:06.630872 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.630804 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="offline" containerID="cri-o://dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8" gracePeriod=30 Sep 08 10:38:06.630872 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.630805 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" containerID="cri-o://84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075" gracePeriod=30 Sep 08 10:38:06.631076 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.631020 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" containerID="cri-o://3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e" gracePeriod=30 Sep 08 10:38:06.712671 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.712572 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:06.771931 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:06.771882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:07.351952 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.351927 2577 generic.go:356] "Generic (PLEG): container finished" podID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerID="84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075" exitCode=0 Sep 08 10:38:07.352075 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.351995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075"} Sep 08 10:38:07.354656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.354630 2577 generic.go:356] "Generic (PLEG): container finished" podID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerID="9f8d473acf4a7c8a98b837282d2774bf4bb9eb38662c457fe82ced8ffec21008" exitCode=0 Sep 08 10:38:07.354656 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.354655 2577 generic.go:356] "Generic (PLEG): container finished" podID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerID="281f2267e4cdad2549daaa81f59a1b4baf70d2218f336adf350696a805942048" exitCode=0 Sep 08 10:38:07.354814 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.354696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerDied","Data":"9f8d473acf4a7c8a98b837282d2774bf4bb9eb38662c457fe82ced8ffec21008"} Sep 08 10:38:07.354814 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.354727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerDied","Data":"281f2267e4cdad2549daaa81f59a1b4baf70d2218f336adf350696a805942048"} Sep 08 10:38:07.655712 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.655590 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 08 10:38:07.655712 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:07.655614 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 08 10:38:08.362509 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:08.362473 2577 generic.go:356] "Generic (PLEG): container finished" podID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerID="3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e" exitCode=0 Sep 08 10:38:08.362699 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:08.362541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e"} Sep 08 10:38:09.062316 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:09.062273 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 08 10:38:11.770532 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:11.770497 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:12.835919 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:12.835881 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 08 10:38:17.655352 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:17.655302 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 08 10:38:17.655796 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:17.655345 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 08 10:38:19.062545 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:19.062502 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 08 10:38:22.835590 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:22.835544 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 08 10:38:27.655894 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:27.655842 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 08 10:38:27.656382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:27.655993 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:38:27.656382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:27.656105 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 08 10:38:27.656382 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:27.656196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:38:29.062357 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:29.062312 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 08 10:38:29.062814 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:29.062426 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:38:32.835471 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:32.835427 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 08 10:38:32.835862 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:32.835580 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:38:36.473349 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:36.473315 2577 generic.go:356] "Generic (PLEG): container finished" podID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerID="15295d30c8dfdcd24f52530ca770410bcc053c5042830b1423bc92acf10e2a61" exitCode=137 Sep 08 10:38:36.473713 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:36.473386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerDied","Data":"15295d30c8dfdcd24f52530ca770410bcc053c5042830b1423bc92acf10e2a61"} Sep 08 10:38:37.067659 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.067636 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:38:37.157510 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.157484 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-ui-tls\") pod \"856fa9b7-7ce8-4637-b945-d7c6f86af900\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " Sep 08 10:38:37.157624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.157531 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zflts\" (UniqueName: \"kubernetes.io/projected/856fa9b7-7ce8-4637-b945-d7c6f86af900-kube-api-access-zflts\") pod \"856fa9b7-7ce8-4637-b945-d7c6f86af900\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " Sep 08 10:38:37.157624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.157570 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/856fa9b7-7ce8-4637-b945-d7c6f86af900-registry-tls\") pod \"856fa9b7-7ce8-4637-b945-d7c6f86af900\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " Sep 08 10:38:37.157624 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.157610 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856fa9b7-7ce8-4637-b945-d7c6f86af900-feast-data\") pod \"856fa9b7-7ce8-4637-b945-d7c6f86af900\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " Sep 08 10:38:37.157795 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.157628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls\") pod \"856fa9b7-7ce8-4637-b945-d7c6f86af900\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " Sep 08 10:38:37.157795 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.157777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-online-tls\") pod \"856fa9b7-7ce8-4637-b945-d7c6f86af900\" (UID: \"856fa9b7-7ce8-4637-b945-d7c6f86af900\") " Sep 08 10:38:37.158060 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.158011 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/856fa9b7-7ce8-4637-b945-d7c6f86af900-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "856fa9b7-7ce8-4637-b945-d7c6f86af900" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:38:37.158171 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.158151 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/856fa9b7-7ce8-4637-b945-d7c6f86af900-feast-data" (OuterVolumeSpecName: "feast-data") pod "856fa9b7-7ce8-4637-b945-d7c6f86af900" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:38:37.160210 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.160183 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-online-tls" (OuterVolumeSpecName: "online-tls") pod "856fa9b7-7ce8-4637-b945-d7c6f86af900" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.160295 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.160205 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "856fa9b7-7ce8-4637-b945-d7c6f86af900" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.160362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.160348 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "856fa9b7-7ce8-4637-b945-d7c6f86af900" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.160411 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.160373 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/856fa9b7-7ce8-4637-b945-d7c6f86af900-kube-api-access-zflts" (OuterVolumeSpecName: "kube-api-access-zflts") pod "856fa9b7-7ce8-4637-b945-d7c6f86af900" (UID: "856fa9b7-7ce8-4637-b945-d7c6f86af900"). InnerVolumeSpecName "kube-api-access-zflts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:38:37.259448 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.259415 2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-ui-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.259448 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.259453 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zflts\" (UniqueName: \"kubernetes.io/projected/856fa9b7-7ce8-4637-b945-d7c6f86af900-kube-api-access-zflts\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.259726 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.259468 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/856fa9b7-7ce8-4637-b945-d7c6f86af900-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.259726 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.259484 2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/856fa9b7-7ce8-4637-b945-d7c6f86af900-feast-data\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.259726 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.259496 2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-offline-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.259726 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.259507 2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/856fa9b7-7ce8-4637-b945-d7c6f86af900-online-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.273009 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.272989 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:38:37.359902 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.359866 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls\") pod \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " Sep 08 10:38:37.359902 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.359909 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") pod \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " Sep 08 10:38:37.360131 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.359957 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-registry-tls\") pod \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " Sep 08 10:38:37.360131 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.359982 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls\") pod \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " Sep 08 10:38:37.360131 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.360006 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77pr6\" (UniqueName: \"kubernetes.io/projected/3da5b1b8-57ee-413a-b10b-6c6673751f2f-kube-api-access-77pr6\") pod \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " Sep 08 10:38:37.360131 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.360027 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3da5b1b8-57ee-413a-b10b-6c6673751f2f-feast-data\") pod \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\" (UID: \"3da5b1b8-57ee-413a-b10b-6c6673751f2f\") " Sep 08 10:38:37.360616 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.360576 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da5b1b8-57ee-413a-b10b-6c6673751f2f-feast-data" (OuterVolumeSpecName: "feast-data") pod "3da5b1b8-57ee-413a-b10b-6c6673751f2f" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:38:37.362194 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.362169 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da5b1b8-57ee-413a-b10b-6c6673751f2f-kube-api-access-77pr6" (OuterVolumeSpecName: "kube-api-access-77pr6") pod "3da5b1b8-57ee-413a-b10b-6c6673751f2f" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f"). InnerVolumeSpecName "kube-api-access-77pr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:38:37.362661 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.362629 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3da5b1b8-57ee-413a-b10b-6c6673751f2f" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.362661 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.362640 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls" (OuterVolumeSpecName: "online-tls") pod "3da5b1b8-57ee-413a-b10b-6c6673751f2f" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.362817 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.362703 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3da5b1b8-57ee-413a-b10b-6c6673751f2f" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.362817 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.362726 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3da5b1b8-57ee-413a-b10b-6c6673751f2f" (UID: "3da5b1b8-57ee-413a-b10b-6c6673751f2f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:38:37.461043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.460976 2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-online-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.461043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.461004 2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-offline-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.461043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.461012 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-registry-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.461043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.461019 2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3da5b1b8-57ee-413a-b10b-6c6673751f2f-ui-tls\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.461043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.461028 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77pr6\" (UniqueName: \"kubernetes.io/projected/3da5b1b8-57ee-413a-b10b-6c6673751f2f-kube-api-access-77pr6\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.461043 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.461036 2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3da5b1b8-57ee-413a-b10b-6c6673751f2f-feast-data\") on node \"ip-10-0-131-17.ec2.internal\" DevicePath \"\"" Sep 08 10:38:37.479627 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.479605 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" Sep 08 10:38:37.480036 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.479637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p" event={"ID":"856fa9b7-7ce8-4637-b945-d7c6f86af900","Type":"ContainerDied","Data":"103fa318294d105ef286426264e76958b5166b605f86ae9251e1e0ee1dc12536"} Sep 08 10:38:37.480036 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.479704 2577 scope.go:117] "RemoveContainer" containerID="9f8d473acf4a7c8a98b837282d2774bf4bb9eb38662c457fe82ced8ffec21008" Sep 08 10:38:37.482694 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.482671 2577 generic.go:356] "Generic (PLEG): container finished" podID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerID="dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8" exitCode=137 Sep 08 10:38:37.482820 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.482697 2577 generic.go:356] "Generic (PLEG): container finished" podID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerID="1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc" exitCode=137 Sep 08 10:38:37.482820 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.482761 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" Sep 08 10:38:37.482820 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.482764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8"} Sep 08 10:38:37.482820 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.482809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc"} Sep 08 10:38:37.482967 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.482831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb" event={"ID":"3da5b1b8-57ee-413a-b10b-6c6673751f2f","Type":"ContainerDied","Data":"68d5124e7a93bdc79d19bba81e16bf41a66873c2e3b9bd2fef7c47cebcf8c6bd"} Sep 08 10:38:37.488685 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.488667 2577 scope.go:117] "RemoveContainer" containerID="15295d30c8dfdcd24f52530ca770410bcc053c5042830b1423bc92acf10e2a61" Sep 08 10:38:37.496508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.496489 2577 scope.go:117] "RemoveContainer" containerID="281f2267e4cdad2549daaa81f59a1b4baf70d2218f336adf350696a805942048" Sep 08 10:38:37.503763 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.503743 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p"] Sep 08 10:38:37.504297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.504284 2577 scope.go:117] "RemoveContainer" containerID="eb6ec010b161249fbc31e0d41a830f02ea6e596912365f639ea2311b215c7184" Sep 08 10:38:37.509053 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.509034 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vbj7p"] Sep 08 10:38:37.511969 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.511949 2577 scope.go:117] "RemoveContainer" containerID="6526e0fcfd4df1ad43be9e0a844aef1b48a7a24e77d538d3306b9b7a586bc38c" Sep 08 10:38:37.519137 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.519114 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb"] Sep 08 10:38:37.520450 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.520432 2577 scope.go:117] "RemoveContainer" containerID="84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075" Sep 08 10:38:37.522550 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.522531 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-wqnfb"] Sep 08 10:38:37.527815 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.527794 2577 scope.go:117] "RemoveContainer" containerID="dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8" Sep 08 10:38:37.535063 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.535043 2577 scope.go:117] "RemoveContainer" containerID="3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e" Sep 08 10:38:37.542344 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.542326 2577 scope.go:117] "RemoveContainer" containerID="1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc" Sep 08 10:38:37.550907 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.550887 2577 scope.go:117] "RemoveContainer" containerID="e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c" Sep 08 10:38:37.557906 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.557891 2577 scope.go:117] "RemoveContainer" containerID="25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c" Sep 08 10:38:37.564700 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.564681 2577 scope.go:117] "RemoveContainer" containerID="84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075" Sep 08 10:38:37.565041 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:38:37.565023 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075\": container with ID starting with 84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075 not found: ID does not exist" containerID="84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075" Sep 08 10:38:37.565092 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565049 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075"} err="failed to get container status \"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075\": rpc error: code = NotFound desc = could not find container \"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075\": container with ID starting with 84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075 not found: ID does not exist" Sep 08 10:38:37.565092 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565067 2577 scope.go:117] "RemoveContainer" containerID="dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8" Sep 08 10:38:37.565274 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:38:37.565259 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8\": container with ID starting with dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8 not found: ID does not exist" containerID="dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8" Sep 08 10:38:37.565318 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565278 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8"} err="failed to get container status \"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8\": rpc error: code = NotFound desc = could not find container \"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8\": container with ID starting with dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8 not found: ID does not exist" Sep 08 10:38:37.565318 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565290 2577 scope.go:117] "RemoveContainer" containerID="3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e" Sep 08 10:38:37.565500 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:38:37.565483 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e\": container with ID starting with 3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e not found: ID does not exist" containerID="3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e" Sep 08 10:38:37.565541 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565511 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e"} err="failed to get container status \"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e\": rpc error: code = NotFound desc = could not find container \"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e\": container with ID starting with 3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e not found: ID does not exist" Sep 08 10:38:37.565541 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565531 2577 scope.go:117] "RemoveContainer" containerID="1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc" Sep 08 10:38:37.565753 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:38:37.565719 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc\": container with ID starting with 1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc not found: ID does not exist" containerID="1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc" Sep 08 10:38:37.565802 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565758 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc"} err="failed to get container status \"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc\": rpc error: code = NotFound desc = could not find container \"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc\": container with ID starting with 1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc not found: ID does not exist" Sep 08 10:38:37.565802 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565772 2577 scope.go:117] "RemoveContainer" containerID="e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c" Sep 08 10:38:37.565988 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:38:37.565973 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c\": container with ID starting with e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c not found: ID does not exist" containerID="e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c" Sep 08 10:38:37.566027 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.565992 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c"} err="failed to get container status \"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c\": rpc error: code = NotFound desc = could not find container \"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c\": container with ID starting with e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c not found: ID does not exist" Sep 08 10:38:37.566027 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566004 2577 scope.go:117] "RemoveContainer" containerID="25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c" Sep 08 10:38:37.566254 ip-10-0-131-17 kubenswrapper[2577]: E0908 10:38:37.566240 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c\": container with ID starting with 25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c not found: ID does not exist" containerID="25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c" Sep 08 10:38:37.566297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566257 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c"} err="failed to get container status \"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c\": rpc error: code = NotFound desc = could not find container \"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c\": container with ID starting with 25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c not found: ID does not exist" Sep 08 10:38:37.566297 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566277 2577 scope.go:117] "RemoveContainer" containerID="84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075" Sep 08 10:38:37.566493 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566477 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075"} err="failed to get container status \"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075\": rpc error: code = NotFound desc = could not find container \"84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075\": container with ID starting with 84f3f70d5b3f02baf998a996dffdd839f95e45723bd53cf6bf8aa2196963e075 not found: ID does not exist" Sep 08 10:38:37.566533 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566494 2577 scope.go:117] "RemoveContainer" containerID="dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8" Sep 08 10:38:37.566723 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566707 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8"} err="failed to get container status \"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8\": rpc error: code = NotFound desc = could not find container \"dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8\": container with ID starting with dee14dc07493bc80896b111f44d3b0c66a59f8f45d8b850a797db4523e57add8 not found: ID does not exist" Sep 08 10:38:37.566792 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566723 2577 scope.go:117] "RemoveContainer" containerID="3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e" Sep 08 10:38:37.566971 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566952 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e"} err="failed to get container status \"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e\": rpc error: code = NotFound desc = could not find container \"3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e\": container with ID starting with 3b6dbf65ad9c913b7295a7963076483effe37e18ddff802c6c30d620e407ec7e not found: ID does not exist" Sep 08 10:38:37.567036 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.566972 2577 scope.go:117] "RemoveContainer" containerID="1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc" Sep 08 10:38:37.567245 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.567226 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc"} err="failed to get container status \"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc\": rpc error: code = NotFound desc = could not find container \"1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc\": container with ID starting with 1ad51fe200eb44280338a785826b18c751e871193decd80d54c1a1c76c2132bc not found: ID does not exist" Sep 08 10:38:37.567296 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.567247 2577 scope.go:117] "RemoveContainer" containerID="e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c" Sep 08 10:38:37.567514 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.567496 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c"} err="failed to get container status \"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c\": rpc error: code = NotFound desc = could not find container \"e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c\": container with ID starting with e26eaad70baa8ae59d9ab560c723f97e02a2a1ce2f486ac461792ef496ea486c not found: ID does not exist" Sep 08 10:38:37.567554 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.567516 2577 scope.go:117] "RemoveContainer" containerID="25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c" Sep 08 10:38:37.567771 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:37.567752 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c"} err="failed to get container status \"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c\": rpc error: code = NotFound desc = could not find container \"25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c\": container with ID starting with 25855a20f1b0e8f176635253961ca197a92bb92f214b544336f0df1d8c95c01c not found: ID does not exist" Sep 08 10:38:39.048253 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:39.048218 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" path="/var/lib/kubelet/pods/3da5b1b8-57ee-413a-b10b-6c6673751f2f/volumes" Sep 08 10:38:39.048830 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:39.048816 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" path="/var/lib/kubelet/pods/856fa9b7-7ce8-4637-b945-d7c6f86af900/volumes" Sep 08 10:38:49.511839 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:49.511788 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:49.632323 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:49.632287 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:55.194235 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:55.194185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:55.252481 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:55.252445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:55.890843 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:55.890801 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:55.963982 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:38:55.963949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:13.231514 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.231473 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:13.389290 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389259 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zssmc/must-gather-jpxsl"] Sep 08 10:39:13.389534 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389522 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="feast-init" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389535 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="feast-init" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389547 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="feast-init" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389552 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="feast-init" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389561 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="registry" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389566 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="registry" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389576 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" Sep 08 10:39:13.389581 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389582 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389588 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="offline" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389595 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="offline" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389604 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389610 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389617 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389622 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389628 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="feast-apply" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389633 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="feast-apply" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389638 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="feast-apply" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389642 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="feast-apply" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389648 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389652 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389659 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389663 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389706 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="offline" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389714 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="ui" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389719 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="online" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389723 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="offline" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389742 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da5b1b8-57ee-413a-b10b-6c6673751f2f" containerName="registry" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389748 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="online" Sep 08 10:39:13.389847 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.389756 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="856fa9b7-7ce8-4637-b945-d7c6f86af900" containerName="ui" Sep 08 10:39:13.392570 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.392554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.395943 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.395920 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zssmc\"/\"openshift-service-ca.crt\"" Sep 08 10:39:13.396618 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.396603 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zssmc\"/\"kube-root-ca.crt\"" Sep 08 10:39:13.396714 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.396620 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zssmc\"/\"default-dockercfg-6zgz8\"" Sep 08 10:39:13.404438 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.404417 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zssmc/must-gather-jpxsl"] Sep 08 10:39:13.404899 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.404869 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:13.442879 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.442854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a517b6cf-3f1f-45e6-b101-c106deb78fda-must-gather-output\") pod \"must-gather-jpxsl\" (UID: \"a517b6cf-3f1f-45e6-b101-c106deb78fda\") " pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.443019 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.442910 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6c8\" (UniqueName: \"kubernetes.io/projected/a517b6cf-3f1f-45e6-b101-c106deb78fda-kube-api-access-7n6c8\") pod \"must-gather-jpxsl\" (UID: \"a517b6cf-3f1f-45e6-b101-c106deb78fda\") " pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.504222 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.504125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:13.544178 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.544144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6c8\" (UniqueName: \"kubernetes.io/projected/a517b6cf-3f1f-45e6-b101-c106deb78fda-kube-api-access-7n6c8\") pod \"must-gather-jpxsl\" (UID: \"a517b6cf-3f1f-45e6-b101-c106deb78fda\") " pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.544271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.544208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a517b6cf-3f1f-45e6-b101-c106deb78fda-must-gather-output\") pod \"must-gather-jpxsl\" (UID: \"a517b6cf-3f1f-45e6-b101-c106deb78fda\") " pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.544520 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.544499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a517b6cf-3f1f-45e6-b101-c106deb78fda-must-gather-output\") pod \"must-gather-jpxsl\" (UID: \"a517b6cf-3f1f-45e6-b101-c106deb78fda\") " pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.552309 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.552281 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6c8\" (UniqueName: \"kubernetes.io/projected/a517b6cf-3f1f-45e6-b101-c106deb78fda-kube-api-access-7n6c8\") pod \"must-gather-jpxsl\" (UID: \"a517b6cf-3f1f-45e6-b101-c106deb78fda\") " pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.701749 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.701709 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zssmc/must-gather-jpxsl" Sep 08 10:39:13.972435 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.972353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zssmc/must-gather-jpxsl"] Sep 08 10:39:13.976449 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:39:13.976419 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda517b6cf_3f1f_45e6_b101_c106deb78fda.slice/crio-749636fedf982706d60b0b501309655e74df84372ffce163ca3376bf8207c99a WatchSource:0}: Error finding container 749636fedf982706d60b0b501309655e74df84372ffce163ca3376bf8207c99a: Status 404 returned error can't find the container with id 749636fedf982706d60b0b501309655e74df84372ffce163ca3376bf8207c99a Sep 08 10:39:13.978373 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:13.978356 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:39:14.618859 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:14.618826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zssmc/must-gather-jpxsl" event={"ID":"a517b6cf-3f1f-45e6-b101-c106deb78fda","Type":"ContainerStarted","Data":"749636fedf982706d60b0b501309655e74df84372ffce163ca3376bf8207c99a"} Sep 08 10:39:15.627532 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:15.626709 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zssmc/must-gather-jpxsl" event={"ID":"a517b6cf-3f1f-45e6-b101-c106deb78fda","Type":"ContainerStarted","Data":"0d640e635e33880feb806fa25ee13c1bad0834c35b57a17118d8b361846b9c35"} Sep 08 10:39:15.627532 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:15.626783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zssmc/must-gather-jpxsl" event={"ID":"a517b6cf-3f1f-45e6-b101-c106deb78fda","Type":"ContainerStarted","Data":"1ac2a3ce1fe78841b348595fde5795d395ec79f010cec6e92575f94753ee1977"} Sep 08 10:39:16.569149 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:16.569116 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bvvg9_31afbe58-732a-4cf8-81e9-9af79095b26e/global-pull-secret-syncer/0.log" Sep 08 10:39:16.667680 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:16.667640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" Sep 08 10:39:16.749491 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:16.749462 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-17.ec2.internal_6613c508e2f799827626149a2992482f/haproxy/0.log" Sep 08 10:39:18.695632 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:18.695600 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:18.767271 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:18.767236 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l5msj_4c833253-97ce-42a6-a3aa-8e441495dfbf/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:20.633686 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:20.633645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-vcg9d_67d455ed-3301-4c43-b6b7-3f6c573b1174/cluster-monitoring-operator/0.log" Sep 08 10:39:20.764232 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:20.764120 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5784dcb644-gbnwz_93fe7e4e-b8dc-458a-b72e-fe142ff22245/metrics-server/0.log" Sep 08 10:39:20.794835 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:20.794798 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-4srrt_43d811e9-a765-495d-ad2e-94c190d8e817/monitoring-plugin/0.log" Sep 08 10:39:20.839251 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:20.839197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k8xbz_7deac37b-9ae5-4f66-8268-ea6250f10864/node-exporter/0.log" Sep 08 10:39:20.867447 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:20.867414 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k8xbz_7deac37b-9ae5-4f66-8268-ea6250f10864/kube-rbac-proxy/0.log" Sep 08 10:39:20.898342 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:20.898269 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k8xbz_7deac37b-9ae5-4f66-8268-ea6250f10864/init-textfile/0.log" Sep 08 10:39:21.491355 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.491326 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7954d4b98d-k6lzn_c6098c37-7102-4f9a-9eec-bd4b4d36c710/telemeter-client/0.log" Sep 08 10:39:21.523601 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.523568 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7954d4b98d-k6lzn_c6098c37-7102-4f9a-9eec-bd4b4d36c710/reload/0.log" Sep 08 10:39:21.554632 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.554539 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7954d4b98d-k6lzn_c6098c37-7102-4f9a-9eec-bd4b4d36c710/kube-rbac-proxy/0.log" Sep 08 10:39:21.599241 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.599202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8dbf8c4-zfnlq_d2992574-ce43-4e6f-a6e5-4b5bb0fbede8/thanos-query/0.log" Sep 08 10:39:21.632551 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.632523 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8dbf8c4-zfnlq_d2992574-ce43-4e6f-a6e5-4b5bb0fbede8/kube-rbac-proxy-web/0.log" Sep 08 10:39:21.681015 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.680988 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8dbf8c4-zfnlq_d2992574-ce43-4e6f-a6e5-4b5bb0fbede8/kube-rbac-proxy/0.log" Sep 08 10:39:21.715700 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.715654 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8dbf8c4-zfnlq_d2992574-ce43-4e6f-a6e5-4b5bb0fbede8/prom-label-proxy/0.log" Sep 08 10:39:21.754084 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.754004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8dbf8c4-zfnlq_d2992574-ce43-4e6f-a6e5-4b5bb0fbede8/kube-rbac-proxy-rules/0.log" Sep 08 10:39:21.796267 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:21.796235 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7bb8dbf8c4-zfnlq_d2992574-ce43-4e6f-a6e5-4b5bb0fbede8/kube-rbac-proxy-metrics/0.log" Sep 08 10:39:23.372555 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.372521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/1.log" Sep 08 10:39:23.384923 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.384890 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-rpj69_f9be1eec-3fb6-4544-9cf7-a78f8de71871/console-operator/2.log" Sep 08 10:39:23.739980 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.739926 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zssmc/must-gather-jpxsl" podStartSLOduration=9.607357625 podStartE2EDuration="10.739904261s" totalImagesPullingTime="1.132546636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:39:15.642780009 +0000 UTC m=+1957.047642457" watchObservedRunningTime="2026-09-08 10:39:23.739904261 +0000 UTC m=+1965.144766709" Sep 08 10:39:23.741206 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.741180 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf"] Sep 08 10:39:23.744546 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.744525 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.756454 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.756426 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf"] Sep 08 10:39:23.806092 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.806062 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c57f87c7f-hj6j5_591d8ec0-4b3e-45ae-aa67-f671ec3f7cb7/console/0.log" Sep 08 10:39:23.835904 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.835864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-proc\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.836100 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.835918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cx46\" (UniqueName: \"kubernetes.io/projected/55e1f62c-58af-4645-a58a-d544cdeddbd1-kube-api-access-8cx46\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.836100 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.836043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-podres\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.836100 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.836083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-sys\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.836226 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.836158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-lib-modules\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937068 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-podres\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937068 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-sys\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937330 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-lib-modules\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937330 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-proc\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937330 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cx46\" (UniqueName: \"kubernetes.io/projected/55e1f62c-58af-4645-a58a-d544cdeddbd1-kube-api-access-8cx46\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937747 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937701 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-lib-modules\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.937939 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.937904 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-proc\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.938067 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.938048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-sys\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.938130 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.938009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55e1f62c-58af-4645-a58a-d544cdeddbd1-podres\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:23.947873 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:23.947851 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cx46\" (UniqueName: \"kubernetes.io/projected/55e1f62c-58af-4645-a58a-d544cdeddbd1-kube-api-access-8cx46\") pod \"perf-node-gather-daemonset-lj4cf\" (UID: \"55e1f62c-58af-4645-a58a-d544cdeddbd1\") " pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:24.060444 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:24.060362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:24.343923 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:24.343894 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf"] Sep 08 10:39:24.346972 ip-10-0-131-17 kubenswrapper[2577]: W0908 10:39:24.346934 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55e1f62c_58af_4645_a58a_d544cdeddbd1.slice/crio-15653d5b5029849593335dfa8826bcf2f44682a0284536f71e91a0c2c6e399f6 WatchSource:0}: Error finding container 15653d5b5029849593335dfa8826bcf2f44682a0284536f71e91a0c2c6e399f6: Status 404 returned error can't find the container with id 15653d5b5029849593335dfa8826bcf2f44682a0284536f71e91a0c2c6e399f6 Sep 08 10:39:24.679621 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:24.679516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" event={"ID":"55e1f62c-58af-4645-a58a-d544cdeddbd1","Type":"ContainerStarted","Data":"1a4ebf24f3e3a14f2fc264ef1c5c9c190b33d1561bf67ee65b479e744912a567"} Sep 08 10:39:24.679621 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:24.679599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" event={"ID":"55e1f62c-58af-4645-a58a-d544cdeddbd1","Type":"ContainerStarted","Data":"15653d5b5029849593335dfa8826bcf2f44682a0284536f71e91a0c2c6e399f6"} Sep 08 10:39:24.680146 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:24.680133 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:24.700508 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:24.700444 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" podStartSLOduration=1.700423917 podStartE2EDuration="1.700423917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:39:24.699530843 +0000 UTC m=+1966.104393291" watchObservedRunningTime="2026-09-08 10:39:24.700423917 +0000 UTC m=+1966.105286365" Sep 08 10:39:25.508295 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:25.508264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rj6lj_9400831b-d835-4eb6-9ce2-be6c3b0a1bf3/dns/0.log" Sep 08 10:39:25.529396 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:25.529370 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rj6lj_9400831b-d835-4eb6-9ce2-be6c3b0a1bf3/kube-rbac-proxy/0.log" Sep 08 10:39:25.553404 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:25.553374 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jczk_0564785d-36fe-474e-9eae-82d5797ed588/dns-node-resolver/0.log" Sep 08 10:39:26.121842 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:26.121812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tthb7_0d777bb5-e556-438f-8ae3-634f4f0e6879/node-ca/0.log" Sep 08 10:39:27.258721 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:27.258691 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8p2w_98c2ff34-89c0-4e96-b722-92660a639e28/serve-healthcheck-canary/0.log" Sep 08 10:39:27.808655 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:27.808625 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frtg9_62dd1c11-c544-4e51-9cb9-44e5a413837d/kube-rbac-proxy/0.log" Sep 08 10:39:27.836273 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:27.836246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frtg9_62dd1c11-c544-4e51-9cb9-44e5a413837d/exporter/0.log" Sep 08 10:39:27.871472 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:27.871440 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frtg9_62dd1c11-c544-4e51-9cb9-44e5a413837d/extractor/0.log" Sep 08 10:39:30.695455 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:30.695372 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zssmc/perf-node-gather-daemonset-lj4cf" Sep 08 10:39:33.642757 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.642656 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/kube-multus-additional-cni-plugins/0.log" Sep 08 10:39:33.664272 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.664241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/egress-router-binary-copy/0.log" Sep 08 10:39:33.685983 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.685956 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/cni-plugins/0.log" Sep 08 10:39:33.709129 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.709099 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/bond-cni-plugin/0.log" Sep 08 10:39:33.727026 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.726993 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/routeoverride-cni/0.log" Sep 08 10:39:33.747920 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.747891 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/whereabouts-cni-bincopy/0.log" Sep 08 10:39:33.768362 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:33.768338 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2lnm4_14b94402-8a66-4526-9a13-650d2187c4fd/whereabouts-cni/0.log" Sep 08 10:39:34.148972 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:34.148939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vwppv_5bfdc435-5a0e-418e-93eb-020c0d5a2d6c/kube-multus/0.log" Sep 08 10:39:34.204641 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:34.204609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8s9q4_f888f945-1538-4b99-9cc4-fc69c518a469/network-metrics-daemon/0.log" Sep 08 10:39:34.225431 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:34.225397 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8s9q4_f888f945-1538-4b99-9cc4-fc69c518a469/kube-rbac-proxy/0.log" Sep 08 10:39:35.140258 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.140227 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/ovn-controller/0.log" Sep 08 10:39:35.159569 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.159539 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/ovn-acl-logging/0.log" Sep 08 10:39:35.192766 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.192741 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/kube-rbac-proxy-node/0.log" Sep 08 10:39:35.223387 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.223357 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 10:39:35.257246 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.257202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/northd/0.log" Sep 08 10:39:35.286071 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.286037 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/nbdb/0.log" Sep 08 10:39:35.313604 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.313570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/sbdb/0.log" Sep 08 10:39:35.368758 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:35.368708 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2rmb7_e2565da8-d702-4762-a544-bd4d712e6ac6/ovnkube-controller/0.log" Sep 08 10:39:36.863134 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:36.863099 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9rrz2_6d595065-eb5d-4533-be4c-7182c9d724ba/network-check-target-container/0.log" Sep 08 10:39:37.904557 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:37.904527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nsj84_55457d6c-5003-42bb-9783-3ae4b3207dd4/iptables-alerter/0.log" Sep 08 10:39:38.604145 ip-10-0-131-17 kubenswrapper[2577]: I0908 10:39:38.604112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qn6nb_e122af9b-b02f-4e30-b8b2-da8a542d77c5/tuned/0.log"