Sep 10 10:34:37.077363 ip-10-0-143-147 systemd[1]: Starting Kubernetes Kubelet... Sep 10 10:34:37.476941 ip-10-0-143-147 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 10:34:37.476941 ip-10-0-143-147 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 10:34:37.476941 ip-10-0-143-147 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 10:34:37.476941 ip-10-0-143-147 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 10:34:37.476941 ip-10-0-143-147 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 10:34:37.479737 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.479668 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 10:34:37.484565 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484548 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 10:34:37.484565 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484564 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484568 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484572 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484575 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484579 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484583 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484588 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484591 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484594 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484597 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484600 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484604 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484608 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484612 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484614 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484617 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484620 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484622 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484625 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 10:34:37.484634 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484628 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484630 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484633 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484639 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484642 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484645 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484648 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484651 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484653 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484656 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484658 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484661 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484663 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484666 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484671 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484674 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484677 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484680 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484683 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484686 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 10:34:37.485085 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484689 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484692 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484694 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484697 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484700 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484702 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484705 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484707 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484710 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484713 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484716 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484718 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484721 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484723 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484727 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484730 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484733 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484735 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484738 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 10:34:37.485632 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484741 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484743 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484746 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484749 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484751 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484754 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484756 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484759 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484762 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484764 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484767 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484769 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484772 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484775 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484779 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484781 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484784 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484786 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484789 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484791 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484794 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 10:34:37.486387 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484796 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484799 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484803 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484805 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484808 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484810 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484813 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484816 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484819 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484821 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484824 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484826 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484829 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484831 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484834 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484836 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484839 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484841 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 10:34:37.486913 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.484844 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 10:34:37.487507 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487489 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 10:34:37.487507 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487506 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487510 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487514 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487517 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487520 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487522 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487527 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487530 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487534 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487537 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487541 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487544 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487548 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487550 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487553 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487556 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487558 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487561 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487564 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487567 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 10:34:37.487560 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487569 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487573 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487576 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487578 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487581 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487584 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487586 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487589 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487591 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487594 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487596 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487604 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487607 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487610 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487612 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487615 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487617 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487620 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487622 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 10:34:37.488117 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487625 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487627 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487629 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487634 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487637 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487640 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487643 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487645 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487648 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487650 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487653 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487655 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487657 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487660 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487662 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487665 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487669 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487672 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487674 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487677 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 10:34:37.488657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487679 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487682 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487685 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487687 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487690 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487692 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487695 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487697 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487700 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487702 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487705 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487707 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487710 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487712 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487715 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487717 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487720 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487722 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487726 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 10:34:37.489156 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487730 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487733 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487735 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487738 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487741 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487744 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487747 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487750 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487755 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487757 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487760 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487764 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487767 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487770 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487773 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487775 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487778 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487780 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487783 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 10:34:37.489641 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.487785 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488178 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488183 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488186 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488189 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488192 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488195 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488197 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488200 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488203 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488206 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488208 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488211 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488215 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488217 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488220 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488222 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488225 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488228 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 10:34:37.490119 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488231 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488233 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488236 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488239 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488242 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488246 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488250 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488253 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488256 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488258 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488262 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488265 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488268 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488270 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488274 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488278 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488282 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488286 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488289 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 10:34:37.490588 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488292 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488294 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488297 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488299 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488302 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488304 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488307 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488309 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488312 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488314 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488317 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488319 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488322 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488325 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488327 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488333 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488335 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488337 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488340 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488342 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 10:34:37.491065 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488345 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488348 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488351 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488354 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488357 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488359 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488361 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488364 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488366 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488369 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488372 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488375 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488378 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488380 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488383 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488385 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488388 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488390 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488393 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488395 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 10:34:37.491573 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488398 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488400 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488403 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488405 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488408 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488411 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488413 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488417 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488420 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488422 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488424 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488427 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488429 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488432 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488435 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488437 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488440 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488442 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488445 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488447 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 10:34:37.492062 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488450 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.488452 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488521 2556 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488556 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488563 2556 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488568 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488572 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488575 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488579 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488583 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488586 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488589 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488592 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488596 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488599 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488602 2556 flags.go:64] FLAG: --cgroup-root="" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488604 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488607 2556 flags.go:64] FLAG: --client-ca-file="" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488611 2556 flags.go:64] FLAG: --cloud-provider="external" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488615 2556 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488619 2556 flags.go:64] FLAG: --cluster-domain="" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488622 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488625 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488628 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 10:34:37.492574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488631 2556 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488635 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488638 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488641 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488644 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488647 2556 flags.go:64] FLAG: --contention-profiling="false" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488650 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488653 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488656 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488659 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488663 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488666 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488669 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488672 2556 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488675 2556 flags.go:64] FLAG: --enable-server="true" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488677 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488682 2556 flags.go:64] FLAG: --event-burst="100" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488685 2556 flags.go:64] FLAG: --event-qps="50" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488688 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488691 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488694 2556 flags.go:64] FLAG: --eviction-hard="" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488697 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488700 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488703 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488706 2556 flags.go:64] FLAG: --eviction-soft="" Sep 10 10:34:37.493216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488709 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488711 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488715 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488718 2556 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488721 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488724 2556 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488727 2556 flags.go:64] FLAG: --feature-gates="" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488730 2556 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488733 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488736 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488743 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488746 2556 flags.go:64] FLAG: --healthz-port="10248" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488749 2556 flags.go:64] FLAG: --help="false" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488752 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488755 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488757 2556 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488760 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488763 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488767 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488769 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488772 2556 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488775 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488777 2556 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 10:34:37.493835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488780 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488783 2556 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488786 2556 flags.go:64] FLAG: --kube-reserved="" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488789 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488791 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488794 2556 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488797 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488799 2556 flags.go:64] FLAG: --lock-file="" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488802 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488805 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488807 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488813 2556 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488816 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488819 2556 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488822 2556 flags.go:64] FLAG: --logging-format="text" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488825 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488828 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488830 2556 flags.go:64] FLAG: --manifest-url="" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488833 2556 flags.go:64] FLAG: --manifest-url-header="" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488838 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488841 2556 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488845 2556 flags.go:64] FLAG: --max-pods="110" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488847 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488850 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488853 2556 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 10:34:37.494441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488856 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488858 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488861 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488864 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488871 2556 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488874 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488878 2556 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488881 2556 flags.go:64] FLAG: --pod-cidr="" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488883 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488888 2556 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488891 2556 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488894 2556 flags.go:64] FLAG: --pods-per-core="0" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488897 2556 flags.go:64] FLAG: --port="10250" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488900 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488903 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d93391e48a14fbd" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488906 2556 flags.go:64] FLAG: --qos-reserved="" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488909 2556 flags.go:64] FLAG: --read-only-port="10255" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488912 2556 flags.go:64] FLAG: --register-node="true" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488914 2556 flags.go:64] FLAG: --register-with-taints="" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488918 2556 flags.go:64] FLAG: --registry-burst="10" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488921 2556 flags.go:64] FLAG: --registry-qps="5" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488924 2556 flags.go:64] FLAG: --reserved-cpus="" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488926 2556 flags.go:64] FLAG: --reserved-memory="" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488930 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488932 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 10:34:37.495047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488935 2556 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488939 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488942 2556 flags.go:64] FLAG: --runonce="false" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488944 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488947 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488950 2556 flags.go:64] FLAG: --seccomp-default="false" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488953 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488955 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488958 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488961 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488964 2556 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488967 2556 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488970 2556 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488972 2556 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488975 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488978 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488981 2556 flags.go:64] FLAG: --system-cgroups="" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488983 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488988 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488991 2556 flags.go:64] FLAG: --tls-cert-file="" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488994 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.488998 2556 flags.go:64] FLAG: --tls-min-version="" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489000 2556 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489003 2556 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489006 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 10:34:37.495696 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489008 2556 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489011 2556 flags.go:64] FLAG: --v="2" Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489015 2556 flags.go:64] FLAG: --version="false" Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489019 2556 flags.go:64] FLAG: --vmodule="" Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489022 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.489025 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489164 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489168 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489173 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489176 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489180 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489182 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489185 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489188 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489191 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489193 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489196 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489198 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489201 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489203 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489207 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 10:34:37.496388 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489210 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489212 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489215 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489218 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489220 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489223 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489225 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489228 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489230 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489233 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489235 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489238 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489240 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489243 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489246 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489249 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489251 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489254 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489257 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489260 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 10:34:37.496933 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489263 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489265 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489268 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489270 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489273 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489275 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489278 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489280 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489283 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489285 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489288 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489292 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489294 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489297 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489300 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489302 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489305 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489308 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489310 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489313 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 10:34:37.497434 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489315 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489318 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489320 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489323 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489325 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489328 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489330 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489332 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489336 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489338 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489341 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489345 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489347 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489350 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489352 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489354 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489357 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489359 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489362 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 10:34:37.497924 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489366 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489369 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489372 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489376 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489380 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489383 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489386 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489388 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489391 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489394 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489396 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489400 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489404 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489408 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489411 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489413 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489416 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489418 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489421 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 10:34:37.498402 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489423 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489426 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489428 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489431 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489434 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.489437 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.490112 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497061 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497076 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497108 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497114 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497172 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497178 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497182 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 10:34:37.498862 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497186 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497189 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497191 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497194 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497196 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497199 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497202 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497204 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497207 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497210 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497212 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497215 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497217 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497220 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497222 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497225 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497227 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497230 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497233 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 10:34:37.499240 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497235 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497238 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497240 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497243 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497246 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497248 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497251 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497255 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497258 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497260 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497263 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497266 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497268 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497271 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497273 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497275 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497278 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497281 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497283 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497286 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 10:34:37.499724 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497288 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497291 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497293 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497296 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497298 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497301 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497303 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497306 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497308 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497311 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497314 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497316 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497319 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497321 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497323 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497326 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497329 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497331 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497336 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 10:34:37.500263 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497339 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497349 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497352 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497355 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497357 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497360 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497362 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497366 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497368 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497371 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497373 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497376 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497378 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497381 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497383 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497386 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497388 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497391 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497393 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497396 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 10:34:37.500747 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497398 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497401 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497403 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497406 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497408 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497411 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497415 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497417 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497420 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497423 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497425 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497428 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497431 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497433 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497436 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497439 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497441 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 10:34:37.501248 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497444 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497449 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497576 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497580 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497582 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497585 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497588 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497590 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497593 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497595 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497598 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497601 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497603 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497606 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497608 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 10:34:37.501657 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497611 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497613 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497616 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497618 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497621 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497623 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497626 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497628 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497631 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497633 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497635 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497639 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497641 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497644 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497646 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497649 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497652 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497654 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497657 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497659 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 10:34:37.502028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497662 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497664 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497667 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497669 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497673 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497677 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497680 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497682 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497685 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497688 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497690 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497693 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497695 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497698 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497700 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497703 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497705 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497708 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497710 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 10:34:37.502525 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497712 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497715 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497717 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497720 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497723 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497725 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497728 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497730 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497733 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497736 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497738 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497741 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497743 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497746 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497748 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497751 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497753 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497756 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497759 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497762 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 10:34:37.503028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497765 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497767 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497770 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497774 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497777 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497780 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497783 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497786 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497789 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497791 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497794 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497797 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497800 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497802 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497805 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497807 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497810 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497812 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497815 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 10:34:37.503545 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497817 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497820 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497822 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497825 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497828 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497830 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497833 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:37.497835 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497840 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.497964 2556 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.499442 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.500493 2556 server.go:1019] "Starting client certificate rotation" Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.500588 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 10:34:37.503999 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.500615 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 10:34:37.504387 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.502990 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 10:34:37.506381 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.506368 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 10:34:37.516416 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.516393 2556 log.go:25] "Validated CRI v1 runtime API" Sep 10 10:34:37.519466 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.519444 2556 log.go:25] "Validated CRI v1 image API" Sep 10 10:34:37.521501 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.521485 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 10:34:37.524706 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.524687 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af540971-7fa4-40b7-b0b8-d428ebf8a5b0:/dev/nvme0n1p3 b101ce0f-cb7e-491f-80d9-7ecb8eb0a8e8:/dev/nvme0n1p4] Sep 10 10:34:37.524783 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.524706 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 10:34:37.529592 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.529483 2556 manager.go:216] Machine: {Timestamp:2026-09-10 10:34:37.528192945 +0000 UTC m=+0.334259630 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107223 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2910193b40a30e6bea7f789e912c58 SystemUUID:ec291019-3b40-a30e-6bea-7f789e912c58 BootID:7099d72b-70d0-443b-8793-08eeb53e5da8 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:a7:07:ee:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:a7:07:ee:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:18:ef:d1:d0:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 10:34:37.529592 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.529580 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 10:34:37.529713 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.529674 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 10:34:37.531891 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.531875 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 10:34:37.532765 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.532737 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 10:34:37.532900 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.532769 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 10:34:37.534065 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.534053 2556 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 10:34:37.534065 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.534066 2556 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 10:34:37.534165 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.534074 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 10:34:37.534796 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.534786 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 10:34:37.535687 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.535676 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 10:34:37.539039 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539028 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 10 10:34:37.539166 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539156 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 10:34:37.539198 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539184 2556 kubelet.go:486] "Attempting to sync node with API server" Sep 10 10:34:37.539198 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539193 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 10:34:37.539255 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539210 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 10:34:37.539255 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539220 2556 kubelet.go:398] "Adding apiserver pod source" Sep 10 10:34:37.539255 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539229 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 10:34:37.539563 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539552 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 10:34:37.539602 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.539570 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 10:34:37.541815 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.541798 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 10:34:37.544148 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544136 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 10:34:37.544196 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544165 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 10:34:37.544937 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544925 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 10:34:37.544978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544941 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 10:34:37.544978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544947 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 10:34:37.544978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544955 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 10:34:37.544978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544963 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 10:34:37.544978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544968 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 10:34:37.544978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544981 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 10:34:37.545146 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544987 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 10:34:37.545146 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544993 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 10:34:37.545146 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.544998 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 10:34:37.545146 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.545006 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 10:34:37.545146 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.545011 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 10:34:37.546412 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.546398 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 10:34:37.546445 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.546416 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 10:34:37.550230 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.550214 2556 server.go:1268] "Started kubelet" Sep 10 10:34:37.550350 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.550302 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 10:34:37.550409 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.550362 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 10:34:37.550445 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.550434 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 10:34:37.550877 ip-10-0-143-147 systemd[1]: Started Kubernetes Kubelet. Sep 10 10:34:37.551965 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.551523 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 10:34:37.552033 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.551996 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 10:34:37.552132 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.552116 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 10:34:37.553514 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.552641 2556 server.go:310] "Adding debug handlers to kubelet server" Sep 10 10:34:37.553826 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.553694 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 10:34:37.555640 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.555618 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 10:34:37.558391 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.557524 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-147.ec2.internal.18d3ef3296985229 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-147.ec2.internal,UID:ip-10-0-143-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-147.ec2.internal,},FirstTimestamp:2026-09-10 10:34:37.550187049 +0000 UTC m=+0.356253734,LastTimestamp:2026-09-10 10:34:37.550187049 +0000 UTC m=+0.356253734,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-147.ec2.internal,}" Sep 10 10:34:37.558669 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.558655 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 10:34:37.559226 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559198 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 10:34:37.559314 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.559302 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:37.559779 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559738 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 10:34:37.559779 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559751 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 10:34:37.559779 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559766 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 10:34:37.559954 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559865 2556 reconstruct.go:97] "Volume reconstruction finished" Sep 10 10:34:37.559954 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559875 2556 reconciler.go:29] "Reconciler: start to sync state" Sep 10 10:34:37.560061 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.559994 2556 factory.go:55] Registering systemd factory Sep 10 10:34:37.560061 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.560004 2556 factory.go:223] Registration of the systemd container factory successfully Sep 10 10:34:37.560199 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.560176 2556 factory.go:153] Registering CRI-O factory Sep 10 10:34:37.560199 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.560192 2556 factory.go:223] Registration of the crio container factory successfully Sep 10 10:34:37.560348 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.560235 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 10:34:37.560348 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.560249 2556 factory.go:103] Registering Raw factory Sep 10 10:34:37.560348 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.560259 2556 manager.go:1196] Started watching for new ooms in manager Sep 10 10:34:37.561614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.561582 2556 manager.go:349] Starting recovery of all containers Sep 10 10:34:37.565820 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.565195 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 10:34:37.565820 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.565298 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 10:34:37.573701 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.573685 2556 manager.go:354] Recovery completed Sep 10 10:34:37.575753 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.574805 2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 10 10:34:37.577653 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.577638 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.579180 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579164 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.579265 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579197 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.579265 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579212 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.579797 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579781 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 10:34:37.579797 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579795 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 10:34:37.579915 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579800 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.579915 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.579811 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 10 10:34:37.580488 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.580469 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.580557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.580501 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.580557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.580515 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.581202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.581183 2556 policy_none.go:49] "None policy: Start" Sep 10 10:34:37.581202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.581203 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 10:34:37.581347 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.581214 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 10:34:37.581452 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.581365 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-147.ec2.internal.18d3ef329852bb8c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-147.ec2.internal,UID:ip-10-0-143-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-147.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-147.ec2.internal,},FirstTimestamp:2026-09-10 10:34:37.57918094 +0000 UTC m=+0.385247625,LastTimestamp:2026-09-10 10:34:37.57918094 +0000 UTC m=+0.385247625,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-147.ec2.internal,}" Sep 10 10:34:37.582265 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.582251 2556 policy_none.go:47] "Start" Sep 10 10:34:37.582725 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.582710 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vxl9d" Sep 10 10:34:37.590986 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.590966 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vxl9d" Sep 10 10:34:37.592653 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.592567 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-147.ec2.internal.18d3ef32985314bb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-147.ec2.internal,UID:ip-10-0-143-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-147.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-147.ec2.internal,},FirstTimestamp:2026-09-10 10:34:37.579203771 +0000 UTC m=+0.385270457,LastTimestamp:2026-09-10 10:34:37.579203771 +0000 UTC m=+0.385270457,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-147.ec2.internal,}" Sep 10 10:34:37.611764 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.611751 2556 manager.go:337] "Starting Device Plugin manager" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.611791 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.611800 2556 server.go:87] "Starting device plugin registration server" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.611989 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.612001 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.612087 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.612173 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.612182 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.612755 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 10:34:37.626697 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.612791 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:37.701520 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.701493 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 10:34:37.702655 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.702638 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 10:34:37.702744 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.702682 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 10:34:37.702744 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.702702 2556 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 10:34:37.702744 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.702734 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 10:34:37.705081 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.705066 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 10:34:37.712795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.712778 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.713537 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.713519 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.713614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.713552 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.713614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.713565 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.713614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.713589 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.724053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.724039 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.724144 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.724057 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-147.ec2.internal\": node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:37.748887 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.748834 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:37.802816 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.802796 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal"] Sep 10 10:34:37.802887 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.802854 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.804210 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.804197 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.804271 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.804222 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.804271 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.804231 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.805680 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.805669 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.805802 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.805787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.805848 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.805820 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.806350 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.806330 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.806447 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.806356 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.806447 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.806366 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.806447 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.806335 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.806447 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.806439 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.806623 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.806456 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.808169 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.808149 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.808169 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.808184 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:37.809236 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.809209 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:37.809338 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.809240 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:37.809338 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.809255 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:37.833688 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.833663 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-147.ec2.internal\" not found" node="ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.837987 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.837971 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-147.ec2.internal\" not found" node="ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.849291 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.849276 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:37.861829 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.861809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f9d76cfc3da1d9db70bee1ecff03cab-config\") pod \"kube-apiserver-proxy-ip-10-0-143-147.ec2.internal\" (UID: \"2f9d76cfc3da1d9db70bee1ecff03cab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.861898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.861831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0664e44094243a39d3c8615d0c8c663-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal\" (UID: \"e0664e44094243a39d3c8615d0c8c663\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.861898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.861848 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0664e44094243a39d3c8615d0c8c663-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal\" (UID: \"e0664e44094243a39d3c8615d0c8c663\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.949671 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:37.949653 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:37.961922 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.961896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0664e44094243a39d3c8615d0c8c663-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal\" (UID: \"e0664e44094243a39d3c8615d0c8c663\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.962004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.961932 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0664e44094243a39d3c8615d0c8c663-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal\" (UID: \"e0664e44094243a39d3c8615d0c8c663\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.962004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.961949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f9d76cfc3da1d9db70bee1ecff03cab-config\") pod \"kube-apiserver-proxy-ip-10-0-143-147.ec2.internal\" (UID: \"2f9d76cfc3da1d9db70bee1ecff03cab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.962004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.961978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e0664e44094243a39d3c8615d0c8c663-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal\" (UID: \"e0664e44094243a39d3c8615d0c8c663\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.962004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.961990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0664e44094243a39d3c8615d0c8c663-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal\" (UID: \"e0664e44094243a39d3c8615d0c8c663\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:37.962004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:37.961981 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f9d76cfc3da1d9db70bee1ecff03cab-config\") pod \"kube-apiserver-proxy-ip-10-0-143-147.ec2.internal\" (UID: \"2f9d76cfc3da1d9db70bee1ecff03cab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" Sep 10 10:34:38.050330 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.050285 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.135791 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.135756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:38.141285 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.140795 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" Sep 10 10:34:38.150601 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.150581 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.251228 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.251083 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.351599 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.351551 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.407561 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.407545 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 10:34:38.454860 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.454840 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.501688 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.501672 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 10:34:38.502047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.501785 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 10:34:38.502047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.501819 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 10:34:38.555820 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.555799 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.595538 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.595493 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 10:29:38 +0000 UTC" deadline="2028-04-22 20:02:17.793736324 +0000 UTC" Sep 10 10:34:38.595538 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.595531 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14169h27m39.198208528s" Sep 10 10:34:38.656514 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.656459 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.757061 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.757034 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.765480 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.765463 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 10:34:38.766494 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.766473 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientMemory" Sep 10 10:34:38.766589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.766506 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 10:34:38.766589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.766517 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeHasSufficientPID" Sep 10 10:34:38.802376 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:38.802348 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9d76cfc3da1d9db70bee1ecff03cab.slice/crio-9d0e687b83b4b9d3e26c6b5546b5caddf07432c592de12719cd524ddab955110 WatchSource:0}: Error finding container 9d0e687b83b4b9d3e26c6b5546b5caddf07432c592de12719cd524ddab955110: Status 404 returned error can't find the container with id 9d0e687b83b4b9d3e26c6b5546b5caddf07432c592de12719cd524ddab955110 Sep 10 10:34:38.802895 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:38.802870 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0664e44094243a39d3c8615d0c8c663.slice/crio-82ace51d9a375cf1395d39ba4d79aae448d94f6fbd31d63edcd8a418ec841348 WatchSource:0}: Error finding container 82ace51d9a375cf1395d39ba4d79aae448d94f6fbd31d63edcd8a418ec841348: Status 404 returned error can't find the container with id 82ace51d9a375cf1395d39ba4d79aae448d94f6fbd31d63edcd8a418ec841348 Sep 10 10:34:38.807537 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.807521 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 10:34:38.859212 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:38.859191 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-147.ec2.internal\" not found" Sep 10 10:34:38.911947 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.911906 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 10:34:38.961904 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.961885 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" Sep 10 10:34:38.977588 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.977573 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 10:34:38.979816 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.979803 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" Sep 10 10:34:38.991309 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:38.991290 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 10:34:39.031246 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.031228 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 10:34:39.540437 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.540411 2556 apiserver.go:52] "Watching apiserver" Sep 10 10:34:39.549084 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.549059 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 10:34:39.550230 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.550199 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-srhsr","openshift-cluster-node-tuning-operator/tuned-ptfpj","openshift-image-registry/node-ca-gcmh4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal","openshift-multus/multus-additional-cni-plugins-7bvdl","openshift-ovn-kubernetes/ovnkube-node-ggnbq","kube-system/global-pull-secret-syncer-rnkj7","kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw","openshift-dns/node-resolver-2zpbg","openshift-multus/multus-qpzpl","openshift-multus/network-metrics-daemon-cwjm6","openshift-network-diagnostics/network-check-target-c72pg","openshift-network-operator/iptables-alerter-t9j6j"] Sep 10 10:34:39.552147 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.552126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.553812 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.553479 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:39.553812 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.553561 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:39.555152 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.555129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.555461 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.555334 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.555552 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.555491 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vtxft\"" Sep 10 10:34:39.556227 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.555947 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.557249 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.557153 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.558211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.558185 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 10:34:39.560229 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.558399 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tlxlw\"" Sep 10 10:34:39.560229 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.558594 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.560229 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.558624 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.564577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.561077 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.564577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.561344 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 10:34:39.564577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.564014 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.564577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.564460 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vn5vc\"" Sep 10 10:34:39.565101 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.564689 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.565101 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.564844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.565101 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.564875 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 10:34:39.565826 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.565649 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.565826 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.565666 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.565986 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.565931 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 10:34:39.566550 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.566530 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 10:34:39.568017 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.567986 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdsd6\"" Sep 10 10:34:39.568658 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.568639 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.569414 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.569395 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ttcw4\"" Sep 10 10:34:39.569591 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.569574 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 10:34:39.570055 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.570037 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.570638 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.570617 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 10:34:39.570816 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.570799 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.571010 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.570992 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 10:34:39.571266 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571249 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 10:34:39.571347 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4e5221e-de38-4cd6-8f2e-fd063c40d300-iptables-alerter-script\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.571347 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4e5221e-de38-4cd6-8f2e-fd063c40d300-host-slash\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.571462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cnibin\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.571462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.571462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-systemd\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.571462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571433 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovn-node-metrics-cert\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.571462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj8qx\" (UniqueName: \"kubernetes.io/projected/3bc0df36-7279-4352-9fb6-cb02e3d17a16-kube-api-access-tj8qx\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571482 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571507 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw82b\" (UniqueName: \"kubernetes.io/projected/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-kube-api-access-vw82b\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-kubelet\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.571691 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovnkube-config\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4psq\" (UniqueName: \"kubernetes.io/projected/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-kube-api-access-q4psq\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42fw9\" (UniqueName: \"kubernetes.io/projected/a4e5221e-de38-4cd6-8f2e-fd063c40d300-kube-api-access-42fw9\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-slash\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-node-log\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovnkube-script-lib\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-serviceca\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-run-netns\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-var-lib-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-log-socket\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.571994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572034 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572080 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bc0df36-7279-4352-9fb6-cb02e3d17a16-hosts-file\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.572131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc0df36-7279-4352-9fb6-cb02e3d17a16-tmp-dir\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572158 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-ovn\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9l7\" (UniqueName: \"kubernetes.io/projected/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-kube-api-access-5w9l7\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572079 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572189 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jxt8p\"" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-systemd-units\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-cni-bin\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572321 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-env-overrides\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-host\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-cni-netd\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.572979 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.572441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-etc-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.573660 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.573073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.573660 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.573169 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:39.574747 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.574728 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.576876 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.576443 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.578287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.577842 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:34:39.578287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.578067 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 10:34:39.578287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.578209 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r7mlz\"" Sep 10 10:34:39.579328 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.578620 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.579328 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.578723 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 10:34:39.579328 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.579026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ttczd\"" Sep 10 10:34:39.579328 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.579108 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 10:34:39.579636 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.579580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:39.579694 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.579645 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:39.581556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.581529 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pbpl7\"" Sep 10 10:34:39.581635 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.581589 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 10:34:39.581810 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.581791 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 10:34:39.611469 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.611445 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q5bcx" Sep 10 10:34:39.624493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.624472 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q5bcx" Sep 10 10:34:39.660414 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.660394 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 10:34:39.673221 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-cni-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.673326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ctl7\" (UniqueName: \"kubernetes.io/projected/b96fbb0c-ffd8-4108-b549-63268fba21e9-kube-api-access-2ctl7\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:39.673326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj8qx\" (UniqueName: \"kubernetes.io/projected/3bc0df36-7279-4352-9fb6-cb02e3d17a16-kube-api-access-tj8qx\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.673326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw82b\" (UniqueName: \"kubernetes.io/projected/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-kube-api-access-vw82b\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-kubelet\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovnkube-config\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673425 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-system-cni-dir\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.673489 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673475 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-kubelet\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf991fb1-c3af-4119-ba10-2ab113c2ea2e-agent-certs\") pod \"konnectivity-agent-srhsr\" (UID: \"cf991fb1-c3af-4119-ba10-2ab113c2ea2e\") " pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4psq\" (UniqueName: \"kubernetes.io/projected/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-kube-api-access-q4psq\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-node-log\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673505 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf991fb1-c3af-4119-ba10-2ab113c2ea2e-konnectivity-ca\") pod \"konnectivity-agent-srhsr\" (UID: \"cf991fb1-c3af-4119-ba10-2ab113c2ea2e\") " pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673674 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-lib-modules\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-node-log\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673722 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-cni-bin\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-serviceca\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-sys\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673802 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-host\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bc0df36-7279-4352-9fb6-cb02e3d17a16-hosts-file\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.673860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673855 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc0df36-7279-4352-9fb6-cb02e3d17a16-tmp-dir\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673880 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-ovn\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9l7\" (UniqueName: \"kubernetes.io/projected/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-kube-api-access-5w9l7\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3bc0df36-7279-4352-9fb6-cb02e3d17a16-hosts-file\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-sys-fs\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.673976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-ovn\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-device-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysctl-conf\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674063 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5p54\" (UniqueName: \"kubernetes.io/projected/96a0671c-73e8-4cbf-b8a7-f967f232613a-kube-api-access-z5p54\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674089 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-socket-dir-parent\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovnkube-config\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-hostroot\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-cni-netd\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674224 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-serviceca\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674260 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-etc-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-systemd\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-daemon-config\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.674646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674333 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-etc-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674303 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-cni-netd\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4e5221e-de38-4cd6-8f2e-fd063c40d300-host-slash\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674399 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cnibin\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674403 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bc0df36-7279-4352-9fb6-cb02e3d17a16-tmp-dir\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674444 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-systemd\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovn-node-metrics-cert\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-k8s-cni-cncf-io\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674525 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-netns\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-run-systemd\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-conf-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674548 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cnibin\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674603 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4e5221e-de38-4cd6-8f2e-fd063c40d300-host-slash\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-multus-certs\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovnkube-script-lib\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-registration-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.675589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-tuned\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-system-cni-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.674964 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-cnibin\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hj5q\" (UniqueName: \"kubernetes.io/projected/cf37d1e7-5be3-42b0-b562-c7472cf86966-kube-api-access-7hj5q\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675075 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42fw9\" (UniqueName: \"kubernetes.io/projected/a4e5221e-de38-4cd6-8f2e-fd063c40d300-kube-api-access-42fw9\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-slash\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-cni-multus\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675240 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-run-netns\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-var-lib-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-log-socket\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-kubelet\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.676485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysconfig\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675448 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovnkube-script-lib\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675493 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-run-netns\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ed4c76f-8059-4a53-969d-cc5b62a4e493-dbus\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96a0671c-73e8-4cbf-b8a7-f967f232613a-tmp\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-systemd-units\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-cni-bin\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-slash\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-env-overrides\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-host-cni-bin\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-kubernetes\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675800 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-var-lib-openvswitch\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-log-socket\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-host\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.677322 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrpww\" (UniqueName: \"kubernetes.io/projected/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-kube-api-access-mrpww\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-systemd-units\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf37d1e7-5be3-42b0-b562-c7472cf86966-cni-binary-copy\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675963 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.675970 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-host\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-etc-kubernetes\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-socket-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-modprobe-d\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676317 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-run\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676341 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-var-lib-kubelet\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4e5221e-de38-4cd6-8f2e-fd063c40d300-iptables-alerter-script\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676422 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676446 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-env-overrides\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ed4c76f-8059-4a53-969d-cc5b62a4e493-kubelet-config\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.677892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676588 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.678529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676708 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysctl-d\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.678529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.676999 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4e5221e-de38-4cd6-8f2e-fd063c40d300-iptables-alerter-script\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.678529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.677054 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.679148 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.679130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-ovn-node-metrics-cert\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.682466 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.682439 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:34:39.682596 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.682487 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:34:39.682596 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.682503 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:39.682596 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.682563 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:34:40.182538979 +0000 UTC m=+2.988605652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:39.686312 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.685682 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9l7\" (UniqueName: \"kubernetes.io/projected/58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a-kube-api-access-5w9l7\") pod \"ovnkube-node-ggnbq\" (UID: \"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.686312 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.685791 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj8qx\" (UniqueName: \"kubernetes.io/projected/3bc0df36-7279-4352-9fb6-cb02e3d17a16-kube-api-access-tj8qx\") pod \"node-resolver-2zpbg\" (UID: \"3bc0df36-7279-4352-9fb6-cb02e3d17a16\") " pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.686312 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.685902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw82b\" (UniqueName: \"kubernetes.io/projected/b08b751d-ba65-4665-bbef-1ac8d98d4ba3-kube-api-access-vw82b\") pod \"multus-additional-cni-plugins-7bvdl\" (UID: \"b08b751d-ba65-4665-bbef-1ac8d98d4ba3\") " pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.686492 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.686340 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42fw9\" (UniqueName: \"kubernetes.io/projected/a4e5221e-de38-4cd6-8f2e-fd063c40d300-kube-api-access-42fw9\") pod \"iptables-alerter-t9j6j\" (UID: \"a4e5221e-de38-4cd6-8f2e-fd063c40d300\") " pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.688238 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.686728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4psq\" (UniqueName: \"kubernetes.io/projected/43dcdf8f-1ed0-414a-ab8c-45d6595436c7-kube-api-access-q4psq\") pod \"node-ca-gcmh4\" (UID: \"43dcdf8f-1ed0-414a-ab8c-45d6595436c7\") " pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.708298 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.708250 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" event={"ID":"2f9d76cfc3da1d9db70bee1ecff03cab","Type":"ContainerStarted","Data":"9d0e687b83b4b9d3e26c6b5546b5caddf07432c592de12719cd524ddab955110"} Sep 10 10:34:39.709639 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.709605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" event={"ID":"e0664e44094243a39d3c8615d0c8c663","Type":"ContainerStarted","Data":"82ace51d9a375cf1395d39ba4d79aae448d94f6fbd31d63edcd8a418ec841348"} Sep 10 10:34:39.777361 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-sys-fs\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-device-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysctl-conf\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5p54\" (UniqueName: \"kubernetes.io/projected/96a0671c-73e8-4cbf-b8a7-f967f232613a-kube-api-access-z5p54\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-socket-dir-parent\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-hostroot\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-systemd\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777473 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-sys-fs\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777473 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-device-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.777524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-daemon-config\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-k8s-cni-cncf-io\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777552 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysctl-conf\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-netns\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777587 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-socket-dir-parent\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777601 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-conf-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777633 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-hostroot\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777640 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-conf-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777681 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-netns\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777692 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-systemd\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-k8s-cni-cncf-io\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-multus-certs\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-registration-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-tuned\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777825 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-system-cni-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777833 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-run-multus-certs\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-registration-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-cnibin\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hj5q\" (UniqueName: \"kubernetes.io/projected/cf37d1e7-5be3-42b0-b562-c7472cf86966-kube-api-access-7hj5q\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-cnibin\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-cni-multus\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-daemon-config\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-kubelet\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778101 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-kubelet\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysconfig\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ed4c76f-8059-4a53-969d-cc5b62a4e493-dbus\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96a0671c-73e8-4cbf-b8a7-f967f232613a-tmp\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.777935 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-system-cni-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-cni-multus\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778316 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysconfig\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.778328 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.778936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778352 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ed4c76f-8059-4a53-969d-cc5b62a4e493-dbus\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.778406 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:40.278387126 +0000 UTC m=+3.084453839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-kubernetes\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrpww\" (UniqueName: \"kubernetes.io/projected/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-kube-api-access-mrpww\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778479 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf37d1e7-5be3-42b0-b562-c7472cf86966-cni-binary-copy\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-etc-kubernetes\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-socket-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-kubernetes\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-modprobe-d\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-run\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-etc-kubernetes\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778674 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-var-lib-kubelet\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ed4c76f-8059-4a53-969d-cc5b62a4e493-kubelet-config\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysctl-d\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778750 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-socket-dir\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-cni-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.779871 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-var-lib-kubelet\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.778802 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778815 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-run\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:39.778847 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:40.278832464 +0000 UTC m=+3.084899157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ctl7\" (UniqueName: \"kubernetes.io/projected/b96fbb0c-ffd8-4108-b549-63268fba21e9-kube-api-access-2ctl7\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-sysctl-d\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf991fb1-c3af-4119-ba10-2ab113c2ea2e-agent-certs\") pod \"konnectivity-agent-srhsr\" (UID: \"cf991fb1-c3af-4119-ba10-2ab113c2ea2e\") " pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778934 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ed4c76f-8059-4a53-969d-cc5b62a4e493-kubelet-config\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778938 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf991fb1-c3af-4119-ba10-2ab113c2ea2e-konnectivity-ca\") pod \"konnectivity-agent-srhsr\" (UID: \"cf991fb1-c3af-4119-ba10-2ab113c2ea2e\") " pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778974 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-lib-modules\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-cni-bin\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.778748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-modprobe-d\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779041 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-host-var-lib-cni-bin\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-sys\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-host\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779135 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf37d1e7-5be3-42b0-b562-c7472cf86966-multus-cni-dir\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779198 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-sys\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-host\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.780758 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779293 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96a0671c-73e8-4cbf-b8a7-f967f232613a-lib-modules\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.781560 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779357 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf37d1e7-5be3-42b0-b562-c7472cf86966-cni-binary-copy\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.781560 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.779535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf991fb1-c3af-4119-ba10-2ab113c2ea2e-konnectivity-ca\") pod \"konnectivity-agent-srhsr\" (UID: \"cf991fb1-c3af-4119-ba10-2ab113c2ea2e\") " pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.781560 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.780954 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96a0671c-73e8-4cbf-b8a7-f967f232613a-tmp\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.781560 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.781470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96a0671c-73e8-4cbf-b8a7-f967f232613a-etc-tuned\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.782048 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.782023 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf991fb1-c3af-4119-ba10-2ab113c2ea2e-agent-certs\") pod \"konnectivity-agent-srhsr\" (UID: \"cf991fb1-c3af-4119-ba10-2ab113c2ea2e\") " pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.791191 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.790862 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hj5q\" (UniqueName: \"kubernetes.io/projected/cf37d1e7-5be3-42b0-b562-c7472cf86966-kube-api-access-7hj5q\") pod \"multus-qpzpl\" (UID: \"cf37d1e7-5be3-42b0-b562-c7472cf86966\") " pod="openshift-multus/multus-qpzpl" Sep 10 10:34:39.791837 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.791795 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5p54\" (UniqueName: \"kubernetes.io/projected/96a0671c-73e8-4cbf-b8a7-f967f232613a-kube-api-access-z5p54\") pod \"tuned-ptfpj\" (UID: \"96a0671c-73e8-4cbf-b8a7-f967f232613a\") " pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.792545 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.792522 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ctl7\" (UniqueName: \"kubernetes.io/projected/b96fbb0c-ffd8-4108-b549-63268fba21e9-kube-api-access-2ctl7\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:39.792778 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.792749 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrpww\" (UniqueName: \"kubernetes.io/projected/02f4ede7-72f2-4cc2-aa88-b37cea0077ba-kube-api-access-mrpww\") pod \"aws-ebs-csi-driver-node-qxxtw\" (UID: \"02f4ede7-72f2-4cc2-aa88-b37cea0077ba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.871864 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.871838 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zpbg" Sep 10 10:34:39.881262 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.881240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcmh4" Sep 10 10:34:39.892373 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.892346 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9j6j" Sep 10 10:34:39.900340 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.900320 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" Sep 10 10:34:39.908612 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.908595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:34:39.916600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.916582 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" Sep 10 10:34:39.925635 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.925617 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" Sep 10 10:34:39.933847 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.933824 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:34:39.940566 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:39.940547 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpzpl" Sep 10 10:34:40.029805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:40.029782 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 10:34:40.282399 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:40.282312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:40.282399 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:40.282366 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:40.282631 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282497 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:40.282631 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:40.282512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:40.282631 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282580 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:41.28255916 +0000 UTC m=+4.088625833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:40.282802 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282666 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:40.282802 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282704 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:34:40.282802 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282723 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:41.282710463 +0000 UTC m=+4.088777142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:40.282802 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282728 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:34:40.282802 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282742 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:40.282802 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:40.282790 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:34:41.282774661 +0000 UTC m=+4.088841351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:40.627198 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:40.627106 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 10:29:40 +0000 UTC" deadline="2028-06-14 14:34:45.311164384 +0000 UTC" Sep 10 10:34:40.627198 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:40.627147 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15436h0m4.684024789s" Sep 10 10:34:40.758693 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.758646 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08b751d_ba65_4665_bbef_1ac8d98d4ba3.slice/crio-a2f15389943e68fbfbd42d1a38951bd393e6d403e3fe4ea5c5bd108a2f3ee4c4 WatchSource:0}: Error finding container a2f15389943e68fbfbd42d1a38951bd393e6d403e3fe4ea5c5bd108a2f3ee4c4: Status 404 returned error can't find the container with id a2f15389943e68fbfbd42d1a38951bd393e6d403e3fe4ea5c5bd108a2f3ee4c4 Sep 10 10:34:40.759064 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.759040 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e5221e_de38_4cd6_8f2e_fd063c40d300.slice/crio-3100370d2414b4297e7d859a9e894548f81f087edd5dc641fd77ddcb100edcee WatchSource:0}: Error finding container 3100370d2414b4297e7d859a9e894548f81f087edd5dc641fd77ddcb100edcee: Status 404 returned error can't find the container with id 3100370d2414b4297e7d859a9e894548f81f087edd5dc641fd77ddcb100edcee Sep 10 10:34:40.764028 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.763985 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf991fb1_c3af_4119_ba10_2ab113c2ea2e.slice/crio-fb90b268f83037650df19ecac16140735893727cf720238b22d3960ba22e2280 WatchSource:0}: Error finding container fb90b268f83037650df19ecac16140735893727cf720238b22d3960ba22e2280: Status 404 returned error can't find the container with id fb90b268f83037650df19ecac16140735893727cf720238b22d3960ba22e2280 Sep 10 10:34:40.765967 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.765946 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a0671c_73e8_4cbf_b8a7_f967f232613a.slice/crio-117dbd82a02305434d5690cbb47d36dd74b63e36dfa9d2ad4c63442904b509be WatchSource:0}: Error finding container 117dbd82a02305434d5690cbb47d36dd74b63e36dfa9d2ad4c63442904b509be: Status 404 returned error can't find the container with id 117dbd82a02305434d5690cbb47d36dd74b63e36dfa9d2ad4c63442904b509be Sep 10 10:34:40.767773 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.767741 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf37d1e7_5be3_42b0_b562_c7472cf86966.slice/crio-061abd518e4730f386ff60608f3c0e4ab85de7bd2846e01880648bfb9d3ae4e0 WatchSource:0}: Error finding container 061abd518e4730f386ff60608f3c0e4ab85de7bd2846e01880648bfb9d3ae4e0: Status 404 returned error can't find the container with id 061abd518e4730f386ff60608f3c0e4ab85de7bd2846e01880648bfb9d3ae4e0 Sep 10 10:34:40.769462 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.769440 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f4ede7_72f2_4cc2_aa88_b37cea0077ba.slice/crio-a077468d12fed32fc197d7bbf866edb534585809e06f6963f656d4f39adce085 WatchSource:0}: Error finding container a077468d12fed32fc197d7bbf866edb534585809e06f6963f656d4f39adce085: Status 404 returned error can't find the container with id a077468d12fed32fc197d7bbf866edb534585809e06f6963f656d4f39adce085 Sep 10 10:34:40.770536 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.770510 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43dcdf8f_1ed0_414a_ab8c_45d6595436c7.slice/crio-841d973461f9014f8d68f0507320d0817d20d582d97b36561987e46565c040de WatchSource:0}: Error finding container 841d973461f9014f8d68f0507320d0817d20d582d97b36561987e46565c040de: Status 404 returned error can't find the container with id 841d973461f9014f8d68f0507320d0817d20d582d97b36561987e46565c040de Sep 10 10:34:40.771274 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:34:40.770989 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc0df36_7279_4352_9fb6_cb02e3d17a16.slice/crio-c562f3defbcc534210d9b0c03f55d88747937add11958c8f25f44ee99060f37e WatchSource:0}: Error finding container c562f3defbcc534210d9b0c03f55d88747937add11958c8f25f44ee99060f37e: Status 404 returned error can't find the container with id c562f3defbcc534210d9b0c03f55d88747937add11958c8f25f44ee99060f37e Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.289438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.289741 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.289785 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.289805 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.289887 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:43.289866082 +0000 UTC m=+6.095932762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.289924 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.289942 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.289955 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.290008 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:34:43.289991158 +0000 UTC m=+6.096057836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.290077 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:41.290226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.290108 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:43.29009831 +0000 UTC m=+6.096164984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:41.628365 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.627399 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 10:29:40 +0000 UTC" deadline="2028-05-20 00:50:07.49882803 +0000 UTC" Sep 10 10:34:41.628365 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.627466 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14822h15m25.871366616s" Sep 10 10:34:41.680679 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.680465 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 10:34:41.705016 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.704306 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:41.705016 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.704446 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:41.705016 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.704827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:41.705016 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.704918 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:41.705619 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.705467 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:41.705619 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:41.705573 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:41.722565 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.722495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zpbg" event={"ID":"3bc0df36-7279-4352-9fb6-cb02e3d17a16","Type":"ContainerStarted","Data":"c562f3defbcc534210d9b0c03f55d88747937add11958c8f25f44ee99060f37e"} Sep 10 10:34:41.726837 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.726807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" event={"ID":"02f4ede7-72f2-4cc2-aa88-b37cea0077ba","Type":"ContainerStarted","Data":"a077468d12fed32fc197d7bbf866edb534585809e06f6963f656d4f39adce085"} Sep 10 10:34:41.732145 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.732119 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" event={"ID":"96a0671c-73e8-4cbf-b8a7-f967f232613a","Type":"ContainerStarted","Data":"117dbd82a02305434d5690cbb47d36dd74b63e36dfa9d2ad4c63442904b509be"} Sep 10 10:34:41.735059 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.735034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9j6j" event={"ID":"a4e5221e-de38-4cd6-8f2e-fd063c40d300","Type":"ContainerStarted","Data":"3100370d2414b4297e7d859a9e894548f81f087edd5dc641fd77ddcb100edcee"} Sep 10 10:34:41.739108 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.739083 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerStarted","Data":"a2f15389943e68fbfbd42d1a38951bd393e6d403e3fe4ea5c5bd108a2f3ee4c4"} Sep 10 10:34:41.748085 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.748057 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" event={"ID":"2f9d76cfc3da1d9db70bee1ecff03cab","Type":"ContainerStarted","Data":"e49cb7be70120603927d01590ca1d3566c3015231841a2f91b472d1c146f15a6"} Sep 10 10:34:41.759910 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.759867 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"74f49e659cee0349d171dde3a8916822e681786360196659def2b21641866fc3"} Sep 10 10:34:41.765003 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.764974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcmh4" event={"ID":"43dcdf8f-1ed0-414a-ab8c-45d6595436c7","Type":"ContainerStarted","Data":"841d973461f9014f8d68f0507320d0817d20d582d97b36561987e46565c040de"} Sep 10 10:34:41.770908 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.770881 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpzpl" event={"ID":"cf37d1e7-5be3-42b0-b562-c7472cf86966","Type":"ContainerStarted","Data":"061abd518e4730f386ff60608f3c0e4ab85de7bd2846e01880648bfb9d3ae4e0"} Sep 10 10:34:41.777857 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.777829 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srhsr" event={"ID":"cf991fb1-c3af-4119-ba10-2ab113c2ea2e","Type":"ContainerStarted","Data":"fb90b268f83037650df19ecac16140735893727cf720238b22d3960ba22e2280"} Sep 10 10:34:41.778521 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.778464 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-147.ec2.internal" podStartSLOduration=2.778446775 podStartE2EDuration="2.778446775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:41.778000967 +0000 UTC m=+4.584067665" watchObservedRunningTime="2026-09-10 10:34:41.778446775 +0000 UTC m=+4.584513493" Sep 10 10:34:41.791210 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.791040 2556 generic.go:356] "Generic (PLEG): container finished" podID="e0664e44094243a39d3c8615d0c8c663" containerID="58a399a80c9f38e70c36db0fa4fe90d8f8a14fe022ac23382a84a5aca38c7f68" exitCode=0 Sep 10 10:34:41.791210 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:41.791076 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" event={"ID":"e0664e44094243a39d3c8615d0c8c663","Type":"ContainerDied","Data":"58a399a80c9f38e70c36db0fa4fe90d8f8a14fe022ac23382a84a5aca38c7f68"} Sep 10 10:34:42.823494 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:42.823412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" event={"ID":"e0664e44094243a39d3c8615d0c8c663","Type":"ContainerStarted","Data":"45461b9100f2cc4a483dc0158fe459390f44eed4aff6de9cdad4a4c36eb8a9cd"} Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:43.307309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:43.307370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:43.307406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307551 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307574 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307587 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307645 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:34:47.307627498 +0000 UTC m=+10.113694174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307828 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307895 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:47.307876573 +0000 UTC m=+10.113943261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307828 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:43.307985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.307944 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:47.307933189 +0000 UTC m=+10.113999878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:43.705555 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:43.705468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:43.705729 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.705609 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:43.706023 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:43.706002 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:43.706142 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.706119 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:43.706216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:43.706208 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:43.706306 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:43.706285 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:45.704201 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:45.704169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:45.704725 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:45.704294 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:45.704725 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:45.704293 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:45.704725 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:45.704402 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:45.704725 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:45.704169 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:45.704725 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:45.704502 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:47.341989 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:47.341942 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:47.342006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:47.342068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342249 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342264 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342327 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:55.342307614 +0000 UTC m=+18.148374303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342328 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342348 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:34:55.342337842 +0000 UTC m=+18.148404517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342349 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342367 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:47.342458 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.342401 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:34:55.342392224 +0000 UTC m=+18.148458912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:47.705387 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:47.704585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:47.705387 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.704698 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:47.705387 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:47.705048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:47.705387 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.705157 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:47.705387 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:47.705211 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:47.705387 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:47.705286 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:49.703524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:49.703011 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:49.703524 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:49.703159 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:49.703524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:49.703190 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:49.703524 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:49.703325 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:49.703524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:49.703201 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:49.703524 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:49.703426 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:51.703208 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:51.703166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:51.703208 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:51.703188 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:51.703208 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:51.703210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:51.703753 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:51.703291 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:51.703753 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:51.703366 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:51.703753 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:51.703413 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:53.703280 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:53.703244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:53.703689 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:53.703247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:53.703689 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:53.703362 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:53.703689 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:53.703258 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:53.703689 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:53.703423 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:53.703689 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:53.703485 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:55.407779 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:55.407743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:55.407792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:55.407818 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.407898 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.407933 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.407952 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.407958 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:11.407944505 +0000 UTC m=+34.214011192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.407962 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.407963 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.408008 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:35:11.407995118 +0000 UTC m=+34.214061795 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:34:55.408368 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.408028 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:11.408018787 +0000 UTC m=+34.214085462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:34:55.703331 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:55.703253 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:55.703496 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:55.703253 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:55.703496 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.703378 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:55.703496 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.703461 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:55.703496 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:55.703257 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:55.703707 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:55.703572 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:57.704451 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:57.704418 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:57.704451 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:57.704440 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:57.704926 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:57.704548 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:57.704926 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:57.704568 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:57.704926 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:57.704621 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:57.704926 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:57.704671 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:58.862103 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.861782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"eb823f26d5b4e357b1131fd54de7e0575d5648b68b4ed2bb92ff860fff06cd3e"} Sep 10 10:34:58.862792 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.862201 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"d4a2c71ec5eab28fdb0111fd3687d42bb3e316dcc429d86f806fc2db768c919b"} Sep 10 10:34:58.862792 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.862251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"6064db68978ba7dd7dfb8f321ad64f631ea59bcd35802e4bc5963d583a4d0bab"} Sep 10 10:34:58.862792 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.862291 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"7dc97cd88ed5e314418ea0aaad3dc05809c4272492c4d84c8c2885f96b1eca41"} Sep 10 10:34:58.863674 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.863483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcmh4" event={"ID":"43dcdf8f-1ed0-414a-ab8c-45d6595436c7","Type":"ContainerStarted","Data":"0e39bd40ddffab3f2eb29188a5dedfa58c9c681a842516990300a54d54d87aec"} Sep 10 10:34:58.866474 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.866443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpzpl" event={"ID":"cf37d1e7-5be3-42b0-b562-c7472cf86966","Type":"ContainerStarted","Data":"c34f876c01cf22b81eb062bc84cb046ad01338a2512b439e7e5f58709edbf625"} Sep 10 10:34:58.868123 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.868067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-srhsr" event={"ID":"cf991fb1-c3af-4119-ba10-2ab113c2ea2e","Type":"ContainerStarted","Data":"9b8697e325526c7c6126f40d0376f483724b2a2cafe69b696ce82a533bf4c7a3"} Sep 10 10:34:58.869506 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.869482 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zpbg" event={"ID":"3bc0df36-7279-4352-9fb6-cb02e3d17a16","Type":"ContainerStarted","Data":"ac24adb0c7113cb45dddef5a71ece7f228443a2128024b4a42a2fdf50c4e5de1"} Sep 10 10:34:58.871158 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.871132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" event={"ID":"02f4ede7-72f2-4cc2-aa88-b37cea0077ba","Type":"ContainerStarted","Data":"0a3a44b28dfec47d6e3b941e8ee09650dc872ba55ec49999fbbef088cb72aacb"} Sep 10 10:34:58.872636 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.872615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" event={"ID":"96a0671c-73e8-4cbf-b8a7-f967f232613a","Type":"ContainerStarted","Data":"eb385c6517fcdc0d33cbb12340f503806f9b195267cab35d5adee397cb49c645"} Sep 10 10:34:58.874306 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.874284 2556 generic.go:356] "Generic (PLEG): container finished" podID="b08b751d-ba65-4665-bbef-1ac8d98d4ba3" containerID="49afb67ea6597be5ac7ff422d1f2920f599f675d43d70338bb0c117429d2276d" exitCode=0 Sep 10 10:34:58.874403 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.874319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerDied","Data":"49afb67ea6597be5ac7ff422d1f2920f599f675d43d70338bb0c117429d2276d"} Sep 10 10:34:58.878693 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.878658 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gcmh4" podStartSLOduration=3.185232219 podStartE2EDuration="20.878645561s" totalImagesPullingTime="17.693413342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:58.877706867 +0000 UTC m=+21.683773562" watchObservedRunningTime="2026-09-10 10:34:58.878645561 +0000 UTC m=+21.684712282" Sep 10 10:34:58.878769 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.878720 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-147.ec2.internal" podStartSLOduration=19.878716508 podStartE2EDuration="19.878716508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:42.845367189 +0000 UTC m=+5.651433879" watchObservedRunningTime="2026-09-10 10:34:58.878716508 +0000 UTC m=+21.684783214" Sep 10 10:34:58.911435 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.911397 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-srhsr" podStartSLOduration=10.475138654 podStartE2EDuration="20.91138485s" totalImagesPullingTime="10.436246196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:58.911284926 +0000 UTC m=+21.717351610" watchObservedRunningTime="2026-09-10 10:34:58.91138485 +0000 UTC m=+21.717451543" Sep 10 10:34:58.928271 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.928236 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpzpl" podStartSLOduration=3.163922159 podStartE2EDuration="20.928226145s" totalImagesPullingTime="17.764303986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:58.92804492 +0000 UTC m=+21.734111617" watchObservedRunningTime="2026-09-10 10:34:58.928226145 +0000 UTC m=+21.734292849" Sep 10 10:34:58.946459 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.946394 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2zpbg" podStartSLOduration=3.252989598 podStartE2EDuration="20.94638375s" totalImagesPullingTime="17.693394152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:58.946342626 +0000 UTC m=+21.752409320" watchObservedRunningTime="2026-09-10 10:34:58.94638375 +0000 UTC m=+21.752450444" Sep 10 10:34:58.964305 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:58.964277 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ptfpj" podStartSLOduration=3.26302802 podStartE2EDuration="20.96426182s" totalImagesPullingTime="17.7012338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:34:58.964169847 +0000 UTC m=+21.770236541" watchObservedRunningTime="2026-09-10 10:34:58.96426182 +0000 UTC m=+21.770328514" Sep 10 10:34:59.703554 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:59.703525 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:34:59.703806 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:59.703522 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:34:59.703806 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:59.703657 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:34:59.703806 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:59.703678 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:34:59.703981 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:59.703840 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:34:59.703981 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:34:59.703925 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:34:59.879866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:59.879835 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"40d968ea3a455df62293f2c97f669f2540478610dfd4c79d7f877b1d2b505d17"} Sep 10 10:34:59.880309 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:34:59.879919 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"8b8680261e3fc3096fcdb2642d3aae2834bafb9848dbf4203ae2cf54f79365a7"} Sep 10 10:35:00.067811 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.067787 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 10:35:00.623660 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.623554 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T10:35:00.067807634Z","UUID":"385de822-6fee-460a-ae28-f0ade399dbb8","Handler":null,"Name":"","Endpoint":""} Sep 10 10:35:00.625439 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.625417 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 10:35:00.625439 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.625443 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 10:35:00.884699 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.884610 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" event={"ID":"02f4ede7-72f2-4cc2-aa88-b37cea0077ba","Type":"ContainerStarted","Data":"5ad74da09b4167d26122af40de95c664f5b11563f313b5b51df24787125c54d8"} Sep 10 10:35:00.886644 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.886611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9j6j" event={"ID":"a4e5221e-de38-4cd6-8f2e-fd063c40d300","Type":"ContainerStarted","Data":"90a638a66523bdf895a16eea769ed038861c2ab3e4791647d492a9c7df2f593f"} Sep 10 10:35:00.903228 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:00.903179 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t9j6j" podStartSLOduration=5.197752861 podStartE2EDuration="22.903160916s" totalImagesPullingTime="17.705408055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:00.902818604 +0000 UTC m=+23.708885297" watchObservedRunningTime="2026-09-10 10:35:00.903160916 +0000 UTC m=+23.709227612" Sep 10 10:35:01.703355 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:01.703281 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:01.703355 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:01.703291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:01.703540 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:01.703400 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:35:01.703540 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:01.703462 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:35:01.703540 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:01.703517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:01.703700 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:01.703624 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:35:01.893768 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:01.891587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" event={"ID":"02f4ede7-72f2-4cc2-aa88-b37cea0077ba","Type":"ContainerStarted","Data":"1329239997c92098b2c673390f0e71716d7bf4a523935f91bfcd21b239df1aa3"} Sep 10 10:35:01.897470 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:01.897444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"55139e15aa1314ec908e4b2cb5deeaf1a380653578c1e3e5fde7af40e1a5bf55"} Sep 10 10:35:01.912142 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:01.912083 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxxtw" podStartSLOduration=3.748437041 podStartE2EDuration="23.912070935s" totalImagesPullingTime="20.163633894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:01.911666867 +0000 UTC m=+24.717733561" watchObservedRunningTime="2026-09-10 10:35:01.912070935 +0000 UTC m=+24.718137631" Sep 10 10:35:03.047943 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.047729 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:35:03.048437 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.048405 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:35:03.703837 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.703814 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:03.703946 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.703825 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:03.703946 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.703916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:03.703946 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:03.703916 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:35:03.704109 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:03.703989 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:35:03.704109 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:03.704062 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:35:03.904249 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.904178 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerStarted","Data":"f76726ededc002fdb103858941b96c52e7a65f7317ead7873b4f8454b9e35bbb"} Sep 10 10:35:03.908303 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.908275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" event={"ID":"58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a","Type":"ContainerStarted","Data":"571ec4600b34b662b373ae6181b8a5d2e3ba6d6fd2c0a070af6df1e0dbdcc38c"} Sep 10 10:35:03.908460 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.908363 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:35:03.908534 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.908514 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:35:03.908604 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.908591 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:35:03.908653 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.908644 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:35:03.909027 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.909006 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-srhsr" Sep 10 10:35:03.925149 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.925123 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:35:03.925294 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.925280 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:35:03.975503 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:03.973805 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" podStartSLOduration=8.259471717 podStartE2EDuration="25.973786096s" totalImagesPullingTime="17.714314379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:03.973262933 +0000 UTC m=+26.779329629" watchObservedRunningTime="2026-09-10 10:35:03.973786096 +0000 UTC m=+26.779852782" Sep 10 10:35:04.913887 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:04.913649 2556 generic.go:356] "Generic (PLEG): container finished" podID="b08b751d-ba65-4665-bbef-1ac8d98d4ba3" containerID="f76726ededc002fdb103858941b96c52e7a65f7317ead7873b4f8454b9e35bbb" exitCode=0 Sep 10 10:35:04.915589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:04.915559 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerDied","Data":"f76726ededc002fdb103858941b96c52e7a65f7317ead7873b4f8454b9e35bbb"} Sep 10 10:35:05.585755 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.585718 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c72pg"] Sep 10 10:35:05.585951 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.585864 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:05.586000 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:05.585953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:35:05.586686 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.586664 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnkj7"] Sep 10 10:35:05.586766 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.586759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:05.586864 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:05.586827 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:35:05.587855 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.587833 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cwjm6"] Sep 10 10:35:05.587971 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.587958 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:05.588079 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:05.588062 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:35:05.919708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.919615 2556 generic.go:356] "Generic (PLEG): container finished" podID="b08b751d-ba65-4665-bbef-1ac8d98d4ba3" containerID="2088e39e42c0aa39fa60aa2d5fb318790f67c649af19c551ed1c7d5744c2de11" exitCode=0 Sep 10 10:35:05.919708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:05.919676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerDied","Data":"2088e39e42c0aa39fa60aa2d5fb318790f67c649af19c551ed1c7d5744c2de11"} Sep 10 10:35:06.703055 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:06.703026 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:06.703235 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:06.703142 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:35:06.924574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:06.924541 2556 generic.go:356] "Generic (PLEG): container finished" podID="b08b751d-ba65-4665-bbef-1ac8d98d4ba3" containerID="f95fc36bdfd795cd32d04f05eeda4a22f3e74a48015ab1fb055b1010abd3115c" exitCode=0 Sep 10 10:35:06.924936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:06.924587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerDied","Data":"f95fc36bdfd795cd32d04f05eeda4a22f3e74a48015ab1fb055b1010abd3115c"} Sep 10 10:35:07.704983 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:07.704910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:07.705213 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:07.705035 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:07.705213 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:07.705074 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:35:07.705213 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:07.705147 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:35:08.703397 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:08.703371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:08.703826 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:08.703479 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:35:09.703367 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:09.703146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:09.703512 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:09.703413 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rnkj7" podUID="4ed4c76f-8059-4a53-969d-cc5b62a4e493" Sep 10 10:35:09.703512 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:09.703214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:09.703883 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:09.703626 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cwjm6" podUID="b96fbb0c-ffd8-4108-b549-63268fba21e9" Sep 10 10:35:10.703837 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:10.703804 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:10.704426 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:10.703934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c72pg" podUID="a45a92c6-9ea5-4f4a-a813-89ec733ea0db" Sep 10 10:35:11.422101 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.422051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:11.422270 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.422132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:11.422270 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.422171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:11.422270 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422208 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:35:11.422270 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422270 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs podName:b96fbb0c-ffd8-4108-b549-63268fba21e9 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.422252112 +0000 UTC m=+66.228318804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs") pod "network-metrics-daemon-cwjm6" (UID: "b96fbb0c-ffd8-4108-b549-63268fba21e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 10:35:11.422494 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422289 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 10:35:11.422494 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422292 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 10:35:11.422494 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422308 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 10:35:11.422494 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422319 2556 projected.go:196] Error preparing data for projected volume kube-api-access-h5qdp for pod openshift-network-diagnostics/network-check-target-c72pg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:35:11.422494 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422355 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret podName:4ed4c76f-8059-4a53-969d-cc5b62a4e493 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.422338302 +0000 UTC m=+66.228404975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret") pod "global-pull-secret-syncer-rnkj7" (UID: "4ed4c76f-8059-4a53-969d-cc5b62a4e493") : object "kube-system"/"original-pull-secret" not registered Sep 10 10:35:11.422494 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.422375 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp podName:a45a92c6-9ea5-4f4a-a813-89ec733ea0db nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.422366865 +0000 UTC m=+66.228433537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5qdp" (UniqueName: "kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp") pod "network-check-target-c72pg" (UID: "a45a92c6-9ea5-4f4a-a813-89ec733ea0db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 10:35:11.536258 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.536234 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-147.ec2.internal" event="NodeReady" Sep 10 10:35:11.536430 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.536341 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 10:35:11.582196 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.582159 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f74589979-pbxzt"] Sep 10 10:35:11.591813 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.591790 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf"] Sep 10 10:35:11.591934 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.591913 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.594275 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.594251 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 10:35:11.597825 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.597766 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 10:35:11.597825 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.597787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 10:35:11.598439 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.598035 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fw5f\"" Sep 10 10:35:11.602120 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.602102 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl"] Sep 10 10:35:11.602262 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.602244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.606068 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.606043 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 10:35:11.606418 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.606394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 10:35:11.606917 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.606895 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.612950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.612335 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gczlv\"" Sep 10 10:35:11.612950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.612369 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.612950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.612371 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 10:35:11.612950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.612634 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-lzpsv"] Sep 10 10:35:11.612950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.612836 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.615402 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.615381 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.615595 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.615581 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 10:35:11.615827 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.615815 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kpl8b\"" Sep 10 10:35:11.616110 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.616056 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.616197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.616119 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 10:35:11.626741 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.626723 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm"] Sep 10 10:35:11.626852 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.626838 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.629653 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.629636 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.630294 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.630229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 10:35:11.632464 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.632206 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t85l2\"" Sep 10 10:35:11.632464 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.632252 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 10:35:11.638364 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.638345 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.643278 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.643261 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f74589979-pbxzt"] Sep 10 10:35:11.643357 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.643288 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl"] Sep 10 10:35:11.643357 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.643302 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-lzpsv"] Sep 10 10:35:11.643357 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.643317 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pqhpd"] Sep 10 10:35:11.643453 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.643434 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:11.644760 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.644744 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 10:35:11.646484 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.646467 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.646581 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.646486 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bpv2w\"" Sep 10 10:35:11.646581 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.646509 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.646581 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.646468 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 10:35:11.657670 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.657651 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf"] Sep 10 10:35:11.657872 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.657685 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-lvw66"] Sep 10 10:35:11.659113 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.658070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.660543 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.660521 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 10:35:11.661363 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.661347 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwxhn\"" Sep 10 10:35:11.661763 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.661747 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 10:35:11.675723 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.675705 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws"] Sep 10 10:35:11.675827 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.675815 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.678276 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.678259 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 10:35:11.678358 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.678308 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 10:35:11.678430 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.678418 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.678497 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.678475 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.678554 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.678481 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-v5cb5\"" Sep 10 10:35:11.683244 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.683227 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 10:35:11.690154 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.690138 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rtct2"] Sep 10 10:35:11.690247 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.690235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" Sep 10 10:35:11.692651 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.692631 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7bwnn\"" Sep 10 10:35:11.692736 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.692649 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.692736 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.692676 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.706718 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.706695 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc"] Sep 10 10:35:11.706998 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.706776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.706998 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.706803 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:11.707129 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.707012 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:11.709598 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.709580 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.709867 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.709850 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 10:35:11.709944 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.709855 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.709944 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.709906 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bnwsz\"" Sep 10 10:35:11.710048 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.709945 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrr5x\"" Sep 10 10:35:11.710048 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.710004 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 10:35:11.710205 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.710190 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 10:35:11.720961 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.720943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.723516 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723499 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 10:35:11.723516 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723521 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-42tbx\"" Sep 10 10:35:11.723680 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 10:35:11.723680 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723554 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.723680 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723589 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.723867 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-config\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.723867 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.723993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0978729-e8b1-4974-a1e9-7fd009be2e84-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.723993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bed4219b-8cd3-44c7-b103-c72a634ae9a5-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.723993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bkxz\" (UniqueName: \"kubernetes.io/projected/bed4219b-8cd3-44c7-b103-c72a634ae9a5-kube-api-access-8bkxz\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.723993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.723969 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pmms\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-kube-api-access-5pmms\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724145 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0978729-e8b1-4974-a1e9-7fd009be2e84-snapshots\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.724145 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-bound-sa-token\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724145 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724142 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0978729-e8b1-4974-a1e9-7fd009be2e84-serving-cert\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.724240 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c000a92-6582-4844-811f-1e17a362679a-ca-trust-extracted\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724240 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-installation-pull-secrets\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724240 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-registry-certificates\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724329 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724241 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.724329 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvgqd\" (UniqueName: \"kubernetes.io/projected/b0978729-e8b1-4974-a1e9-7fd009be2e84-kube-api-access-mvgqd\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.724329 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724304 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-serving-cert\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.724329 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-image-registry-private-configuration\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724443 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0978729-e8b1-4974-a1e9-7fd009be2e84-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.724443 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-trusted-ca\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.724443 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724402 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dc99bb984-k9f94"] Sep 10 10:35:11.724443 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hwnc\" (UniqueName: \"kubernetes.io/projected/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-kube-api-access-5hwnc\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.724556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.724462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0978729-e8b1-4974-a1e9-7fd009be2e84-tmp\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.738956 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.738938 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-flndl"] Sep 10 10:35:11.739068 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.739054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.741816 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.741795 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 10:35:11.742237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.742210 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-htqrh\"" Sep 10 10:35:11.742817 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.742800 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.743060 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.743046 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 10:35:11.743150 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.743124 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 10:35:11.743291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.743266 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.743410 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.743393 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 10:35:11.763069 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763050 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqhpd"] Sep 10 10:35:11.763164 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763113 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtct2"] Sep 10 10:35:11.763164 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763135 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc"] Sep 10 10:35:11.763164 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" Sep 10 10:35:11.763164 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763156 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm"] Sep 10 10:35:11.763291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763181 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws"] Sep 10 10:35:11.763291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763198 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-lvw66"] Sep 10 10:35:11.763291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763216 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc99bb984-k9f94"] Sep 10 10:35:11.763291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.763233 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-flndl"] Sep 10 10:35:11.765557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.765540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 10:35:11.765634 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.765619 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 10:35:11.765678 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.765629 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f4bqv\"" Sep 10 10:35:11.825625 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825604 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.825707 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-registry-certificates\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.825707 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf38c067-aa09-4fdd-8a48-843ad63dc145-serving-cert\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.825707 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.825707 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825684 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-serving-cert\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.825872 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0978729-e8b1-4974-a1e9-7fd009be2e84-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.825872 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs7cs\" (UniqueName: \"kubernetes.io/projected/86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8-kube-api-access-hs7cs\") pod \"ingress-canary-rtct2\" (UID: \"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8\") " pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.825872 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.825834 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:11.825872 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-trusted-ca\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.826053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.825874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-tmp-dir\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.826053 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.825911 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls podName:bed4219b-8cd3-44c7-b103-c72a634ae9a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:12.325893591 +0000 UTC m=+35.131960265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xvltf" (UID: "bed4219b-8cd3-44c7-b103-c72a634ae9a5") : secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:11.826053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hwnc\" (UniqueName: \"kubernetes.io/projected/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-kube-api-access-5hwnc\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.826053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4bb97fa-c372-4efd-879a-07944f3893bf-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.826311 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0978729-e8b1-4974-a1e9-7fd009be2e84-tmp\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826311 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826225 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-config\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.826311 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fczs2\" (UniqueName: \"kubernetes.io/projected/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-kube-api-access-fczs2\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.826311 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826307 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf38c067-aa09-4fdd-8a48-843ad63dc145-trusted-ca\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcx7\" (UniqueName: \"kubernetes.io/projected/bf38c067-aa09-4fdd-8a48-843ad63dc145-kube-api-access-zzcx7\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826380 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0978729-e8b1-4974-a1e9-7fd009be2e84-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pmms\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-kube-api-access-5pmms\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwz5w\" (UniqueName: \"kubernetes.io/projected/725e4b71-a490-421b-bdde-ac228899337a-kube-api-access-cwz5w\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826451 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-registry-certificates\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-default-certificate\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.826562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826379 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0978729-e8b1-4974-a1e9-7fd009be2e84-tmp\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826599 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgxvn\" (UniqueName: \"kubernetes.io/projected/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-kube-api-access-mgxvn\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0978729-e8b1-4974-a1e9-7fd009be2e84-serving-cert\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf38c067-aa09-4fdd-8a48-843ad63dc145-config\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvgqd\" (UniqueName: \"kubernetes.io/projected/b0978729-e8b1-4974-a1e9-7fd009be2e84-kube-api-access-mvgqd\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0978729-e8b1-4974-a1e9-7fd009be2e84-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-image-registry-private-configuration\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8-cert\") pod \"ingress-canary-rtct2\" (UID: \"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8\") " pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826759 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-trusted-ca\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-stats-auth\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826791 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4bb97fa-c372-4efd-879a-07944f3893bf-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5v2\" (UniqueName: \"kubernetes.io/projected/e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9-kube-api-access-wn5v2\") pod \"volume-data-source-validator-695c895bd6-2mhws\" (UID: \"e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826863 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0978729-e8b1-4974-a1e9-7fd009be2e84-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.826888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826913 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826914 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-config\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-config-volume\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.826991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bed4219b-8cd3-44c7-b103-c72a634ae9a5-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.827003 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.827015 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74589979-pbxzt: secret "image-registry-tls" not found Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827017 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bkxz\" (UniqueName: \"kubernetes.io/projected/bed4219b-8cd3-44c7-b103-c72a634ae9a5-kube-api-access-8bkxz\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0978729-e8b1-4974-a1e9-7fd009be2e84-snapshots\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.827059 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls podName:5c000a92-6582-4844-811f-1e17a362679a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:12.327045733 +0000 UTC m=+35.133112405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls") pod "image-registry-6f74589979-pbxzt" (UID: "5c000a92-6582-4844-811f-1e17a362679a") : secret "image-registry-tls" not found Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-bound-sa-token\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c000a92-6582-4844-811f-1e17a362679a-ca-trust-extracted\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-installation-pull-secrets\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9792\" (UniqueName: \"kubernetes.io/projected/e4bb97fa-c372-4efd-879a-07944f3893bf-kube-api-access-j9792\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.827557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827539 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b0978729-e8b1-4974-a1e9-7fd009be2e84-snapshots\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.828244 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827669 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c000a92-6582-4844-811f-1e17a362679a-ca-trust-extracted\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.828244 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.827953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bed4219b-8cd3-44c7-b103-c72a634ae9a5-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.830018 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.829984 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-serving-cert\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.830115 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.830070 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b0978729-e8b1-4974-a1e9-7fd009be2e84-serving-cert\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.830187 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.830164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-image-registry-private-configuration\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.830224 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.830192 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-installation-pull-secrets\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.841773 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.841750 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hwnc\" (UniqueName: \"kubernetes.io/projected/5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc-kube-api-access-5hwnc\") pod \"service-ca-operator-859f94c4b-h7kwl\" (UID: \"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.841882 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.841869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pmms\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-kube-api-access-5pmms\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.842131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.842112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bkxz\" (UniqueName: \"kubernetes.io/projected/bed4219b-8cd3-44c7-b103-c72a634ae9a5-kube-api-access-8bkxz\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:11.842237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.842216 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-bound-sa-token\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:11.842342 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.842325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvgqd\" (UniqueName: \"kubernetes.io/projected/b0978729-e8b1-4974-a1e9-7fd009be2e84-kube-api-access-mvgqd\") pod \"insights-operator-76bcd6ccf5-lzpsv\" (UID: \"b0978729-e8b1-4974-a1e9-7fd009be2e84\") " pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.921862 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.921820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" Sep 10 10:35:11.927616 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.927708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9792\" (UniqueName: \"kubernetes.io/projected/e4bb97fa-c372-4efd-879a-07944f3893bf-kube-api-access-j9792\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.927708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.927708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf38c067-aa09-4fdd-8a48-843ad63dc145-serving-cert\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs7cs\" (UniqueName: \"kubernetes.io/projected/86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8-kube-api-access-hs7cs\") pod \"ingress-canary-rtct2\" (UID: \"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8\") " pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-tmp-dir\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.927754 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:12.427738545 +0000 UTC m=+35.233805235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : configmap references non-existent config key: service-ca.crt Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4bb97fa-c372-4efd-879a-07944f3893bf-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.927801 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fczs2\" (UniqueName: \"kubernetes.io/projected/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-kube-api-access-fczs2\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.927860 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.927856 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:12.427834586 +0000 UTC m=+35.233901275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : secret "router-metrics-certs-default" not found Sep 10 10:35:11.928183 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf38c067-aa09-4fdd-8a48-843ad63dc145-trusted-ca\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.928183 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927908 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcx7\" (UniqueName: \"kubernetes.io/projected/bf38c067-aa09-4fdd-8a48-843ad63dc145-kube-api-access-zzcx7\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.928183 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwz5w\" (UniqueName: \"kubernetes.io/projected/725e4b71-a490-421b-bdde-ac228899337a-kube-api-access-cwz5w\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:11.928183 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.927988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-default-certificate\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.928183 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgxvn\" (UniqueName: \"kubernetes.io/projected/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-kube-api-access-mgxvn\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.928183 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928053 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf38c067-aa09-4fdd-8a48-843ad63dc145-config\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928183 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-tmp-dir\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjgmc\" (UniqueName: \"kubernetes.io/projected/65f22a38-5419-4d20-b9b3-db7815aa95c6-kube-api-access-cjgmc\") pod \"network-check-source-685456655f-flndl\" (UID: \"65f22a38-5419-4d20-b9b3-db7815aa95c6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8-cert\") pod \"ingress-canary-rtct2\" (UID: \"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8\") " pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-stats-auth\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4bb97fa-c372-4efd-879a-07944f3893bf-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5v2\" (UniqueName: \"kubernetes.io/projected/e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9-kube-api-access-wn5v2\") pod \"volume-data-source-validator-695c895bd6-2mhws\" (UID: \"e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:11.928490 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-config-volume\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.928919 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bf38c067-aa09-4fdd-8a48-843ad63dc145-config\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.928919 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928820 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf38c067-aa09-4fdd-8a48-843ad63dc145-trusted-ca\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.928919 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928905 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-config-volume\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.929085 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.928378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4bb97fa-c372-4efd-879a-07944f3893bf-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.929085 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.928975 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 10:35:11.929085 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.929015 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls podName:725e4b71-a490-421b-bdde-ac228899337a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:12.429005219 +0000 UTC m=+35.235071896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-42zrm" (UID: "725e4b71-a490-421b-bdde-ac228899337a") : secret "samples-operator-tls" not found Sep 10 10:35:11.929085 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.929056 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 10:35:11.929313 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:11.929139 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls podName:7a1a990e-fa6c-4e25-8464-a5f18ea27e75 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:12.429121792 +0000 UTC m=+35.235188486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls") pod "dns-default-pqhpd" (UID: "7a1a990e-fa6c-4e25-8464-a5f18ea27e75") : secret "dns-default-metrics-tls" not found Sep 10 10:35:11.930219 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.930187 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf38c067-aa09-4fdd-8a48-843ad63dc145-serving-cert\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.930662 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.930629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-default-certificate\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.930768 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.930753 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-stats-auth\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.931087 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.931067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8-cert\") pod \"ingress-canary-rtct2\" (UID: \"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8\") " pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.931261 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.931245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4bb97fa-c372-4efd-879a-07944f3893bf-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.937065 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.936787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" Sep 10 10:35:11.937065 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.936913 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9792\" (UniqueName: \"kubernetes.io/projected/e4bb97fa-c372-4efd-879a-07944f3893bf-kube-api-access-j9792\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fxzbc\" (UID: \"e4bb97fa-c372-4efd-879a-07944f3893bf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:11.937859 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.937834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs7cs\" (UniqueName: \"kubernetes.io/projected/86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8-kube-api-access-hs7cs\") pod \"ingress-canary-rtct2\" (UID: \"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8\") " pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:11.938607 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.938579 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5v2\" (UniqueName: \"kubernetes.io/projected/e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9-kube-api-access-wn5v2\") pod \"volume-data-source-validator-695c895bd6-2mhws\" (UID: \"e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" Sep 10 10:35:11.938834 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.938812 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgxvn\" (UniqueName: \"kubernetes.io/projected/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-kube-api-access-mgxvn\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:11.939126 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.939086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwz5w\" (UniqueName: \"kubernetes.io/projected/725e4b71-a490-421b-bdde-ac228899337a-kube-api-access-cwz5w\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:11.939194 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.939136 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcx7\" (UniqueName: \"kubernetes.io/projected/bf38c067-aa09-4fdd-8a48-843ad63dc145-kube-api-access-zzcx7\") pod \"console-operator-85b454874b-lvw66\" (UID: \"bf38c067-aa09-4fdd-8a48-843ad63dc145\") " pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.939194 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.939158 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fczs2\" (UniqueName: \"kubernetes.io/projected/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-kube-api-access-fczs2\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:11.984242 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.984210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:11.998326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:11.998301 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" Sep 10 10:35:12.016616 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.016474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtct2" Sep 10 10:35:12.029587 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.029559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjgmc\" (UniqueName: \"kubernetes.io/projected/65f22a38-5419-4d20-b9b3-db7815aa95c6-kube-api-access-cjgmc\") pod \"network-check-source-685456655f-flndl\" (UID: \"65f22a38-5419-4d20-b9b3-db7815aa95c6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" Sep 10 10:35:12.033827 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.033537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" Sep 10 10:35:12.041207 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.040773 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjgmc\" (UniqueName: \"kubernetes.io/projected/65f22a38-5419-4d20-b9b3-db7815aa95c6-kube-api-access-cjgmc\") pod \"network-check-source-685456655f-flndl\" (UID: \"65f22a38-5419-4d20-b9b3-db7815aa95c6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" Sep 10 10:35:12.070825 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.070803 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" Sep 10 10:35:12.235689 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.235664 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl"] Sep 10 10:35:12.241221 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.241201 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-lzpsv"] Sep 10 10:35:12.305172 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.305148 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-lvw66"] Sep 10 10:35:12.316557 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.316538 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws"] Sep 10 10:35:12.322574 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.322556 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtct2"] Sep 10 10:35:12.335080 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.335061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:12.335226 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.335209 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 10:35:12.335273 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.335228 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74589979-pbxzt: secret "image-registry-tls" not found Sep 10 10:35:12.335273 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.335243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:12.335365 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.335283 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls podName:5c000a92-6582-4844-811f-1e17a362679a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:13.33526136 +0000 UTC m=+36.141328042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls") pod "image-registry-6f74589979-pbxzt" (UID: "5c000a92-6582-4844-811f-1e17a362679a") : secret "image-registry-tls" not found Sep 10 10:35:12.335424 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.335393 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:12.335471 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.335457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls podName:bed4219b-8cd3-44c7-b103-c72a634ae9a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:13.335440174 +0000 UTC m=+36.141506869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xvltf" (UID: "bed4219b-8cd3-44c7-b103-c72a634ae9a5") : secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:12.355275 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.355252 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc"] Sep 10 10:35:12.381524 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.381496 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-flndl"] Sep 10 10:35:12.386768 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:12.386742 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bb97fa_c372_4efd_879a_07944f3893bf.slice/crio-96820065e1368fa7e9ac410291d3f6d45d8cb8b199755a10d362a63604ff7233 WatchSource:0}: Error finding container 96820065e1368fa7e9ac410291d3f6d45d8cb8b199755a10d362a63604ff7233: Status 404 returned error can't find the container with id 96820065e1368fa7e9ac410291d3f6d45d8cb8b199755a10d362a63604ff7233 Sep 10 10:35:12.387023 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:12.386999 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f22a38_5419_4d20_b9b3_db7815aa95c6.slice/crio-04d4320ca1bfe1d665257721e0eb741d08af0c72c8eb21b9a600f2c3bd3fe8e1 WatchSource:0}: Error finding container 04d4320ca1bfe1d665257721e0eb741d08af0c72c8eb21b9a600f2c3bd3fe8e1: Status 404 returned error can't find the container with id 04d4320ca1bfe1d665257721e0eb741d08af0c72c8eb21b9a600f2c3bd3fe8e1 Sep 10 10:35:12.387404 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:12.387299 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf38c067_aa09_4fdd_8a48_843ad63dc145.slice/crio-2e752bffb51be11e1198ab7a908700dc6541b8c8ca1ba672e9a43f7977ad95fa WatchSource:0}: Error finding container 2e752bffb51be11e1198ab7a908700dc6541b8c8ca1ba672e9a43f7977ad95fa: Status 404 returned error can't find the container with id 2e752bffb51be11e1198ab7a908700dc6541b8c8ca1ba672e9a43f7977ad95fa Sep 10 10:35:12.388494 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:12.388472 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86bf8262_4bf1_4a4f_92cd_05ded5c5ecc8.slice/crio-177719d209e7b1dca462213f2d5b3016b0251e714ab4b3eed45cfb2429a21406 WatchSource:0}: Error finding container 177719d209e7b1dca462213f2d5b3016b0251e714ab4b3eed45cfb2429a21406: Status 404 returned error can't find the container with id 177719d209e7b1dca462213f2d5b3016b0251e714ab4b3eed45cfb2429a21406 Sep 10 10:35:12.389981 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:12.389445 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f362aa4_d2f8_45f4_9acf_bca0a9cc57dc.slice/crio-714963c397381ec1413ab4bfdfd4c5bf13bdb3c013825d35cb5efcb648887382 WatchSource:0}: Error finding container 714963c397381ec1413ab4bfdfd4c5bf13bdb3c013825d35cb5efcb648887382: Status 404 returned error can't find the container with id 714963c397381ec1413ab4bfdfd4c5bf13bdb3c013825d35cb5efcb648887382 Sep 10 10:35:12.435775 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.435748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:12.435895 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.435877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:12.435956 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.435906 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:13.435889363 +0000 UTC m=+36.241956035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : configmap references non-existent config key: service-ca.crt Sep 10 10:35:12.436018 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.435971 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 10:35:12.436066 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.435969 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:12.436066 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.436022 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls podName:7a1a990e-fa6c-4e25-8464-a5f18ea27e75 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:13.436007632 +0000 UTC m=+36.242074307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls") pod "dns-default-pqhpd" (UID: "7a1a990e-fa6c-4e25-8464-a5f18ea27e75") : secret "dns-default-metrics-tls" not found Sep 10 10:35:12.436066 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.436052 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 10:35:12.436259 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.436109 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls podName:725e4b71-a490-421b-bdde-ac228899337a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:13.436078973 +0000 UTC m=+36.242145660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-42zrm" (UID: "725e4b71-a490-421b-bdde-ac228899337a") : secret "samples-operator-tls" not found Sep 10 10:35:12.436259 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.436083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:12.436259 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.436213 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 10:35:12.436349 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:12.436265 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:13.436246742 +0000 UTC m=+36.242313415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : secret "router-metrics-certs-default" not found Sep 10 10:35:12.703555 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.703528 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:12.706254 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.706222 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-skrtq\"" Sep 10 10:35:12.940023 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.939989 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" event={"ID":"e4bb97fa-c372-4efd-879a-07944f3893bf","Type":"ContainerStarted","Data":"96820065e1368fa7e9ac410291d3f6d45d8cb8b199755a10d362a63604ff7233"} Sep 10 10:35:12.941671 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.941614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" event={"ID":"65f22a38-5419-4d20-b9b3-db7815aa95c6","Type":"ContainerStarted","Data":"04d4320ca1bfe1d665257721e0eb741d08af0c72c8eb21b9a600f2c3bd3fe8e1"} Sep 10 10:35:12.943029 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.943005 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtct2" event={"ID":"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8","Type":"ContainerStarted","Data":"177719d209e7b1dca462213f2d5b3016b0251e714ab4b3eed45cfb2429a21406"} Sep 10 10:35:12.945822 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.945761 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" event={"ID":"e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9","Type":"ContainerStarted","Data":"56c3bd78c365d3d1ba556bee3fb126a53900941acdf7b001371e7f8209e2f933"} Sep 10 10:35:12.948049 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.947992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" event={"ID":"b0978729-e8b1-4974-a1e9-7fd009be2e84","Type":"ContainerStarted","Data":"2f63bceba587434709696aab2cef779e221cbb88461013eabbefb5b659b3e55f"} Sep 10 10:35:12.950317 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.950269 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-lvw66" event={"ID":"bf38c067-aa09-4fdd-8a48-843ad63dc145","Type":"ContainerStarted","Data":"2e752bffb51be11e1198ab7a908700dc6541b8c8ca1ba672e9a43f7977ad95fa"} Sep 10 10:35:12.951749 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.951679 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" event={"ID":"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc","Type":"ContainerStarted","Data":"714963c397381ec1413ab4bfdfd4c5bf13bdb3c013825d35cb5efcb648887382"} Sep 10 10:35:12.956527 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.956471 2556 generic.go:356] "Generic (PLEG): container finished" podID="b08b751d-ba65-4665-bbef-1ac8d98d4ba3" containerID="f304881a53cda4e6047a6749c093b7f39d95abd084e880a6a41428f6bc8425f3" exitCode=0 Sep 10 10:35:12.956527 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:12.956509 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerDied","Data":"f304881a53cda4e6047a6749c093b7f39d95abd084e880a6a41428f6bc8425f3"} Sep 10 10:35:13.343556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.343520 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:13.343738 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.343668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:13.343822 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.343797 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 10:35:13.343822 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.343812 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74589979-pbxzt: secret "image-registry-tls" not found Sep 10 10:35:13.343921 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.343872 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls podName:5c000a92-6582-4844-811f-1e17a362679a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.343849299 +0000 UTC m=+38.149915993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls") pod "image-registry-6f74589979-pbxzt" (UID: "5c000a92-6582-4844-811f-1e17a362679a") : secret "image-registry-tls" not found Sep 10 10:35:13.344280 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.344204 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:13.344280 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.344261 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls podName:bed4219b-8cd3-44c7-b103-c72a634ae9a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.344246244 +0000 UTC m=+38.150312922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xvltf" (UID: "bed4219b-8cd3-44c7-b103-c72a634ae9a5") : secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.445024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.445082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.445144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.445191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445325 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.445308252 +0000 UTC m=+38.251374942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : configmap references non-existent config key: service-ca.crt Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445337 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445360 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445374 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.445363346 +0000 UTC m=+38.251430034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : secret "router-metrics-certs-default" not found Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445423 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445440 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls podName:725e4b71-a490-421b-bdde-ac228899337a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.445420848 +0000 UTC m=+38.251487533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-42zrm" (UID: "725e4b71-a490-421b-bdde-ac228899337a") : secret "samples-operator-tls" not found Sep 10 10:35:13.445641 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:13.445457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls podName:7a1a990e-fa6c-4e25-8464-a5f18ea27e75 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:15.445447202 +0000 UTC m=+38.251513876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls") pod "dns-default-pqhpd" (UID: "7a1a990e-fa6c-4e25-8464-a5f18ea27e75") : secret "dns-default-metrics-tls" not found Sep 10 10:35:13.971156 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.970409 2556 generic.go:356] "Generic (PLEG): container finished" podID="b08b751d-ba65-4665-bbef-1ac8d98d4ba3" containerID="cafbce214e1940a778ae50866d8f4223696d7818be9d5ec26bb49a70c699fcda" exitCode=0 Sep 10 10:35:13.971156 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:13.970464 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerDied","Data":"cafbce214e1940a778ae50866d8f4223696d7818be9d5ec26bb49a70c699fcda"} Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:15.362604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:15.362695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.362809 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.362825 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.362836 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74589979-pbxzt: secret "image-registry-tls" not found Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.362904 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls podName:bed4219b-8cd3-44c7-b103-c72a634ae9a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.362884797 +0000 UTC m=+42.168951472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xvltf" (UID: "bed4219b-8cd3-44c7-b103-c72a634ae9a5") : secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:15.362950 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.362925 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls podName:5c000a92-6582-4844-811f-1e17a362679a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.362915554 +0000 UTC m=+42.168982245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls") pod "image-registry-6f74589979-pbxzt" (UID: "5c000a92-6582-4844-811f-1e17a362679a") : secret "image-registry-tls" not found Sep 10 10:35:15.463793 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:15.463765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:15.463956 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:15.463820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:15.463956 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.463926 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 10:35:15.463956 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.463931 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 10:35:15.464116 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.463982 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls podName:725e4b71-a490-421b-bdde-ac228899337a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.463963822 +0000 UTC m=+42.270030505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-42zrm" (UID: "725e4b71-a490-421b-bdde-ac228899337a") : secret "samples-operator-tls" not found Sep 10 10:35:15.464116 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.463998 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls podName:7a1a990e-fa6c-4e25-8464-a5f18ea27e75 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.463990976 +0000 UTC m=+42.270057648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls") pod "dns-default-pqhpd" (UID: "7a1a990e-fa6c-4e25-8464-a5f18ea27e75") : secret "dns-default-metrics-tls" not found Sep 10 10:35:15.464116 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:15.464026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:15.464116 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:15.464071 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:15.464275 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.464155 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 10:35:15.464275 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.464211 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.464193333 +0000 UTC m=+42.270260011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : secret "router-metrics-certs-default" not found Sep 10 10:35:15.464360 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:15.464281 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:19.464262414 +0000 UTC m=+42.270329088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : configmap references non-existent config key: service-ca.crt Sep 10 10:35:19.395255 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.395219 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:19.395625 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.395280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:19.395625 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.395366 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:19.395625 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.395383 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 10:35:19.395625 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.395404 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74589979-pbxzt: secret "image-registry-tls" not found Sep 10 10:35:19.395625 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.395415 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls podName:bed4219b-8cd3-44c7-b103-c72a634ae9a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:27.395402471 +0000 UTC m=+50.201469147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xvltf" (UID: "bed4219b-8cd3-44c7-b103-c72a634ae9a5") : secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:19.395625 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.395449 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls podName:5c000a92-6582-4844-811f-1e17a362679a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:27.395435211 +0000 UTC m=+50.201501899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls") pod "image-registry-6f74589979-pbxzt" (UID: "5c000a92-6582-4844-811f-1e17a362679a") : secret "image-registry-tls" not found Sep 10 10:35:19.496436 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.496393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:19.496610 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.496452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:19.496610 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.496493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:19.496610 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.496533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:19.496610 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496544 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 10:35:19.496610 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496601 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 10:35:19.496838 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496609 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 10:35:19.496838 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496621 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls podName:7a1a990e-fa6c-4e25-8464-a5f18ea27e75 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:27.496601627 +0000 UTC m=+50.302668299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls") pod "dns-default-pqhpd" (UID: "7a1a990e-fa6c-4e25-8464-a5f18ea27e75") : secret "dns-default-metrics-tls" not found Sep 10 10:35:19.496838 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496649 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls podName:725e4b71-a490-421b-bdde-ac228899337a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:27.496635881 +0000 UTC m=+50.302702554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-42zrm" (UID: "725e4b71-a490-421b-bdde-ac228899337a") : secret "samples-operator-tls" not found Sep 10 10:35:19.496838 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496662 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:27.496655808 +0000 UTC m=+50.302722479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : secret "router-metrics-certs-default" not found Sep 10 10:35:19.496838 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:19.496673 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:27.496666933 +0000 UTC m=+50.302733605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : configmap references non-existent config key: service-ca.crt Sep 10 10:35:19.988634 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.988605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" event={"ID":"e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9","Type":"ContainerStarted","Data":"c7fffffd3cc82bc25cc67fd6bc5a5b3ed1e880a188aa0c284edfda62acc9f11c"} Sep 10 10:35:19.990573 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.990529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" event={"ID":"b0978729-e8b1-4974-a1e9-7fd009be2e84","Type":"ContainerStarted","Data":"e20d261b44604d3feb524323b439ca8f2e8b5ed5eb71c7e3a17e7dd46bf11195"} Sep 10 10:35:19.995421 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:19.995350 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" event={"ID":"b08b751d-ba65-4665-bbef-1ac8d98d4ba3","Type":"ContainerStarted","Data":"7b8a25b7e751576079a99c314e2c50aea55032a7c20f435951e5a25e022cb374"} Sep 10 10:35:20.026111 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.025938 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2mhws" podStartSLOduration=10.622797613 podStartE2EDuration="18.025919815s" totalImagesPullingTime="7.403122202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:20.024262893 +0000 UTC m=+42.830329588" watchObservedRunningTime="2026-09-10 10:35:20.025919815 +0000 UTC m=+42.831986509" Sep 10 10:35:20.048670 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.046828 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7bvdl" podStartSLOduration=13.217444343 podStartE2EDuration="42.046812686s" totalImagesPullingTime="28.829368343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:20.04659502 +0000 UTC m=+42.852661713" watchObservedRunningTime="2026-09-10 10:35:20.046812686 +0000 UTC m=+42.852879374" Sep 10 10:35:20.422507 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.422471 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bd94t"] Sep 10 10:35:20.444452 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.444414 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bd94t"] Sep 10 10:35:20.444591 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.444560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.446867 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.446834 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 10:35:20.447024 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.447005 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdf7z\"" Sep 10 10:35:20.447131 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.447026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 10:35:20.506420 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.506388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.506575 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.506521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjhh\" (UniqueName: \"kubernetes.io/projected/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-api-access-jtjhh\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.506642 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.506593 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.506686 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.506649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/658aaa93-d59c-41b7-91b3-f5f884d86a58-crio-socket\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.506686 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.506676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/658aaa93-d59c-41b7-91b3-f5f884d86a58-data-volume\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607087 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjhh\" (UniqueName: \"kubernetes.io/projected/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-api-access-jtjhh\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607297 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607297 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:20.607271 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 10:35:20.607405 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:20.607324 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:21.107307408 +0000 UTC m=+43.913374094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : secret "insights-runtime-extractor-tls" not found Sep 10 10:35:20.607405 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607383 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/658aaa93-d59c-41b7-91b3-f5f884d86a58-crio-socket\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607520 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/658aaa93-d59c-41b7-91b3-f5f884d86a58-data-volume\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607520 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/658aaa93-d59c-41b7-91b3-f5f884d86a58-crio-socket\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607619 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.607619 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:20.607572 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 10:35:20.607721 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:20.607628 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:21.107611918 +0000 UTC m=+43.913678593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : configmap "kube-rbac-proxy" not found Sep 10 10:35:20.607794 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.607778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/658aaa93-d59c-41b7-91b3-f5f884d86a58-data-volume\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:20.631708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:20.631677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjhh\" (UniqueName: \"kubernetes.io/projected/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-api-access-jtjhh\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:21.001070 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.001031 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" event={"ID":"e4bb97fa-c372-4efd-879a-07944f3893bf","Type":"ContainerStarted","Data":"eea5d85d65daae69701e9f8743625db7c4d5ce85c6e0c6dfbbf661e6d915e716"} Sep 10 10:35:21.002740 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.002709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" event={"ID":"65f22a38-5419-4d20-b9b3-db7815aa95c6","Type":"ContainerStarted","Data":"87d5611c16b5f89e865d7c4ed2de22ef89731179388780540d3019b765f89001"} Sep 10 10:35:21.004307 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.004282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtct2" event={"ID":"86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8","Type":"ContainerStarted","Data":"9d96fccdfd234ea0a27d818f65fa75fae2abf105afe419ee2f7063685a0c92c6"} Sep 10 10:35:21.006197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.006175 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/0.log" Sep 10 10:35:21.006287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.006217 2556 generic.go:356] "Generic (PLEG): container finished" podID="bf38c067-aa09-4fdd-8a48-843ad63dc145" containerID="d9e6205e686d57cdc47d23fe09f70a57e3e324599c8b3e66a6402806bb306cd6" exitCode=255 Sep 10 10:35:21.006337 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.006287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-lvw66" event={"ID":"bf38c067-aa09-4fdd-8a48-843ad63dc145","Type":"ContainerDied","Data":"d9e6205e686d57cdc47d23fe09f70a57e3e324599c8b3e66a6402806bb306cd6"} Sep 10 10:35:21.006486 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.006473 2556 scope.go:117] "RemoveContainer" containerID="d9e6205e686d57cdc47d23fe09f70a57e3e324599c8b3e66a6402806bb306cd6" Sep 10 10:35:21.008830 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.008808 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" event={"ID":"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc","Type":"ContainerStarted","Data":"4c4de5dab17b182519b45bd76c75309cf34f79beaafbc7abf3acafaff232b934"} Sep 10 10:35:21.021064 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.021021 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" podStartSLOduration=11.572237488 podStartE2EDuration="19.021004799s" totalImagesPullingTime="7.448767311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:21.020086946 +0000 UTC m=+43.826153641" watchObservedRunningTime="2026-09-10 10:35:21.021004799 +0000 UTC m=+43.827071494" Sep 10 10:35:21.059195 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.059147 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" podStartSLOduration=11.614817418 podStartE2EDuration="19.059131507s" totalImagesPullingTime="7.444314089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:21.057586226 +0000 UTC m=+43.863652921" watchObservedRunningTime="2026-09-10 10:35:21.059131507 +0000 UTC m=+43.865198201" Sep 10 10:35:21.074074 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.074006 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rtct2" podStartSLOduration=2.629370351 podStartE2EDuration="10.073985812s" totalImagesPullingTime="7.444615461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:21.073767717 +0000 UTC m=+43.879834412" watchObservedRunningTime="2026-09-10 10:35:21.073985812 +0000 UTC m=+43.880052507" Sep 10 10:35:21.112006 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.111956 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" podStartSLOduration=11.669088252 podStartE2EDuration="19.11194133s" totalImagesPullingTime="7.442853078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:21.110988604 +0000 UTC m=+43.917055299" watchObservedRunningTime="2026-09-10 10:35:21.11194133 +0000 UTC m=+43.918008023" Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.112176 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-flndl" podStartSLOduration=11.653869755 podStartE2EDuration="19.11216436s" totalImagesPullingTime="7.458294605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:21.090072766 +0000 UTC m=+43.896139485" watchObservedRunningTime="2026-09-10 10:35:21.11216436 +0000 UTC m=+43.918231091" Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.112478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.112722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:21.113212 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:21.113264 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:22.113248031 +0000 UTC m=+44.919314717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : configmap "kube-rbac-proxy" not found Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:21.114809 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 10:35:21.116078 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:21.114857 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:22.114841861 +0000 UTC m=+44.920908536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : secret "insights-runtime-extractor-tls" not found Sep 10 10:35:21.813461 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.813434 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zpbg_3bc0df36-7279-4352-9fb6-cb02e3d17a16/dns-node-resolver/0.log" Sep 10 10:35:21.984625 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.984594 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:21.984778 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:21.984655 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:22.013505 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.013478 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/1.log" Sep 10 10:35:22.013948 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.013930 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/0.log" Sep 10 10:35:22.014033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.013983 2556 generic.go:356] "Generic (PLEG): container finished" podID="bf38c067-aa09-4fdd-8a48-843ad63dc145" containerID="bb6fbc6c6cf3ff7d4fcde9d7ebd3a62e7b749e008d4f8c2f8d162459eea269fa" exitCode=255 Sep 10 10:35:22.014117 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.014081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-lvw66" event={"ID":"bf38c067-aa09-4fdd-8a48-843ad63dc145","Type":"ContainerDied","Data":"bb6fbc6c6cf3ff7d4fcde9d7ebd3a62e7b749e008d4f8c2f8d162459eea269fa"} Sep 10 10:35:22.014170 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.014155 2556 scope.go:117] "RemoveContainer" containerID="d9e6205e686d57cdc47d23fe09f70a57e3e324599c8b3e66a6402806bb306cd6" Sep 10 10:35:22.014400 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.014382 2556 scope.go:117] "RemoveContainer" containerID="bb6fbc6c6cf3ff7d4fcde9d7ebd3a62e7b749e008d4f8c2f8d162459eea269fa" Sep 10 10:35:22.014649 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:22.014595 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-lvw66_openshift-console-operator(bf38c067-aa09-4fdd-8a48-843ad63dc145)\"" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podUID="bf38c067-aa09-4fdd-8a48-843ad63dc145" Sep 10 10:35:22.122172 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.122145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:22.122333 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:22.122314 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 10:35:22.122429 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:22.122383 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:24.122362623 +0000 UTC m=+46.928429340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : secret "insights-runtime-extractor-tls" not found Sep 10 10:35:22.122743 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:22.122548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:22.122743 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:22.122610 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 10:35:22.122743 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:22.122661 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:24.122642252 +0000 UTC m=+46.928708946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : configmap "kube-rbac-proxy" not found Sep 10 10:35:23.015484 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:23.015453 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcmh4_43dcdf8f-1ed0-414a-ab8c-45d6595436c7/node-ca/0.log" Sep 10 10:35:23.020363 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:23.020339 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/1.log" Sep 10 10:35:23.020660 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:23.020645 2556 scope.go:117] "RemoveContainer" containerID="bb6fbc6c6cf3ff7d4fcde9d7ebd3a62e7b749e008d4f8c2f8d162459eea269fa" Sep 10 10:35:23.020812 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:23.020793 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-lvw66_openshift-console-operator(bf38c067-aa09-4fdd-8a48-843ad63dc145)\"" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podUID="bf38c067-aa09-4fdd-8a48-843ad63dc145" Sep 10 10:35:23.812826 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:23.812761 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtct2_86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8/serve-healthcheck-canary/0.log" Sep 10 10:35:24.138850 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:24.138819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:24.139255 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:24.138900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:24.139255 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:24.138957 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 10:35:24.139255 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:24.139006 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 10:35:24.139255 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:24.139024 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:28.139007759 +0000 UTC m=+50.945074433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : configmap "kube-rbac-proxy" not found Sep 10 10:35:24.139255 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:24.139051 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:28.139033402 +0000 UTC m=+50.945100074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : secret "insights-runtime-extractor-tls" not found Sep 10 10:35:27.465775 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:27.465745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:27.466167 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:27.465811 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:27.466167 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.465898 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 10:35:27.466167 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.465917 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f74589979-pbxzt: secret "image-registry-tls" not found Sep 10 10:35:27.466167 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.465923 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:27.466167 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.465971 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls podName:5c000a92-6582-4844-811f-1e17a362679a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.465955485 +0000 UTC m=+66.272022157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls") pod "image-registry-6f74589979-pbxzt" (UID: "5c000a92-6582-4844-811f-1e17a362679a") : secret "image-registry-tls" not found Sep 10 10:35:27.466167 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.465984 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls podName:bed4219b-8cd3-44c7-b103-c72a634ae9a5 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.465978304 +0000 UTC m=+66.272044975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-xvltf" (UID: "bed4219b-8cd3-44c7-b103-c72a634ae9a5") : secret "cluster-monitoring-operator-tls" not found Sep 10 10:35:27.566727 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:27.566704 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:27.566855 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:27.566737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:27.566855 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:27.566762 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:27.566927 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.566865 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 10:35:27.566927 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.566879 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 10:35:27.566927 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:27.566896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:27.566927 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.566906 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls podName:725e4b71-a490-421b-bdde-ac228899337a nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.566894873 +0000 UTC m=+66.372961545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-42zrm" (UID: "725e4b71-a490-421b-bdde-ac228899337a") : secret "samples-operator-tls" not found Sep 10 10:35:27.567156 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.566942 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 10:35:27.567156 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.566973 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls podName:7a1a990e-fa6c-4e25-8464-a5f18ea27e75 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.566943734 +0000 UTC m=+66.373010421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls") pod "dns-default-pqhpd" (UID: "7a1a990e-fa6c-4e25-8464-a5f18ea27e75") : secret "dns-default-metrics-tls" not found Sep 10 10:35:27.567156 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.567011 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.566996502 +0000 UTC m=+66.373063180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : secret "router-metrics-certs-default" not found Sep 10 10:35:27.567156 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:27.567032 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle podName:1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:43.56702256 +0000 UTC m=+66.373089237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle") pod "router-default-6dc99bb984-k9f94" (UID: "1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18") : configmap references non-existent config key: service-ca.crt Sep 10 10:35:28.173730 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:28.173698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:28.173906 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:28.173792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:28.173906 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:28.173848 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 10:35:28.173985 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:28.173918 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls podName:658aaa93-d59c-41b7-91b3-f5f884d86a58 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:36.173903706 +0000 UTC m=+58.979970378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bd94t" (UID: "658aaa93-d59c-41b7-91b3-f5f884d86a58") : secret "insights-runtime-extractor-tls" not found Sep 10 10:35:28.174385 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:28.174366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/658aaa93-d59c-41b7-91b3-f5f884d86a58-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:31.985318 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:31.985285 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:31.985934 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:31.985344 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:31.985934 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:31.985732 2556 scope.go:117] "RemoveContainer" containerID="bb6fbc6c6cf3ff7d4fcde9d7ebd3a62e7b749e008d4f8c2f8d162459eea269fa" Sep 10 10:35:32.050487 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:32.050466 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/1.log" Sep 10 10:35:32.050600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:32.050523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-lvw66" event={"ID":"bf38c067-aa09-4fdd-8a48-843ad63dc145","Type":"ContainerStarted","Data":"55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c"} Sep 10 10:35:32.050760 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:32.050739 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:32.052214 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:32.052186 2556 patch_prober.go:28] interesting pod/console-operator-85b454874b-lvw66 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Sep 10 10:35:32.052331 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:32.052226 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podUID="bf38c067-aa09-4fdd-8a48-843ad63dc145" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Sep 10 10:35:32.069767 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:32.069728 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podStartSLOduration=22.625209825 podStartE2EDuration="30.069714836s" totalImagesPullingTime="7.444505011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:32.068718239 +0000 UTC m=+54.874784934" watchObservedRunningTime="2026-09-10 10:35:32.069714836 +0000 UTC m=+54.875781556" Sep 10 10:35:33.056358 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:33.056328 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:35:33.056840 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:33.056822 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/1.log" Sep 10 10:35:33.056900 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:33.056860 2556 generic.go:356] "Generic (PLEG): container finished" podID="bf38c067-aa09-4fdd-8a48-843ad63dc145" containerID="55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c" exitCode=255 Sep 10 10:35:33.056938 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:33.056890 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-lvw66" event={"ID":"bf38c067-aa09-4fdd-8a48-843ad63dc145","Type":"ContainerDied","Data":"55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c"} Sep 10 10:35:33.056986 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:33.056975 2556 scope.go:117] "RemoveContainer" containerID="bb6fbc6c6cf3ff7d4fcde9d7ebd3a62e7b749e008d4f8c2f8d162459eea269fa" Sep 10 10:35:33.057230 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:33.057216 2556 scope.go:117] "RemoveContainer" containerID="55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c" Sep 10 10:35:33.057387 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:33.057370 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-lvw66_openshift-console-operator(bf38c067-aa09-4fdd-8a48-843ad63dc145)\"" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podUID="bf38c067-aa09-4fdd-8a48-843ad63dc145" Sep 10 10:35:34.061185 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:34.061160 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:35:34.061630 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:34.061520 2556 scope.go:117] "RemoveContainer" containerID="55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c" Sep 10 10:35:34.061735 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:34.061713 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-lvw66_openshift-console-operator(bf38c067-aa09-4fdd-8a48-843ad63dc145)\"" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podUID="bf38c067-aa09-4fdd-8a48-843ad63dc145" Sep 10 10:35:35.935231 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:35.935204 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggnbq" Sep 10 10:35:36.239883 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:36.239808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:36.242052 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:36.242017 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/658aaa93-d59c-41b7-91b3-f5f884d86a58-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bd94t\" (UID: \"658aaa93-d59c-41b7-91b3-f5f884d86a58\") " pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:36.355911 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:36.355883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bd94t" Sep 10 10:35:36.626447 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:36.626417 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bd94t"] Sep 10 10:35:36.631488 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:36.631466 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658aaa93_d59c_41b7_91b3_f5f884d86a58.slice/crio-0ef8440bf6e6c2884e70f81fa175a53b575ec525e44832109e3476454b7f8fc2 WatchSource:0}: Error finding container 0ef8440bf6e6c2884e70f81fa175a53b575ec525e44832109e3476454b7f8fc2: Status 404 returned error can't find the container with id 0ef8440bf6e6c2884e70f81fa175a53b575ec525e44832109e3476454b7f8fc2 Sep 10 10:35:37.072234 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:37.072202 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bd94t" event={"ID":"658aaa93-d59c-41b7-91b3-f5f884d86a58","Type":"ContainerStarted","Data":"3c5ba54f1c434c6e8cc64251bef3712859ea0678e07503195309d476f8d4ce75"} Sep 10 10:35:37.072584 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:37.072256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bd94t" event={"ID":"658aaa93-d59c-41b7-91b3-f5f884d86a58","Type":"ContainerStarted","Data":"0ef8440bf6e6c2884e70f81fa175a53b575ec525e44832109e3476454b7f8fc2"} Sep 10 10:35:38.077431 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:38.077398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bd94t" event={"ID":"658aaa93-d59c-41b7-91b3-f5f884d86a58","Type":"ContainerStarted","Data":"dd0ed3a131d96028b88e3ae01412339dbeaf3fbcf240eb88b7240bd0c48e583a"} Sep 10 10:35:39.082680 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:39.082655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bd94t" event={"ID":"658aaa93-d59c-41b7-91b3-f5f884d86a58","Type":"ContainerStarted","Data":"4607bd4001f6975162f6379de8e0d9dd95d62c0f1bc688bb59487ca0fc4899af"} Sep 10 10:35:39.100208 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:39.100168 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bd94t" podStartSLOduration=16.828354055 podStartE2EDuration="19.100155393s" totalImagesPullingTime="2.271801338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:35:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:39.098937182 +0000 UTC m=+61.905003867" watchObservedRunningTime="2026-09-10 10:35:39.100155393 +0000 UTC m=+61.906222086" Sep 10 10:35:41.984970 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:41.984936 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:41.985325 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:41.985291 2556 scope.go:117] "RemoveContainer" containerID="55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c" Sep 10 10:35:41.985473 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:41.985453 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-lvw66_openshift-console-operator(bf38c067-aa09-4fdd-8a48-843ad63dc145)\"" pod="openshift-console-operator/console-operator-85b454874b-lvw66" podUID="bf38c067-aa09-4fdd-8a48-843ad63dc145" Sep 10 10:35:43.500658 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.500614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:43.500658 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.500665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:43.501296 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.500695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:43.501296 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.500791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:43.501296 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.500853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:43.503271 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.503242 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bed4219b-8cd3-44c7-b103-c72a634ae9a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-xvltf\" (UID: \"bed4219b-8cd3-44c7-b103-c72a634ae9a5\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:43.503423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.503287 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"image-registry-6f74589979-pbxzt\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:43.503423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.503352 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qdp\" (UniqueName: \"kubernetes.io/projected/a45a92c6-9ea5-4f4a-a813-89ec733ea0db-kube-api-access-h5qdp\") pod \"network-check-target-c72pg\" (UID: \"a45a92c6-9ea5-4f4a-a813-89ec733ea0db\") " pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:43.503423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.503390 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 10:35:43.503423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.503395 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 10:35:43.531130 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.515584 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ed4c76f-8059-4a53-969d-cc5b62a4e493-original-pull-secret\") pod \"global-pull-secret-syncer-rnkj7\" (UID: \"4ed4c76f-8059-4a53-969d-cc5b62a4e493\") " pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:43.531130 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.524163 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b96fbb0c-ffd8-4108-b549-63268fba21e9-metrics-certs\") pod \"network-metrics-daemon-cwjm6\" (UID: \"b96fbb0c-ffd8-4108-b549-63268fba21e9\") " pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:43.531130 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.528269 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rnkj7" Sep 10 10:35:43.533755 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.533739 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jrr5x\"" Sep 10 10:35:43.541683 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.541664 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cwjm6" Sep 10 10:35:43.601355 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.601326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:43.601452 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.601386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:43.601515 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.601483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:43.601569 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.601548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:43.602426 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.602377 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-service-ca-bundle\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:43.604331 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.604293 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18-metrics-certs\") pod \"router-default-6dc99bb984-k9f94\" (UID: \"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18\") " pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:43.604688 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.604668 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/725e4b71-a490-421b-bdde-ac228899337a-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-42zrm\" (UID: \"725e4b71-a490-421b-bdde-ac228899337a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:43.605079 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.605052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a1a990e-fa6c-4e25-8464-a5f18ea27e75-metrics-tls\") pod \"dns-default-pqhpd\" (UID: \"7a1a990e-fa6c-4e25-8464-a5f18ea27e75\") " pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:43.614395 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.614376 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-skrtq\"" Sep 10 10:35:43.622423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.622362 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:43.704211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.704192 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fw5f\"" Sep 10 10:35:43.711896 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.711877 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:43.717804 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.717784 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gczlv\"" Sep 10 10:35:43.725748 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.725730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" Sep 10 10:35:43.755066 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.755010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bpv2w\"" Sep 10 10:35:43.762929 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.762856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" Sep 10 10:35:43.773151 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.772921 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nwxhn\"" Sep 10 10:35:43.781440 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.781365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:43.802112 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.802071 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rnkj7"] Sep 10 10:35:43.815556 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:43.815515 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed4c76f_8059_4a53_969d_cc5b62a4e493.slice/crio-b1c5c881a4c6c516c1feec2f9e6bbc0763cbdc98799aefea0eb0dacd316d51c6 WatchSource:0}: Error finding container b1c5c881a4c6c516c1feec2f9e6bbc0763cbdc98799aefea0eb0dacd316d51c6: Status 404 returned error can't find the container with id b1c5c881a4c6c516c1feec2f9e6bbc0763cbdc98799aefea0eb0dacd316d51c6 Sep 10 10:35:43.824373 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.824350 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cwjm6"] Sep 10 10:35:43.827858 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:43.827817 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96fbb0c_ffd8_4108_b549_63268fba21e9.slice/crio-ba7173374a7b353cc074a87d79f1708848dc9b5b545695e0e518526de29bace7 WatchSource:0}: Error finding container ba7173374a7b353cc074a87d79f1708848dc9b5b545695e0e518526de29bace7: Status 404 returned error can't find the container with id ba7173374a7b353cc074a87d79f1708848dc9b5b545695e0e518526de29bace7 Sep 10 10:35:43.854017 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.853996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-htqrh\"" Sep 10 10:35:43.862236 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.862215 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:43.890827 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.890802 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c72pg"] Sep 10 10:35:43.991832 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:43.991808 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f74589979-pbxzt"] Sep 10 10:35:43.995191 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:43.995168 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c000a92_6582_4844_811f_1e17a362679a.slice/crio-302bdc2423f137ad1cdf1cfb0d7073ea076d08262768584d294df4a678d74620 WatchSource:0}: Error finding container 302bdc2423f137ad1cdf1cfb0d7073ea076d08262768584d294df4a678d74620: Status 404 returned error can't find the container with id 302bdc2423f137ad1cdf1cfb0d7073ea076d08262768584d294df4a678d74620 Sep 10 10:35:44.013653 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.013631 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf"] Sep 10 10:35:44.032004 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:44.031980 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed4219b_8cd3_44c7_b103_c72a634ae9a5.slice/crio-efd4fd0cd9a94170d0903db9badfc47aa5b1c906fab51cc72e633682fc79ad50 WatchSource:0}: Error finding container efd4fd0cd9a94170d0903db9badfc47aa5b1c906fab51cc72e633682fc79ad50: Status 404 returned error can't find the container with id efd4fd0cd9a94170d0903db9badfc47aa5b1c906fab51cc72e633682fc79ad50 Sep 10 10:35:44.052233 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.052211 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm"] Sep 10 10:35:44.078245 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.078218 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqhpd"] Sep 10 10:35:44.080993 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:44.080969 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1a990e_fa6c_4e25_8464_a5f18ea27e75.slice/crio-2b217127cb2238bb80f11971355ce1176678e9c72cdc6ccc5c995a6c2df9a2e5 WatchSource:0}: Error finding container 2b217127cb2238bb80f11971355ce1176678e9c72cdc6ccc5c995a6c2df9a2e5: Status 404 returned error can't find the container with id 2b217127cb2238bb80f11971355ce1176678e9c72cdc6ccc5c995a6c2df9a2e5 Sep 10 10:35:44.098316 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.098291 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" event={"ID":"725e4b71-a490-421b-bdde-ac228899337a","Type":"ContainerStarted","Data":"e62b7f812a8cf68ad8238678f37b5c81e56bdf7c25f8fa04aefec0965e262a26"} Sep 10 10:35:44.099919 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.099896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" event={"ID":"bed4219b-8cd3-44c7-b103-c72a634ae9a5","Type":"ContainerStarted","Data":"efd4fd0cd9a94170d0903db9badfc47aa5b1c906fab51cc72e633682fc79ad50"} Sep 10 10:35:44.101122 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.101087 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnkj7" event={"ID":"4ed4c76f-8059-4a53-969d-cc5b62a4e493","Type":"ContainerStarted","Data":"b1c5c881a4c6c516c1feec2f9e6bbc0763cbdc98799aefea0eb0dacd316d51c6"} Sep 10 10:35:44.102679 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.102661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqhpd" event={"ID":"7a1a990e-fa6c-4e25-8464-a5f18ea27e75","Type":"ContainerStarted","Data":"2b217127cb2238bb80f11971355ce1176678e9c72cdc6ccc5c995a6c2df9a2e5"} Sep 10 10:35:44.104204 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.104185 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" event={"ID":"5c000a92-6582-4844-811f-1e17a362679a","Type":"ContainerStarted","Data":"61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409"} Sep 10 10:35:44.104287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.104223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" event={"ID":"5c000a92-6582-4844-811f-1e17a362679a","Type":"ContainerStarted","Data":"302bdc2423f137ad1cdf1cfb0d7073ea076d08262768584d294df4a678d74620"} Sep 10 10:35:44.104287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.104266 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:35:44.106020 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.105986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cwjm6" event={"ID":"b96fbb0c-ffd8-4108-b549-63268fba21e9","Type":"ContainerStarted","Data":"ba7173374a7b353cc074a87d79f1708848dc9b5b545695e0e518526de29bace7"} Sep 10 10:35:44.110555 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.110530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c72pg" event={"ID":"a45a92c6-9ea5-4f4a-a813-89ec733ea0db","Type":"ContainerStarted","Data":"7bc27c2facc62481ea1bba6636124f1d13a7ca535648016d852114b927057944"} Sep 10 10:35:44.110638 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.110574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c72pg" event={"ID":"a45a92c6-9ea5-4f4a-a813-89ec733ea0db","Type":"ContainerStarted","Data":"b75df5d57da4fde7626c810de736418619e94b58caff1547cf4e961353b585f0"} Sep 10 10:35:44.110681 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.110661 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:35:44.129298 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.129255 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" podStartSLOduration=45.129242989 podStartE2EDuration="45.129242989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:44.128288135 +0000 UTC m=+66.934354950" watchObservedRunningTime="2026-09-10 10:35:44.129242989 +0000 UTC m=+66.935309683" Sep 10 10:35:44.137112 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.137076 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dc99bb984-k9f94"] Sep 10 10:35:44.140920 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:44.140891 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec7ae5e_c8bf_4bc5_bfb3_61736c0d8d18.slice/crio-85b016c09b72b0ff5814a295487a58759795aa77d88fe54298b56e89da2d19ee WatchSource:0}: Error finding container 85b016c09b72b0ff5814a295487a58759795aa77d88fe54298b56e89da2d19ee: Status 404 returned error can't find the container with id 85b016c09b72b0ff5814a295487a58759795aa77d88fe54298b56e89da2d19ee Sep 10 10:35:44.148643 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:44.148600 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c72pg" podStartSLOduration=66.148587815 podStartE2EDuration="1m6.148587815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:44.148420717 +0000 UTC m=+66.954487433" watchObservedRunningTime="2026-09-10 10:35:44.148587815 +0000 UTC m=+66.954654499" Sep 10 10:35:45.119406 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:45.118891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc99bb984-k9f94" event={"ID":"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18","Type":"ContainerStarted","Data":"2ef380dc81d2a691b9820b23d934d0c85299c7f03d80a22ed99541bb5efad842"} Sep 10 10:35:45.119406 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:45.118944 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dc99bb984-k9f94" event={"ID":"1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18","Type":"ContainerStarted","Data":"85b016c09b72b0ff5814a295487a58759795aa77d88fe54298b56e89da2d19ee"} Sep 10 10:35:45.145309 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:45.144234 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dc99bb984-k9f94" podStartSLOduration=43.144214701 podStartE2EDuration="43.144214701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:45.142560281 +0000 UTC m=+67.948626998" watchObservedRunningTime="2026-09-10 10:35:45.144214701 +0000 UTC m=+67.950281399" Sep 10 10:35:45.863191 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:45.863150 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:45.866036 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:45.866013 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:46.125004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:46.124934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cwjm6" event={"ID":"b96fbb0c-ffd8-4108-b549-63268fba21e9","Type":"ContainerStarted","Data":"7a5ad4037fa2f8d2edc468478b1ff245373d956db7144b44d974e3e3a17e329e"} Sep 10 10:35:46.125004 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:46.124994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cwjm6" event={"ID":"b96fbb0c-ffd8-4108-b549-63268fba21e9","Type":"ContainerStarted","Data":"66856fe7c483ad722cd53538caa28c69d8c23be3ac8d3728544b00e14dc44edf"} Sep 10 10:35:46.125456 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:46.125330 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:46.126563 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:46.126539 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dc99bb984-k9f94" Sep 10 10:35:46.141712 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:46.141662 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cwjm6" podStartSLOduration=66.869035924 podStartE2EDuration="1m8.141646349s" totalImagesPullingTime="1.272610425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:46.14107823 +0000 UTC m=+68.947144924" watchObservedRunningTime="2026-09-10 10:35:46.141646349 +0000 UTC m=+68.947713044" Sep 10 10:35:49.137847 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.137810 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" event={"ID":"725e4b71-a490-421b-bdde-ac228899337a","Type":"ContainerStarted","Data":"a59ed940c875d90466e0ebbe202abf6b79e00130b5ff388caaf89cc3771bbadb"} Sep 10 10:35:49.138263 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.137902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" event={"ID":"725e4b71-a490-421b-bdde-ac228899337a","Type":"ContainerStarted","Data":"a379e692e7eca1345a4f4141a3c0d85b32a4dfe53e897c64b69d6fb282e1a1d2"} Sep 10 10:35:49.139338 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.139314 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" event={"ID":"bed4219b-8cd3-44c7-b103-c72a634ae9a5","Type":"ContainerStarted","Data":"afbb252514db1a011eec1b96c430d96dd5b7ff08398e2ab77a37af4cab61bb49"} Sep 10 10:35:49.140766 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.140739 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rnkj7" event={"ID":"4ed4c76f-8059-4a53-969d-cc5b62a4e493","Type":"ContainerStarted","Data":"afd65d837d39a984f1fb1abd401276dee079228d8aa101692f32fe4d17d13ddb"} Sep 10 10:35:49.142516 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.142488 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqhpd" event={"ID":"7a1a990e-fa6c-4e25-8464-a5f18ea27e75","Type":"ContainerStarted","Data":"1fdcaf8e417dd4adc5a554d41acfe9ed529be745c37c044fde20f5c591f92cdc"} Sep 10 10:35:49.142593 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.142528 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqhpd" event={"ID":"7a1a990e-fa6c-4e25-8464-a5f18ea27e75","Type":"ContainerStarted","Data":"dd46644b2ecc2ea44d9b3aca679ec663008f92ad8edb8f03a9e2f320553fdf98"} Sep 10 10:35:49.142593 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.142549 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:49.156479 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.156439 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-42zrm" podStartSLOduration=42.78120162 podStartE2EDuration="47.156424232s" totalImagesPullingTime="4.375222612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:49.155573603 +0000 UTC m=+71.961640342" watchObservedRunningTime="2026-09-10 10:35:49.156424232 +0000 UTC m=+71.962490979" Sep 10 10:35:49.171257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.171214 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rnkj7" podStartSLOduration=66.476200607 podStartE2EDuration="1m11.171201504s" totalImagesPullingTime="4.695000897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 10:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:49.170227786 +0000 UTC m=+71.976294480" watchObservedRunningTime="2026-09-10 10:35:49.171201504 +0000 UTC m=+71.977268198" Sep 10 10:35:49.186550 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.186513 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-xvltf" podStartSLOduration=42.761779434 podStartE2EDuration="47.18650097s" totalImagesPullingTime="4.424721536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:49.185387088 +0000 UTC m=+71.991453796" watchObservedRunningTime="2026-09-10 10:35:49.18650097 +0000 UTC m=+71.992567664" Sep 10 10:35:49.202299 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:49.202258 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pqhpd" podStartSLOduration=33.829722231 podStartE2EDuration="38.202248502s" totalImagesPullingTime="4.372526271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:49.201438178 +0000 UTC m=+72.007504873" watchObservedRunningTime="2026-09-10 10:35:49.202248502 +0000 UTC m=+72.008315220" Sep 10 10:35:53.134805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.134768 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-gp28g"] Sep 10 10:35:53.162592 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.162558 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-gp28g"] Sep 10 10:35:53.162721 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.162657 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.165124 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.165076 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 10:35:53.165989 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.165972 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 10:35:53.166086 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.165972 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 10:35:53.166086 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.166026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7mlzs\"" Sep 10 10:35:53.273726 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.273699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6595a226-9771-4612-b955-781ee153883d-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.273839 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.273749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wxwv\" (UniqueName: \"kubernetes.io/projected/6595a226-9771-4612-b955-781ee153883d-kube-api-access-8wxwv\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.273839 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.273801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6595a226-9771-4612-b955-781ee153883d-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.273839 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.273827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6595a226-9771-4612-b955-781ee153883d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.374876 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.374853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6595a226-9771-4612-b955-781ee153883d-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.375000 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.374961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wxwv\" (UniqueName: \"kubernetes.io/projected/6595a226-9771-4612-b955-781ee153883d-kube-api-access-8wxwv\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.375000 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.374994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6595a226-9771-4612-b955-781ee153883d-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.375155 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.375011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6595a226-9771-4612-b955-781ee153883d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.375525 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.375504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6595a226-9771-4612-b955-781ee153883d-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.377319 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.377291 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6595a226-9771-4612-b955-781ee153883d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.377423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.377387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6595a226-9771-4612-b955-781ee153883d-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.384247 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.384226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wxwv\" (UniqueName: \"kubernetes.io/projected/6595a226-9771-4612-b955-781ee153883d-kube-api-access-8wxwv\") pod \"prometheus-operator-6f4946db56-gp28g\" (UID: \"6595a226-9771-4612-b955-781ee153883d\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.471656 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.471607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" Sep 10 10:35:53.759296 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:53.759231 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-gp28g"] Sep 10 10:35:53.761951 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:53.761924 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6595a226_9771_4612_b955_781ee153883d.slice/crio-09a3d6ae4f91327d092c35bcdb8b382b7b5936139b1868e6f6af125c5d17e8c8 WatchSource:0}: Error finding container 09a3d6ae4f91327d092c35bcdb8b382b7b5936139b1868e6f6af125c5d17e8c8: Status 404 returned error can't find the container with id 09a3d6ae4f91327d092c35bcdb8b382b7b5936139b1868e6f6af125c5d17e8c8 Sep 10 10:35:54.161313 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:54.161281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" event={"ID":"6595a226-9771-4612-b955-781ee153883d","Type":"ContainerStarted","Data":"09a3d6ae4f91327d092c35bcdb8b382b7b5936139b1868e6f6af125c5d17e8c8"} Sep 10 10:35:54.703945 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:54.703918 2556 scope.go:117] "RemoveContainer" containerID="55f1ebbe4170fcdcab3a4661e5da7cc04adeef4b96d3f12d1b58a6e64924a88c" Sep 10 10:35:55.167025 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:55.167000 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:35:55.167501 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:55.167059 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-lvw66" event={"ID":"bf38c067-aa09-4fdd-8a48-843ad63dc145","Type":"ContainerStarted","Data":"5ae40eb6dc15cdeca342e7157458c5eb1a3ff7d9f5e036f8a1ee092dda2bb41e"} Sep 10 10:35:55.167501 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:55.167338 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:55.265906 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:55.265874 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-lvw66" Sep 10 10:35:56.172133 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:56.172078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" event={"ID":"6595a226-9771-4612-b955-781ee153883d","Type":"ContainerStarted","Data":"d3ee635ffefed18bc66ac6c2f8965cceee9998df885ceec73c8018242f5a6106"} Sep 10 10:35:56.172547 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:56.172151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" event={"ID":"6595a226-9771-4612-b955-781ee153883d","Type":"ContainerStarted","Data":"973daff9454d4e9d2d7e2fd9a17bc140bc9d057ec31f18cdcea15465d833c048"} Sep 10 10:35:56.189821 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:56.189774 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-gp28g" podStartSLOduration=1.286460936 podStartE2EDuration="3.189759806s" totalImagesPullingTime="1.90329887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:35:56.188263961 +0000 UTC m=+78.994330647" watchObservedRunningTime="2026-09-10 10:35:56.189759806 +0000 UTC m=+78.995826545" Sep 10 10:35:58.540892 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.540858 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6"] Sep 10 10:35:58.543259 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.543241 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.552376 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.552353 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ws5df\"" Sep 10 10:35:58.552766 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.552752 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 10:35:58.560585 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.560566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 10:35:58.562244 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.562228 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 10:35:58.565847 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.565825 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nqvns"] Sep 10 10:35:58.568011 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.567996 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.574582 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.574550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 10:35:58.574807 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.574786 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4xqbg\"" Sep 10 10:35:58.574952 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.574932 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6"] Sep 10 10:35:58.575052 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.574792 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 10:35:58.575237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.575221 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.716972 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-root\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzbps\" (UniqueName: \"kubernetes.io/projected/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-kube-api-access-qzbps\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb695b8-24e1-43e4-8041-4cb927119ab6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5rxs\" (UniqueName: \"kubernetes.io/projected/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-api-access-s5rxs\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-textfile\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-tls\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fb695b8-24e1-43e4-8041-4cb927119ab6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-sys\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-wtmp\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-metrics-client-ca\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.720600 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.717533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818043 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.818202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fb695b8-24e1-43e4-8041-4cb927119ab6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.818202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-sys\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-wtmp\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-metrics-client-ca\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-sys\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818175 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-root\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818303 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818314 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-wtmp\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzbps\" (UniqueName: \"kubernetes.io/projected/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-kube-api-access-qzbps\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818332 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-root\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb695b8-24e1-43e4-8041-4cb927119ab6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5rxs\" (UniqueName: \"kubernetes.io/projected/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-api-access-s5rxs\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-textfile\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.818493 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-tls\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.819037 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fb695b8-24e1-43e4-8041-4cb927119ab6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.819037 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:58.818669 2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 10:35:58.819037 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:35:58.818727 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-tls podName:4fb695b8-24e1-43e4-8041-4cb927119ab6 nodeName:}" failed. No retries permitted until 2026-09-10 10:35:59.318710088 +0000 UTC m=+82.124776782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-wdlk6" (UID: "4fb695b8-24e1-43e4-8041-4cb927119ab6") : secret "kube-state-metrics-tls" not found Sep 10 10:35:58.819037 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-metrics-client-ca\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.819037 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.818966 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.819037 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.819033 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-accelerators-collector-config\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.819367 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.819232 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-textfile\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.819432 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.819373 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb695b8-24e1-43e4-8041-4cb927119ab6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.820649 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.820620 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.820734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.820724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-node-exporter-tls\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.821067 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.821050 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.827359 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.827337 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzbps\" (UniqueName: \"kubernetes.io/projected/46ec9b3b-087d-409a-93d8-b6cd3d5a520e-kube-api-access-qzbps\") pod \"node-exporter-nqvns\" (UID: \"46ec9b3b-087d-409a-93d8-b6cd3d5a520e\") " pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.828325 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.828305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5rxs\" (UniqueName: \"kubernetes.io/projected/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-api-access-s5rxs\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:58.876813 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:58.876789 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nqvns" Sep 10 10:35:58.887359 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:58.887324 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ec9b3b_087d_409a_93d8_b6cd3d5a520e.slice/crio-e4ff1a9fc76ae343c4c6028da17af695d33d0d00651d6a65b2ae1af99512591f WatchSource:0}: Error finding container e4ff1a9fc76ae343c4c6028da17af695d33d0d00651d6a65b2ae1af99512591f: Status 404 returned error can't find the container with id e4ff1a9fc76ae343c4c6028da17af695d33d0d00651d6a65b2ae1af99512591f Sep 10 10:35:59.147883 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:59.147821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pqhpd" Sep 10 10:35:59.184373 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:59.184344 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqvns" event={"ID":"46ec9b3b-087d-409a-93d8-b6cd3d5a520e","Type":"ContainerStarted","Data":"e4ff1a9fc76ae343c4c6028da17af695d33d0d00651d6a65b2ae1af99512591f"} Sep 10 10:35:59.322233 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:59.322200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:59.324647 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:59.324622 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fb695b8-24e1-43e4-8041-4cb927119ab6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-wdlk6\" (UID: \"4fb695b8-24e1-43e4-8041-4cb927119ab6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:59.451578 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:59.451509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" Sep 10 10:35:59.743051 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:35:59.743024 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6"] Sep 10 10:35:59.918752 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:35:59.918721 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb695b8_24e1_43e4_8041_4cb927119ab6.slice/crio-2c89b2834abebca4fec6b2b0d33e5a6c329d0a55b75e38609b96307b6bc861cc WatchSource:0}: Error finding container 2c89b2834abebca4fec6b2b0d33e5a6c329d0a55b75e38609b96307b6bc861cc: Status 404 returned error can't find the container with id 2c89b2834abebca4fec6b2b0d33e5a6c329d0a55b75e38609b96307b6bc861cc Sep 10 10:36:00.189721 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.189688 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" event={"ID":"4fb695b8-24e1-43e4-8041-4cb927119ab6","Type":"ContainerStarted","Data":"2c89b2834abebca4fec6b2b0d33e5a6c329d0a55b75e38609b96307b6bc861cc"} Sep 10 10:36:00.191348 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.191325 2556 generic.go:356] "Generic (PLEG): container finished" podID="46ec9b3b-087d-409a-93d8-b6cd3d5a520e" containerID="30912cf81352c269ce78553f63e7fc070dcef6fe0c65132bdc888da6113a8073" exitCode=0 Sep 10 10:36:00.191447 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.191372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqvns" event={"ID":"46ec9b3b-087d-409a-93d8-b6cd3d5a520e","Type":"ContainerDied","Data":"30912cf81352c269ce78553f63e7fc070dcef6fe0c65132bdc888da6113a8073"} Sep 10 10:36:00.493589 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.493478 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c47bc4998-6kq7r"] Sep 10 10:36:00.497332 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.497305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.499823 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.499737 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 10:36:00.499823 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.499741 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 10:36:00.500081 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.499920 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 10:36:00.500081 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.500042 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 10:36:00.500211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.500103 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-v2fi3pvi8b3i\"" Sep 10 10:36:00.500211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.500143 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cdsxx\"" Sep 10 10:36:00.500211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.500162 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 10:36:00.509230 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.509203 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c47bc4998-6kq7r"] Sep 10 10:36:00.633435 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633435 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633609 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633609 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-grpc-tls\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633609 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633583 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-metrics-client-ca\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633609 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-tls\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633760 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjp5j\" (UniqueName: \"kubernetes.io/projected/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-kube-api-access-xjp5j\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.633760 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.633666 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.734704 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.734669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.734846 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.734715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.734846 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.734759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.734846 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.734794 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-grpc-tls\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.735017 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.734989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-metrics-client-ca\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.735074 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.735039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-tls\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.735160 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.735079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjp5j\" (UniqueName: \"kubernetes.io/projected/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-kube-api-access-xjp5j\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.735160 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.735133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.736320 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.736276 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-metrics-client-ca\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.737738 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.737711 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.737857 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.737742 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.738290 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.737939 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-tls\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.738290 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.738004 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.738429 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.738357 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.738733 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.738716 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-secret-grpc-tls\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.744777 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.744753 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjp5j\" (UniqueName: \"kubernetes.io/projected/5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a-kube-api-access-xjp5j\") pod \"thanos-querier-6c47bc4998-6kq7r\" (UID: \"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a\") " pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:00.808718 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:00.808666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:01.095161 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:01.095083 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c47bc4998-6kq7r"] Sep 10 10:36:01.166878 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:36:01.166844 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7b8b31_cbac_4fe9_aa2b_cf4fa6362d2a.slice/crio-0e58ca9d5746900c531c8c05de65f521882d1bc49699e3344af2c5c22350efb7 WatchSource:0}: Error finding container 0e58ca9d5746900c531c8c05de65f521882d1bc49699e3344af2c5c22350efb7: Status 404 returned error can't find the container with id 0e58ca9d5746900c531c8c05de65f521882d1bc49699e3344af2c5c22350efb7 Sep 10 10:36:01.195779 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:01.195754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"0e58ca9d5746900c531c8c05de65f521882d1bc49699e3344af2c5c22350efb7"} Sep 10 10:36:01.198017 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:01.197995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqvns" event={"ID":"46ec9b3b-087d-409a-93d8-b6cd3d5a520e","Type":"ContainerStarted","Data":"69719b96b6dddf8840f042820a2c7b6df12be1b9c787e4af186580a5d4a13e27"} Sep 10 10:36:01.198074 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:01.198042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nqvns" event={"ID":"46ec9b3b-087d-409a-93d8-b6cd3d5a520e","Type":"ContainerStarted","Data":"6c0b51db0b877e8b420bf5ac90aa1ea392da041e459c201a5ca5f501cb6706bd"} Sep 10 10:36:01.221103 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:01.221048 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nqvns" podStartSLOduration=2.091486484 podStartE2EDuration="3.221034264s" totalImagesPullingTime="1.066174912s" totalInitContainerRuntime="63.372868ms" isStatefulPod=true podCreationTimestamp="2026-09-10 10:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:01.220033153 +0000 UTC m=+84.026099859" watchObservedRunningTime="2026-09-10 10:36:01.221034264 +0000 UTC m=+84.027100988" Sep 10 10:36:02.204745 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:02.204710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" event={"ID":"4fb695b8-24e1-43e4-8041-4cb927119ab6","Type":"ContainerStarted","Data":"241eac43ec67a4a7cf874d7c1cdc26ab339b69cfd8d63c1cc5d2083a129830d9"} Sep 10 10:36:02.205237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:02.204776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" event={"ID":"4fb695b8-24e1-43e4-8041-4cb927119ab6","Type":"ContainerStarted","Data":"3d6eeb5938d88bec04ef8997e597a27383b967216a0afd12e552b08c0025986e"} Sep 10 10:36:02.205237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:02.204805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" event={"ID":"4fb695b8-24e1-43e4-8041-4cb927119ab6","Type":"ContainerStarted","Data":"923307a39ec076aa6a054d327f562af2a1f13ed3e41e24fcb0f3b61e90b0d3f3"} Sep 10 10:36:02.229755 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:02.229674 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-wdlk6" podStartSLOduration=2.953753978 podStartE2EDuration="4.229653191s" totalImagesPullingTime="1.275899213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:02.229537802 +0000 UTC m=+85.035604497" watchObservedRunningTime="2026-09-10 10:36:02.229653191 +0000 UTC m=+85.035719886" Sep 10 10:36:03.286045 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.286009 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5"] Sep 10 10:36:03.288459 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.288437 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.290705 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.290682 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 10 10:36:03.290788 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.290756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jszkp\"" Sep 10 10:36:03.298398 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.298374 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5"] Sep 10 10:36:03.461395 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.461368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de65ac04-3715-476d-88d0-6d55513fccd5-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6dld5\" (UID: \"de65ac04-3715-476d-88d0-6d55513fccd5\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.461521 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.461417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlthf\" (UniqueName: \"kubernetes.io/projected/de65ac04-3715-476d-88d0-6d55513fccd5-kube-api-access-jlthf\") pod \"monitoring-plugin-85bbbbbf4-6dld5\" (UID: \"de65ac04-3715-476d-88d0-6d55513fccd5\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.562869 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.562752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlthf\" (UniqueName: \"kubernetes.io/projected/de65ac04-3715-476d-88d0-6d55513fccd5-kube-api-access-jlthf\") pod \"monitoring-plugin-85bbbbbf4-6dld5\" (UID: \"de65ac04-3715-476d-88d0-6d55513fccd5\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.562869 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.562867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de65ac04-3715-476d-88d0-6d55513fccd5-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6dld5\" (UID: \"de65ac04-3715-476d-88d0-6d55513fccd5\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.565294 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.565270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de65ac04-3715-476d-88d0-6d55513fccd5-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6dld5\" (UID: \"de65ac04-3715-476d-88d0-6d55513fccd5\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.572257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.572234 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlthf\" (UniqueName: \"kubernetes.io/projected/de65ac04-3715-476d-88d0-6d55513fccd5-kube-api-access-jlthf\") pod \"monitoring-plugin-85bbbbbf4-6dld5\" (UID: \"de65ac04-3715-476d-88d0-6d55513fccd5\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.598793 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.598753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:03.869935 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:03.869912 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5"] Sep 10 10:36:03.872478 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:36:03.872443 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde65ac04_3715_476d_88d0_6d55513fccd5.slice/crio-90a1993f99b81f49b971e2a0471ec9c2961270bbe5cc6f3d21dcd7d082e7077b WatchSource:0}: Error finding container 90a1993f99b81f49b971e2a0471ec9c2961270bbe5cc6f3d21dcd7d082e7077b: Status 404 returned error can't find the container with id 90a1993f99b81f49b971e2a0471ec9c2961270bbe5cc6f3d21dcd7d082e7077b Sep 10 10:36:04.214646 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:04.214553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" event={"ID":"de65ac04-3715-476d-88d0-6d55513fccd5","Type":"ContainerStarted","Data":"90a1993f99b81f49b971e2a0471ec9c2961270bbe5cc6f3d21dcd7d082e7077b"} Sep 10 10:36:04.216601 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:04.216576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"e74c5176b7da835e4ecd77091c9a2803730c9c25e8d532cbf315f8ae88460613"} Sep 10 10:36:04.216709 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:04.216633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"5f0d7e7c555f8c8e89b1923ae952236e426856cf0ae129138647646dbc38cb25"} Sep 10 10:36:04.216709 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:04.216658 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"fa3ee5f8b3fd85734e7b0a7d43175d1d54eac1d1912f1452bcdb3c43cb50fef3"} Sep 10 10:36:05.124026 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:05.123993 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:36:05.223822 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:05.223782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"fbc097071c4cd9dfd1b2ec63f26ab69243a979ca553797045c4a3ed93d37f940"} Sep 10 10:36:05.223974 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:05.223871 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"e4e9081646541f9a4db23eb4e610b33e7e58d7959388c26ddb782b6b26015191"} Sep 10 10:36:05.223974 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:05.223913 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" event={"ID":"5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a","Type":"ContainerStarted","Data":"b2d8dcc90887b30dd2d9127bde70a6748dcfc554cbd9831c49550976ee5689ef"} Sep 10 10:36:05.224068 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:05.224052 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:05.272012 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:05.271956 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" podStartSLOduration=1.991419691 podStartE2EDuration="5.271934634s" totalImagesPullingTime="3.280514943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:36:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:05.260570426 +0000 UTC m=+88.066637145" watchObservedRunningTime="2026-09-10 10:36:05.271934634 +0000 UTC m=+88.078001327" Sep 10 10:36:06.229920 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:06.229882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" event={"ID":"de65ac04-3715-476d-88d0-6d55513fccd5","Type":"ContainerStarted","Data":"4baccc59b0896f89f4f5b241fdff5ab6fffcffc9733930450d4f84138e084978"} Sep 10 10:36:06.230359 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:06.230245 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:06.234950 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:06.234929 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" Sep 10 10:36:06.249146 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:06.249110 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6dld5" podStartSLOduration=1.41466676 podStartE2EDuration="3.249081261s" totalImagesPullingTime="1.834414501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:06.247584102 +0000 UTC m=+89.053650809" watchObservedRunningTime="2026-09-10 10:36:06.249081261 +0000 UTC m=+89.055147955" Sep 10 10:36:07.652556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:07.652526 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f74589979-pbxzt"] Sep 10 10:36:11.235655 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:11.235622 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c47bc4998-6kq7r" Sep 10 10:36:13.753413 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.753383 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7474fc466-g2rs2"] Sep 10 10:36:13.756346 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.756322 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.759912 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.759883 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 10:36:13.760086 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.760066 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 10:36:13.761023 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.761000 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4vtj6\"" Sep 10 10:36:13.761152 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.760999 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 10:36:13.761152 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.761006 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 10:36:13.761484 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.761168 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 10:36:13.762237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.762170 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 10:36:13.762237 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.762202 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 10:36:13.765815 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.765792 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 10:36:13.767048 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.767028 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7474fc466-g2rs2"] Sep 10 10:36:13.846188 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846162 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-oauth-config\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.846292 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846202 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-config\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.846292 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvlfm\" (UniqueName: \"kubernetes.io/projected/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-kube-api-access-fvlfm\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.846366 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-oauth-serving-cert\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.846366 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-service-ca\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.846366 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-trusted-ca-bundle\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.846461 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.846365 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-serving-cert\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947702 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-oauth-serving-cert\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-service-ca\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-trusted-ca-bundle\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947747 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-serving-cert\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947776 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-oauth-config\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-config\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.947835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.947830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvlfm\" (UniqueName: \"kubernetes.io/projected/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-kube-api-access-fvlfm\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.948502 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.948476 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-service-ca\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.948614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.948516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-oauth-serving-cert\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.948614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.948560 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-config\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.948614 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.948589 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-trusted-ca-bundle\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.949981 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.949952 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-serving-cert\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.950113 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.950078 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-oauth-config\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:13.956598 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:13.956577 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvlfm\" (UniqueName: \"kubernetes.io/projected/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-kube-api-access-fvlfm\") pod \"console-7474fc466-g2rs2\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:14.067652 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:14.067627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:14.337563 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:14.337437 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7474fc466-g2rs2"] Sep 10 10:36:14.339700 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:36:14.339667 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b9e983_1c8c_4beb_aa05_c1e3a0240d95.slice/crio-d024a3a076365df06cd42c84623906e776c66d4f3e573ff722c6b7db045dc0aa WatchSource:0}: Error finding container d024a3a076365df06cd42c84623906e776c66d4f3e573ff722c6b7db045dc0aa: Status 404 returned error can't find the container with id d024a3a076365df06cd42c84623906e776c66d4f3e573ff722c6b7db045dc0aa Sep 10 10:36:15.121481 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:15.121451 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c72pg" Sep 10 10:36:15.267281 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:15.267238 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7474fc466-g2rs2" event={"ID":"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95","Type":"ContainerStarted","Data":"d024a3a076365df06cd42c84623906e776c66d4f3e573ff722c6b7db045dc0aa"} Sep 10 10:36:18.281849 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:18.281813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7474fc466-g2rs2" event={"ID":"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95","Type":"ContainerStarted","Data":"a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245"} Sep 10 10:36:18.301482 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:18.301435 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7474fc466-g2rs2" podStartSLOduration=2.145242714 podStartE2EDuration="5.301415397s" totalImagesPullingTime="3.156172683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:36:18.300498512 +0000 UTC m=+101.106565227" watchObservedRunningTime="2026-09-10 10:36:18.301415397 +0000 UTC m=+101.107482090" Sep 10 10:36:24.067815 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:24.067776 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:24.068201 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:24.067850 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:24.072708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:24.072687 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:24.309366 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:24.309339 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:36:26.313958 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:26.313922 2556 generic.go:356] "Generic (PLEG): container finished" podID="e4bb97fa-c372-4efd-879a-07944f3893bf" containerID="eea5d85d65daae69701e9f8743625db7c4d5ce85c6e0c6dfbbf661e6d915e716" exitCode=0 Sep 10 10:36:26.314359 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:26.313998 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" event={"ID":"e4bb97fa-c372-4efd-879a-07944f3893bf","Type":"ContainerDied","Data":"eea5d85d65daae69701e9f8743625db7c4d5ce85c6e0c6dfbbf661e6d915e716"} Sep 10 10:36:26.314459 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:26.314443 2556 scope.go:117] "RemoveContainer" containerID="eea5d85d65daae69701e9f8743625db7c4d5ce85c6e0c6dfbbf661e6d915e716" Sep 10 10:36:27.320243 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:27.320208 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fxzbc" event={"ID":"e4bb97fa-c372-4efd-879a-07944f3893bf","Type":"ContainerStarted","Data":"9a25be2949b8dd23c8f7ec123b95f7657a704c1db17a0b2f1fe650a764d4b6d6"} Sep 10 10:36:32.672207 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.672166 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" podUID="5c000a92-6582-4844-811f-1e17a362679a" containerName="registry" containerID="cri-o://61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409" gracePeriod=30 Sep 10 10:36:32.908809 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.908784 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:36:32.993464 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993386 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-installation-pull-secrets\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993464 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993437 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-registry-certificates\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993464 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993456 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-image-registry-private-configuration\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993752 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993488 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-trusted-ca\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993752 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993527 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c000a92-6582-4844-811f-1e17a362679a-ca-trust-extracted\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993752 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993557 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pmms\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-kube-api-access-5pmms\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993752 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993593 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993752 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993624 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-bound-sa-token\") pod \"5c000a92-6582-4844-811f-1e17a362679a\" (UID: \"5c000a92-6582-4844-811f-1e17a362679a\") " Sep 10 10:36:32.993993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993948 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:36:32.994051 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.993989 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:36:32.996061 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.995995 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:36:32.996061 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.996003 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:36:32.996357 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.996332 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:36:32.996423 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.996359 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-kube-api-access-5pmms" (OuterVolumeSpecName: "kube-api-access-5pmms") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "kube-api-access-5pmms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:36:32.996485 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:32.996420 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:36:33.002310 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.002276 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c000a92-6582-4844-811f-1e17a362679a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5c000a92-6582-4844-811f-1e17a362679a" (UID: "5c000a92-6582-4844-811f-1e17a362679a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:36:33.094163 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094127 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5c000a92-6582-4844-811f-1e17a362679a-ca-trust-extracted\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094163 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094161 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pmms\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-kube-api-access-5pmms\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094163 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094172 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094181 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5c000a92-6582-4844-811f-1e17a362679a-bound-sa-token\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094189 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-installation-pull-secrets\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094197 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-registry-certificates\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094208 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5c000a92-6582-4844-811f-1e17a362679a-image-registry-private-configuration\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.094326 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.094216 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c000a92-6582-4844-811f-1e17a362679a-trusted-ca\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:36:33.345833 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.345799 2556 generic.go:356] "Generic (PLEG): container finished" podID="5c000a92-6582-4844-811f-1e17a362679a" containerID="61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409" exitCode=0 Sep 10 10:36:33.345976 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.345849 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" Sep 10 10:36:33.345976 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.345877 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" event={"ID":"5c000a92-6582-4844-811f-1e17a362679a","Type":"ContainerDied","Data":"61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409"} Sep 10 10:36:33.345976 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.345924 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f74589979-pbxzt" event={"ID":"5c000a92-6582-4844-811f-1e17a362679a","Type":"ContainerDied","Data":"302bdc2423f137ad1cdf1cfb0d7073ea076d08262768584d294df4a678d74620"} Sep 10 10:36:33.345976 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.345945 2556 scope.go:117] "RemoveContainer" containerID="61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409" Sep 10 10:36:33.354528 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.354509 2556 scope.go:117] "RemoveContainer" containerID="61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409" Sep 10 10:36:33.354806 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:36:33.354787 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409\": container with ID starting with 61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409 not found: ID does not exist" containerID="61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409" Sep 10 10:36:33.354870 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.354817 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409"} err="failed to get container status \"61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409\": rpc error: code = NotFound desc = could not find container \"61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409\": container with ID starting with 61fbc125c656c06588b7c9e3fd16ed6cb29b759e1d3fed7a70f3bbada1ced409 not found: ID does not exist" Sep 10 10:36:33.377559 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.377532 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f74589979-pbxzt"] Sep 10 10:36:33.378763 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.378743 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f74589979-pbxzt"] Sep 10 10:36:33.708827 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:33.708750 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c000a92-6582-4844-811f-1e17a362679a" path="/var/lib/kubelet/pods/5c000a92-6582-4844-811f-1e17a362679a/volumes" Sep 10 10:36:35.357032 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:35.356996 2556 generic.go:356] "Generic (PLEG): container finished" podID="b0978729-e8b1-4974-a1e9-7fd009be2e84" containerID="e20d261b44604d3feb524323b439ca8f2e8b5ed5eb71c7e3a17e7dd46bf11195" exitCode=0 Sep 10 10:36:35.357407 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:35.357067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" event={"ID":"b0978729-e8b1-4974-a1e9-7fd009be2e84","Type":"ContainerDied","Data":"e20d261b44604d3feb524323b439ca8f2e8b5ed5eb71c7e3a17e7dd46bf11195"} Sep 10 10:36:35.357407 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:35.357396 2556 scope.go:117] "RemoveContainer" containerID="e20d261b44604d3feb524323b439ca8f2e8b5ed5eb71c7e3a17e7dd46bf11195" Sep 10 10:36:36.362939 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:36.362905 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-lzpsv" event={"ID":"b0978729-e8b1-4974-a1e9-7fd009be2e84","Type":"ContainerStarted","Data":"6ce775db1adb93e28f450222a29059927ad20846ead334b93c82a3f4d4931db6"} Sep 10 10:36:56.447384 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:56.447348 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc" containerID="4c4de5dab17b182519b45bd76c75309cf34f79beaafbc7abf3acafaff232b934" exitCode=0 Sep 10 10:36:56.447790 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:56.447421 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" event={"ID":"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc","Type":"ContainerDied","Data":"4c4de5dab17b182519b45bd76c75309cf34f79beaafbc7abf3acafaff232b934"} Sep 10 10:36:56.447790 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:56.447708 2556 scope.go:117] "RemoveContainer" containerID="4c4de5dab17b182519b45bd76c75309cf34f79beaafbc7abf3acafaff232b934" Sep 10 10:36:57.453857 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:36:57.453826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-h7kwl" event={"ID":"5f362aa4-d2f8-45f4-9acf-bca0a9cc57dc","Type":"ContainerStarted","Data":"38487699a118336e5e74a295a39a50e6d7a1944a322a10a54459c3ab8cc6032c"} Sep 10 10:37:26.714208 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:26.714174 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7474fc466-g2rs2"] Sep 10 10:37:51.735694 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:51.735604 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7474fc466-g2rs2" podUID="b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" containerName="console" containerID="cri-o://a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245" gracePeriod=15 Sep 10 10:37:51.978442 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:51.978419 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:37:52.062993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.062924 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-config\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.062993 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.062973 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-oauth-serving-cert\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.063222 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063011 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvlfm\" (UniqueName: \"kubernetes.io/projected/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-kube-api-access-fvlfm\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.063222 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063066 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-oauth-config\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.063222 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063131 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-trusted-ca-bundle\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.063222 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063158 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-service-ca\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.063222 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063187 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-serving-cert\") pod \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\" (UID: \"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95\") " Sep 10 10:37:52.063453 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063409 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-config" (OuterVolumeSpecName: "console-config") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:37:52.063509 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063463 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:37:52.063562 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063547 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:37:52.063616 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.063558 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:37:52.065324 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.065283 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:37:52.065440 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.065343 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-kube-api-access-fvlfm" (OuterVolumeSpecName: "kube-api-access-fvlfm") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "kube-api-access-fvlfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:37:52.065440 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.065345 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" (UID: "b2b9e983-1c8c-4beb-aa05-c1e3a0240d95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:37:52.164211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164193 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvlfm\" (UniqueName: \"kubernetes.io/projected/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-kube-api-access-fvlfm\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.164211 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164211 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-oauth-config\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.164339 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164220 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-trusted-ca-bundle\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.164339 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164230 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-service-ca\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.164339 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164238 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-serving-cert\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.164339 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164247 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-console-config\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.164339 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.164255 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95-oauth-serving-cert\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:37:52.669372 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.669323 2556 generic.go:356] "Generic (PLEG): container finished" podID="b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" containerID="a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245" exitCode=0 Sep 10 10:37:52.669556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.669386 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7474fc466-g2rs2" Sep 10 10:37:52.669556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.669409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7474fc466-g2rs2" event={"ID":"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95","Type":"ContainerDied","Data":"a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245"} Sep 10 10:37:52.669556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.669462 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7474fc466-g2rs2" event={"ID":"b2b9e983-1c8c-4beb-aa05-c1e3a0240d95","Type":"ContainerDied","Data":"d024a3a076365df06cd42c84623906e776c66d4f3e573ff722c6b7db045dc0aa"} Sep 10 10:37:52.669556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.669483 2556 scope.go:117] "RemoveContainer" containerID="a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245" Sep 10 10:37:52.678527 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.678509 2556 scope.go:117] "RemoveContainer" containerID="a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245" Sep 10 10:37:52.678790 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:37:52.678773 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245\": container with ID starting with a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245 not found: ID does not exist" containerID="a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245" Sep 10 10:37:52.678828 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.678798 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245"} err="failed to get container status \"a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245\": rpc error: code = NotFound desc = could not find container \"a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245\": container with ID starting with a2f2a7d096fb2309cb78293072bc36d63ad56c6b7440ff66f0425e84becf2245 not found: ID does not exist" Sep 10 10:37:52.691610 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.691583 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7474fc466-g2rs2"] Sep 10 10:37:52.695304 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:52.695283 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7474fc466-g2rs2"] Sep 10 10:37:53.709438 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:37:53.709401 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" path="/var/lib/kubelet/pods/b2b9e983-1c8c-4beb-aa05-c1e3a0240d95/volumes" Sep 10 10:39:19.753180 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753141 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk"] Sep 10 10:39:19.753682 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753573 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c000a92-6582-4844-811f-1e17a362679a" containerName="registry" Sep 10 10:39:19.753682 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753593 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c000a92-6582-4844-811f-1e17a362679a" containerName="registry" Sep 10 10:39:19.753682 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753627 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" containerName="console" Sep 10 10:39:19.753682 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753636 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" containerName="console" Sep 10 10:39:19.753882 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753710 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c000a92-6582-4844-811f-1e17a362679a" containerName="registry" Sep 10 10:39:19.753882 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.753725 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b9e983-1c8c-4beb-aa05-c1e3a0240d95" containerName="console" Sep 10 10:39:19.756753 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.756727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:19.759188 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.759169 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 10 10:39:19.759308 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.759198 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 10 10:39:19.759985 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.759971 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-r6bln\"" Sep 10 10:39:19.765029 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.765005 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk"] Sep 10 10:39:19.767903 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.767872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhb9\" (UniqueName: \"kubernetes.io/projected/dde72c02-3451-4bbe-a910-acb8aedbe278-kube-api-access-tvhb9\") pod \"feast-operator-controller-manager-54c97fbb48-8fcrk\" (UID: \"dde72c02-3451-4bbe-a910-acb8aedbe278\") " pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:19.868664 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.868642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhb9\" (UniqueName: \"kubernetes.io/projected/dde72c02-3451-4bbe-a910-acb8aedbe278-kube-api-access-tvhb9\") pod \"feast-operator-controller-manager-54c97fbb48-8fcrk\" (UID: \"dde72c02-3451-4bbe-a910-acb8aedbe278\") " pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:19.877666 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:19.877648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhb9\" (UniqueName: \"kubernetes.io/projected/dde72c02-3451-4bbe-a910-acb8aedbe278-kube-api-access-tvhb9\") pod \"feast-operator-controller-manager-54c97fbb48-8fcrk\" (UID: \"dde72c02-3451-4bbe-a910-acb8aedbe278\") " pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:20.067260 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:20.067244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:20.336826 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:20.336637 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk"] Sep 10 10:39:20.339771 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:39:20.339748 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde72c02_3451_4bbe_a910_acb8aedbe278.slice/crio-8c57aadee68aac5bd5d1a48bfb9e14de1f15ee6f67ddb3610427c4a81b8bb096 WatchSource:0}: Error finding container 8c57aadee68aac5bd5d1a48bfb9e14de1f15ee6f67ddb3610427c4a81b8bb096: Status 404 returned error can't find the container with id 8c57aadee68aac5bd5d1a48bfb9e14de1f15ee6f67ddb3610427c4a81b8bb096 Sep 10 10:39:20.999185 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:20.999147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" event={"ID":"dde72c02-3451-4bbe-a910-acb8aedbe278","Type":"ContainerStarted","Data":"8c57aadee68aac5bd5d1a48bfb9e14de1f15ee6f67ddb3610427c4a81b8bb096"} Sep 10 10:39:23.008421 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:23.008389 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" event={"ID":"dde72c02-3451-4bbe-a910-acb8aedbe278","Type":"ContainerStarted","Data":"8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca"} Sep 10 10:39:23.008785 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:23.008494 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:23.026841 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:23.026798 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" podStartSLOduration=1.823397601 podStartE2EDuration="4.026781779s" totalImagesPullingTime="2.203384178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:39:23.02625818 +0000 UTC m=+285.832324888" watchObservedRunningTime="2026-09-10 10:39:23.026781779 +0000 UTC m=+285.832848474" Sep 10 10:39:34.014805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:34.014773 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:39:37.572168 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:37.572137 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:39:37.574912 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:37.574881 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:39:37.583399 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:37.583379 2556 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 10:39:55.633401 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.633363 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f"] Sep 10 10:39:55.636782 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.636765 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.639344 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.639321 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 10 10:39:55.639459 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.639321 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 10 10:39:55.639459 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.639427 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 10 10:39:55.639578 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.639454 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 10 10:39:55.639980 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.639959 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tcx9w\"" Sep 10 10:39:55.640075 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.639959 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 10 10:39:55.640075 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.640008 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 10 10:39:55.640075 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.640020 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 10 10:39:55.651010 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.650990 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f"] Sep 10 10:39:55.716934 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.716913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgkkh\" (UniqueName: \"kubernetes.io/projected/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-kube-api-access-qgkkh\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.717035 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.716945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-registry-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.717035 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.716967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-offline-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.717035 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.716981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-online-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.717165 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.717049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-ui-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.717165 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.717125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-feast-data\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818409 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-ui-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818498 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-feast-data\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818498 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgkkh\" (UniqueName: \"kubernetes.io/projected/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-kube-api-access-qgkkh\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-registry-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818563 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-offline-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818672 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-online-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.818830 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.818808 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-feast-data\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.821139 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.821118 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-ui-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.821224 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.821160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-online-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.821265 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.821248 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-registry-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.821370 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.821350 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-offline-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.827292 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.827270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgkkh\" (UniqueName: \"kubernetes.io/projected/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-kube-api-access-qgkkh\") pod \"feast-simple-feast-setup-788c8d4b7c-hxl6f\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:55.960513 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:55.960460 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:39:56.235487 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:56.235461 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f"] Sep 10 10:39:56.236992 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:39:56.236960 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode32bbd68_c067_4e68_9ac4_63d47d15a6c8.slice/crio-5c3dc8f003162f0c833e516f0832326be4c896c8ba3447934bbc4af7cefb1e0a WatchSource:0}: Error finding container 5c3dc8f003162f0c833e516f0832326be4c896c8ba3447934bbc4af7cefb1e0a: Status 404 returned error can't find the container with id 5c3dc8f003162f0c833e516f0832326be4c896c8ba3447934bbc4af7cefb1e0a Sep 10 10:39:56.238837 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:56.238820 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 10:39:57.147911 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:39:57.147842 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"5c3dc8f003162f0c833e516f0832326be4c896c8ba3447934bbc4af7cefb1e0a"} Sep 10 10:40:22.262932 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:22.262897 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a"} Sep 10 10:40:27.283622 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:27.283588 2556 generic.go:356] "Generic (PLEG): container finished" podID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerID="641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a" exitCode=0 Sep 10 10:40:27.284073 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:27.283663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a"} Sep 10 10:40:28.289120 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:28.289070 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d"} Sep 10 10:40:33.312147 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:33.312058 2556 generic.go:356] "Generic (PLEG): container finished" podID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerID="1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d" exitCode=0 Sep 10 10:40:33.312455 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:33.312143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d"} Sep 10 10:40:34.322984 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.322940 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd"} Sep 10 10:40:34.323492 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.323003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b"} Sep 10 10:40:34.323492 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.323025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6"} Sep 10 10:40:34.323492 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.323047 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerStarted","Data":"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0"} Sep 10 10:40:34.350176 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.350112 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podStartSLOduration=13.830335664 podStartE2EDuration="39.350072224s" totalImagesPullingTime="25.51973656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:40:34.34792351 +0000 UTC m=+357.153990206" watchObservedRunningTime="2026-09-10 10:40:34.350072224 +0000 UTC m=+357.156138919" Sep 10 10:40:34.961172 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.961136 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:34.962073 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.962039 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:34.962073 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.962078 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:34.962473 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.962116 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:34.963647 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.963564 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 10:40:34.963647 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.963609 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 10:40:34.963647 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.963601 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 10 10:40:34.963885 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:34.963613 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Sep 10 10:40:35.961221 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:35.961173 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:35.961734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:35.961257 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:35.961734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:35.961325 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:35.961734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:35.961347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:37.961288 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:37.961237 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Sep 10 10:40:37.961288 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:37.961279 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 10:40:37.961888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:37.961253 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 10 10:40:37.961888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:37.961248 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 10:40:40.961690 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:40.961638 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Sep 10 10:40:40.962201 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:40.961634 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 10:40:40.962201 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:40.961700 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 10:40:40.962721 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:40.962703 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:40.963654 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:40.963629 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:43.962198 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:43.962164 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:43.962571 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:43.962330 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:43.963047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:43.963024 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:43.963422 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:43.963403 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:43.967729 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:43.967708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:40:44.380250 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:40:44.380226 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:41:45.840764 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:45.840721 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f"] Sep 10 10:41:45.841316 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:45.841031 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" containerID="cri-o://90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0" gracePeriod=30 Sep 10 10:41:45.841316 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:45.841103 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="offline" containerID="cri-o://a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b" gracePeriod=30 Sep 10 10:41:45.841316 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:45.841109 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" containerID="cri-o://bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd" gracePeriod=30 Sep 10 10:41:45.841316 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:45.841140 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" containerID="cri-o://db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6" gracePeriod=30 Sep 10 10:41:46.339495 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.339454 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj"] Sep 10 10:41:46.343943 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.343919 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.346288 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.346270 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dhg7d\"" Sep 10 10:41:46.358031 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.358007 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj"] Sep 10 10:41:46.478035 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.478003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-offline-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.478185 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.478040 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-registry-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.478185 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.478073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmm22\" (UniqueName: \"kubernetes.io/projected/ec10e2aa-605e-4262-b292-9b35d99d2c63-kube-api-access-fmm22\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.478185 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.478142 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-online-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.478301 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.478235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec10e2aa-605e-4262-b292-9b35d99d2c63-feast-data\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.478301 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.478274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-ui-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579374 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec10e2aa-605e-4262-b292-9b35d99d2c63-feast-data\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579537 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-ui-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579537 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-offline-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579537 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579446 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-registry-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579537 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmm22\" (UniqueName: \"kubernetes.io/projected/ec10e2aa-605e-4262-b292-9b35d99d2c63-kube-api-access-fmm22\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579751 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-online-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.579843 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.579792 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec10e2aa-605e-4262-b292-9b35d99d2c63-feast-data\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.582169 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.582143 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-online-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.582292 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.582144 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-registry-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.582368 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.582353 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-offline-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.582435 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.582383 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-ui-tls\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.590029 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.589961 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmm22\" (UniqueName: \"kubernetes.io/projected/ec10e2aa-605e-4262-b292-9b35d99d2c63-kube-api-access-fmm22\") pod \"feast-simple-feast-setup-788c8d4b7c-dlxsj\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.626529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.626503 2556 generic.go:356] "Generic (PLEG): container finished" podID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerID="bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd" exitCode=0 Sep 10 10:41:46.626661 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.626574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd"} Sep 10 10:41:46.656762 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.656741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:41:46.934003 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:46.933982 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj"] Sep 10 10:41:46.936032 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:41:46.936007 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec10e2aa_605e_4262_b292_9b35d99d2c63.slice/crio-66d3ce834711fe1b495433642ed9ae80ac0dfaa24f2edbc4e1f7e09d8a441243 WatchSource:0}: Error finding container 66d3ce834711fe1b495433642ed9ae80ac0dfaa24f2edbc4e1f7e09d8a441243: Status 404 returned error can't find the container with id 66d3ce834711fe1b495433642ed9ae80ac0dfaa24f2edbc4e1f7e09d8a441243 Sep 10 10:41:47.632936 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:47.632896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"562762d426a279a6eb415b9f5864ed7f247d3fc3044514fa592789b510ac1f8d"} Sep 10 10:41:47.633150 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:47.632950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"66d3ce834711fe1b495433642ed9ae80ac0dfaa24f2edbc4e1f7e09d8a441243"} Sep 10 10:41:47.636278 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:47.636251 2556 generic.go:356] "Generic (PLEG): container finished" podID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerID="db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6" exitCode=0 Sep 10 10:41:47.636378 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:47.636325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6"} Sep 10 10:41:52.657491 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:52.657458 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerID="562762d426a279a6eb415b9f5864ed7f247d3fc3044514fa592789b510ac1f8d" exitCode=0 Sep 10 10:41:52.657875 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:52.657533 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"562762d426a279a6eb415b9f5864ed7f247d3fc3044514fa592789b510ac1f8d"} Sep 10 10:41:53.664722 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:53.664685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"66f446982332391c085797cd55a6a069df4e2bc2c9e6bb38a01dda58c43e4789"} Sep 10 10:41:53.963650 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:53.963551 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 10:41:54.377898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:54.377860 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 10:41:58.688801 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:58.688726 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerID="66f446982332391c085797cd55a6a069df4e2bc2c9e6bb38a01dda58c43e4789" exitCode=0 Sep 10 10:41:58.689197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:58.688793 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"66f446982332391c085797cd55a6a069df4e2bc2c9e6bb38a01dda58c43e4789"} Sep 10 10:41:59.700734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:59.700678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"9f2108c5c27a0062a69832db4a621202ef2ea6ded998c373586579389117a4bf"} Sep 10 10:41:59.701240 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:59.700755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"03c79c1122f31ba47fc3f4a5282419a9593e3dcdb11cd1e0633b9bddd8d29605"} Sep 10 10:41:59.701240 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:59.700775 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"80580f9fc9d8e06721564e6c233725bd42653585a4a6fa4cb6d5d2456e312023"} Sep 10 10:41:59.701240 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:59.700793 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerStarted","Data":"072995a9dae7b1a5df62d5bf4d0e8978ceeeed6529b7282ea102c89b0329fd3c"} Sep 10 10:41:59.726654 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:41:59.726587 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podStartSLOduration=13.726567362 podStartE2EDuration="13.726567362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:41:59.724786958 +0000 UTC m=+442.530853678" watchObservedRunningTime="2026-09-10 10:41:59.726567362 +0000 UTC m=+442.532634057" Sep 10 10:42:01.657981 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.657943 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:01.658610 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.658588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:01.659178 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.659159 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:01.659333 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.659320 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:01.660209 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.660179 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 10 10:42:01.660525 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.660497 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 10:42:01.660697 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.660517 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 10 10:42:01.660792 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:01.660539 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 10:42:03.963563 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:03.963383 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 10:42:04.377396 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:04.377346 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 10:42:04.657279 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:04.657162 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 10 10:42:04.657279 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:04.657232 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 10:42:04.657279 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:04.657162 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 10 10:42:04.657279 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:04.657162 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 10:42:06.657425 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:06.657380 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:06.657814 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:06.657441 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:06.657814 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:06.657454 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:06.657814 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:06.657465 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.658178 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.658143 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.658612 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.658361 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.658754 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.658728 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.659151 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.659125 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.659239 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.659201 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.663996 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.663978 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.748302 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.748263 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:07.751186 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:07.751168 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:42:13.963036 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:13.962996 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 10:42:13.963428 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:13.963131 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:42:14.377391 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:14.377356 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 10:42:14.377532 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:14.377455 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:42:16.481887 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.481866 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:42:16.529818 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.529795 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-online-tls\") pod \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " Sep 10 10:42:16.529924 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.529836 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-registry-tls\") pod \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " Sep 10 10:42:16.529924 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.529880 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgkkh\" (UniqueName: \"kubernetes.io/projected/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-kube-api-access-qgkkh\") pod \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " Sep 10 10:42:16.530046 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.529976 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-offline-tls\") pod \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " Sep 10 10:42:16.530046 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.530017 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-ui-tls\") pod \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " Sep 10 10:42:16.530169 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.530073 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-feast-data\") pod \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\" (UID: \"e32bbd68-c067-4e68-9ac4-63d47d15a6c8\") " Sep 10 10:42:16.530777 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.530724 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-feast-data" (OuterVolumeSpecName: "feast-data") pod "e32bbd68-c067-4e68-9ac4-63d47d15a6c8" (UID: "e32bbd68-c067-4e68-9ac4-63d47d15a6c8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:42:16.532134 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.532104 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-online-tls" (OuterVolumeSpecName: "online-tls") pod "e32bbd68-c067-4e68-9ac4-63d47d15a6c8" (UID: "e32bbd68-c067-4e68-9ac4-63d47d15a6c8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:42:16.532235 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.532173 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e32bbd68-c067-4e68-9ac4-63d47d15a6c8" (UID: "e32bbd68-c067-4e68-9ac4-63d47d15a6c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:42:16.532287 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.532232 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-kube-api-access-qgkkh" (OuterVolumeSpecName: "kube-api-access-qgkkh") pod "e32bbd68-c067-4e68-9ac4-63d47d15a6c8" (UID: "e32bbd68-c067-4e68-9ac4-63d47d15a6c8"). InnerVolumeSpecName "kube-api-access-qgkkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:42:16.532467 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.532450 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e32bbd68-c067-4e68-9ac4-63d47d15a6c8" (UID: "e32bbd68-c067-4e68-9ac4-63d47d15a6c8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:42:16.532520 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.532503 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e32bbd68-c067-4e68-9ac4-63d47d15a6c8" (UID: "e32bbd68-c067-4e68-9ac4-63d47d15a6c8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:42:16.630795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.630718 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-online-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:42:16.630795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.630747 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:42:16.630795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.630757 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgkkh\" (UniqueName: \"kubernetes.io/projected/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-kube-api-access-qgkkh\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:42:16.630795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.630766 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-offline-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:42:16.630795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.630775 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-ui-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:42:16.630795 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.630782 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e32bbd68-c067-4e68-9ac4-63d47d15a6c8-feast-data\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:42:16.784006 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.783972 2556 generic.go:356] "Generic (PLEG): container finished" podID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerID="a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b" exitCode=137 Sep 10 10:42:16.784006 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.783998 2556 generic.go:356] "Generic (PLEG): container finished" podID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerID="90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0" exitCode=137 Sep 10 10:42:16.784257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.784032 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" Sep 10 10:42:16.784257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.784055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b"} Sep 10 10:42:16.784257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.784122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0"} Sep 10 10:42:16.784257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.784143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f" event={"ID":"e32bbd68-c067-4e68-9ac4-63d47d15a6c8","Type":"ContainerDied","Data":"5c3dc8f003162f0c833e516f0832326be4c896c8ba3447934bbc4af7cefb1e0a"} Sep 10 10:42:16.784257 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.784168 2556 scope.go:117] "RemoveContainer" containerID="bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd" Sep 10 10:42:16.792911 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.792895 2556 scope.go:117] "RemoveContainer" containerID="a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b" Sep 10 10:42:16.800504 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.800487 2556 scope.go:117] "RemoveContainer" containerID="db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6" Sep 10 10:42:16.807881 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.807858 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f"] Sep 10 10:42:16.809601 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.809578 2556 scope.go:117] "RemoveContainer" containerID="90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0" Sep 10 10:42:16.811274 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.811255 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-hxl6f"] Sep 10 10:42:16.816911 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.816895 2556 scope.go:117] "RemoveContainer" containerID="1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d" Sep 10 10:42:16.823756 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.823740 2556 scope.go:117] "RemoveContainer" containerID="641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a" Sep 10 10:42:16.830471 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.830453 2556 scope.go:117] "RemoveContainer" containerID="bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd" Sep 10 10:42:16.830723 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:42:16.830705 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd\": container with ID starting with bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd not found: ID does not exist" containerID="bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd" Sep 10 10:42:16.830769 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.830739 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd"} err="failed to get container status \"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd\": rpc error: code = NotFound desc = could not find container \"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd\": container with ID starting with bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd not found: ID does not exist" Sep 10 10:42:16.830769 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.830755 2556 scope.go:117] "RemoveContainer" containerID="a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b" Sep 10 10:42:16.831017 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:42:16.830998 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b\": container with ID starting with a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b not found: ID does not exist" containerID="a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b" Sep 10 10:42:16.831080 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831027 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b"} err="failed to get container status \"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b\": rpc error: code = NotFound desc = could not find container \"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b\": container with ID starting with a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b not found: ID does not exist" Sep 10 10:42:16.831080 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831050 2556 scope.go:117] "RemoveContainer" containerID="db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6" Sep 10 10:42:16.831387 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:42:16.831371 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6\": container with ID starting with db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6 not found: ID does not exist" containerID="db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6" Sep 10 10:42:16.831462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831396 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6"} err="failed to get container status \"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6\": rpc error: code = NotFound desc = could not find container \"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6\": container with ID starting with db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6 not found: ID does not exist" Sep 10 10:42:16.831462 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831419 2556 scope.go:117] "RemoveContainer" containerID="90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0" Sep 10 10:42:16.831667 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:42:16.831652 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0\": container with ID starting with 90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0 not found: ID does not exist" containerID="90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0" Sep 10 10:42:16.831725 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831671 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0"} err="failed to get container status \"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0\": rpc error: code = NotFound desc = could not find container \"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0\": container with ID starting with 90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0 not found: ID does not exist" Sep 10 10:42:16.831725 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831690 2556 scope.go:117] "RemoveContainer" containerID="1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d" Sep 10 10:42:16.831944 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:42:16.831929 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d\": container with ID starting with 1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d not found: ID does not exist" containerID="1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d" Sep 10 10:42:16.831989 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831947 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d"} err="failed to get container status \"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d\": rpc error: code = NotFound desc = could not find container \"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d\": container with ID starting with 1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d not found: ID does not exist" Sep 10 10:42:16.831989 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.831961 2556 scope.go:117] "RemoveContainer" containerID="641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a" Sep 10 10:42:16.832214 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:42:16.832192 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a\": container with ID starting with 641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a not found: ID does not exist" containerID="641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a" Sep 10 10:42:16.832262 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832222 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a"} err="failed to get container status \"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a\": rpc error: code = NotFound desc = could not find container \"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a\": container with ID starting with 641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a not found: ID does not exist" Sep 10 10:42:16.832262 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832245 2556 scope.go:117] "RemoveContainer" containerID="bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd" Sep 10 10:42:16.832516 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832492 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd"} err="failed to get container status \"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd\": rpc error: code = NotFound desc = could not find container \"bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd\": container with ID starting with bdadfdcca518e0a4fe128b961f43e1e9766aed5b3bc9d4ee6a90fee70e97aedd not found: ID does not exist" Sep 10 10:42:16.832516 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832509 2556 scope.go:117] "RemoveContainer" containerID="a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b" Sep 10 10:42:16.832740 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832725 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b"} err="failed to get container status \"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b\": rpc error: code = NotFound desc = could not find container \"a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b\": container with ID starting with a24fbe2352707f0e7e95691d586d44f9009e6ef4368f40eaab30cc6ae09db35b not found: ID does not exist" Sep 10 10:42:16.832793 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832742 2556 scope.go:117] "RemoveContainer" containerID="db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6" Sep 10 10:42:16.832966 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832949 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6"} err="failed to get container status \"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6\": rpc error: code = NotFound desc = could not find container \"db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6\": container with ID starting with db088897e904527edd7ceaa7b89e76a2e92db8519bfdb103a5558864544690b6 not found: ID does not exist" Sep 10 10:42:16.833019 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.832967 2556 scope.go:117] "RemoveContainer" containerID="90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0" Sep 10 10:42:16.833184 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.833168 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0"} err="failed to get container status \"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0\": rpc error: code = NotFound desc = could not find container \"90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0\": container with ID starting with 90c3f7164873cb40c8f37ee7096d35732cd0310d22910a5f984f1917254dc4e0 not found: ID does not exist" Sep 10 10:42:16.833239 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.833184 2556 scope.go:117] "RemoveContainer" containerID="1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d" Sep 10 10:42:16.833382 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.833363 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d"} err="failed to get container status \"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d\": rpc error: code = NotFound desc = could not find container \"1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d\": container with ID starting with 1c18ad70d8ab7e8a64d2bc9bc39e0d18a16c645d653e369ee3651cdfcc22c90d not found: ID does not exist" Sep 10 10:42:16.833382 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.833379 2556 scope.go:117] "RemoveContainer" containerID="641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a" Sep 10 10:42:16.833577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:16.833561 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a"} err="failed to get container status \"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a\": rpc error: code = NotFound desc = could not find container \"641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a\": container with ID starting with 641fec5222630eaf2f1896c085f5257676d854f2dc90ca14f05cde703a23171a not found: ID does not exist" Sep 10 10:42:17.707980 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:42:17.707945 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" path="/var/lib/kubelet/pods/e32bbd68-c067-4e68-9ac4-63d47d15a6c8/volumes" Sep 10 10:43:11.217285 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217246 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn"] Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217588 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217605 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217639 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217649 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217660 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217666 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217675 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="feast-init" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217681 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="feast-init" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217691 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="feast-apply" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217697 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="feast-apply" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217708 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="offline" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217716 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="offline" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217810 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="offline" Sep 10 10:43:11.217866 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217823 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="ui" Sep 10 10:43:11.218556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217831 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="registry" Sep 10 10:43:11.218556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.217947 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e32bbd68-c067-4e68-9ac4-63d47d15a6c8" containerName="online" Sep 10 10:43:11.221615 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.221588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.224007 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.223969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 10 10:43:11.224191 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224016 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 10 10:43:11.224191 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224070 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-d85cz\"" Sep 10 10:43:11.224191 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224082 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 10 10:43:11.224340 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224286 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 10 10:43:11.224421 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224402 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 10 10:43:11.224455 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224444 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 10 10:43:11.224545 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.224528 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 10 10:43:11.232531 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.232501 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn"] Sep 10 10:43:11.266997 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.266955 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.266997 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.267001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-feast-data\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.267245 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.267059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-offline-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.267245 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.267126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.267245 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.267154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-registry-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.267245 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.267228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrld\" (UniqueName: \"kubernetes.io/projected/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-kube-api-access-vfrld\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.367657 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.367617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.367844 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.367668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-registry-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.367844 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.367724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrld\" (UniqueName: \"kubernetes.io/projected/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-kube-api-access-vfrld\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.367844 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.367768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.367844 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:43:11.367778 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 10 10:43:11.367844 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:43:11.367837 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 10 10:43:11.368040 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:43:11.367858 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls podName:f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef nodeName:}" failed. No retries permitted until 2026-09-10 10:43:11.8678363 +0000 UTC m=+514.673902993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls") pod "feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 10 10:43:11.368040 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:43:11.367881 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls podName:f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef nodeName:}" failed. No retries permitted until 2026-09-10 10:43:11.867871448 +0000 UTC m=+514.673938121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls") pod "feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 10 10:43:11.368040 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.367976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-feast-data\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.368040 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.368010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-offline-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.368427 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.368404 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-feast-data\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.368471 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.368423 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-registry-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.370680 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.370648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-offline-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.384965 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.384932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrld\" (UniqueName: \"kubernetes.io/projected/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-kube-api-access-vfrld\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.871424 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.871378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.871626 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.871461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:11.871626 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:43:11.871538 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 10 10:43:11.871711 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:43:11.871627 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls podName:f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef nodeName:}" failed. No retries permitted until 2026-09-10 10:43:12.871605649 +0000 UTC m=+515.677672334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls") pod "feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 10 10:43:11.874169 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:11.874137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:12.877931 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:12.877882 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:12.880430 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:12.880402 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") pod \"feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:13.033128 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:13.033062 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:13.314227 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:13.314196 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn"] Sep 10 10:43:13.316103 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:43:13.316052 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7c5b4d9_1ee3_4150_a1f7_81b0180a9cef.slice/crio-859da0da8ddc6926f0332153a3ba6f7b8e5d028c16edb17b2bb52de014ae64f9 WatchSource:0}: Error finding container 859da0da8ddc6926f0332153a3ba6f7b8e5d028c16edb17b2bb52de014ae64f9: Status 404 returned error can't find the container with id 859da0da8ddc6926f0332153a3ba6f7b8e5d028c16edb17b2bb52de014ae64f9 Sep 10 10:43:14.034296 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:14.034258 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerStarted","Data":"41c96d7f2df5bb2bc007b9e140fa2a74de4fccccd16d92a5ea7284eb0c0ba4f9"} Sep 10 10:43:14.034296 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:14.034301 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerStarted","Data":"859da0da8ddc6926f0332153a3ba6f7b8e5d028c16edb17b2bb52de014ae64f9"} Sep 10 10:43:19.057710 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:19.057664 2556 generic.go:356] "Generic (PLEG): container finished" podID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerID="41c96d7f2df5bb2bc007b9e140fa2a74de4fccccd16d92a5ea7284eb0c0ba4f9" exitCode=0 Sep 10 10:43:19.058141 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:19.057724 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerDied","Data":"41c96d7f2df5bb2bc007b9e140fa2a74de4fccccd16d92a5ea7284eb0c0ba4f9"} Sep 10 10:43:20.064139 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:20.064087 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerStarted","Data":"da687cf9266c42e0341f4af6f51329bf7bf720fa8c33711e662f429e6b488ed5"} Sep 10 10:43:45.177805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:45.177701 2556 generic.go:356] "Generic (PLEG): container finished" podID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerID="da687cf9266c42e0341f4af6f51329bf7bf720fa8c33711e662f429e6b488ed5" exitCode=0 Sep 10 10:43:45.177805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:45.177774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerDied","Data":"da687cf9266c42e0341f4af6f51329bf7bf720fa8c33711e662f429e6b488ed5"} Sep 10 10:43:45.181479 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:45.181452 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 10 10:43:46.187684 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:46.187641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerStarted","Data":"b0789a306de7cac86c4bd1c4c2296b7a7c40f014c64a290380e47a0c2867032b"} Sep 10 10:43:46.188136 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:46.187710 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerStarted","Data":"e4b137321b500ca6f0852463410f31917e83df54299b7908150aa82aea70962d"} Sep 10 10:43:46.188136 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:46.187730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerStarted","Data":"34eec097e3a94ec4b33885a6e6bf3bbad52abf9355caa4d728b6cb4c818024db"} Sep 10 10:43:46.211006 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:46.210934 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podStartSLOduration=35.210908041 podStartE2EDuration="35.210908041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:43:46.209573398 +0000 UTC m=+549.015640116" watchObservedRunningTime="2026-09-10 10:43:46.210908041 +0000 UTC m=+549.016974736" Sep 10 10:43:49.033372 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:49.033318 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:49.033844 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:49.033390 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:49.033844 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:49.033409 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:49.035274 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:49.035230 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Sep 10 10:43:49.035441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:49.035300 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 10 10:43:49.035441 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:49.035324 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 10 10:43:52.033676 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:52.033614 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 10 10:43:52.033676 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:52.033637 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Sep 10 10:43:52.034290 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:52.033641 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 10 10:43:53.034223 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:53.034176 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:53.034643 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:53.034252 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:53.034643 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:53.034274 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:55.034416 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:55.034381 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:55.034925 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:55.034512 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:55.035238 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:55.035214 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:55.035465 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:55.035445 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:55.056856 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:55.056820 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:43:55.260332 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:43:55.260292 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:44:37.605678 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:37.605646 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:44:37.606275 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:37.605941 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:44:57.469573 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.469530 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn"] Sep 10 10:44:57.473053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.469849 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" containerID="cri-o://34eec097e3a94ec4b33885a6e6bf3bbad52abf9355caa4d728b6cb4c818024db" gracePeriod=30 Sep 10 10:44:57.473053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.469926 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" containerID="cri-o://b0789a306de7cac86c4bd1c4c2296b7a7c40f014c64a290380e47a0c2867032b" gracePeriod=30 Sep 10 10:44:57.473053 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.470043 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="offline" containerID="cri-o://e4b137321b500ca6f0852463410f31917e83df54299b7908150aa82aea70962d" gracePeriod=30 Sep 10 10:44:57.584917 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.584876 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj"] Sep 10 10:44:57.585270 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.585225 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" containerID="cri-o://072995a9dae7b1a5df62d5bf4d0e8978ceeeed6529b7282ea102c89b0329fd3c" gracePeriod=30 Sep 10 10:44:57.585369 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.585267 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" containerID="cri-o://03c79c1122f31ba47fc3f4a5282419a9593e3dcdb11cd1e0633b9bddd8d29605" gracePeriod=30 Sep 10 10:44:57.585369 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.585298 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" containerID="cri-o://80580f9fc9d8e06721564e6c233725bd42653585a4a6fa4cb6d5d2456e312023" gracePeriod=30 Sep 10 10:44:57.585479 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.585421 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" containerID="cri-o://9f2108c5c27a0062a69832db4a621202ef2ea6ded998c373586579389117a4bf" gracePeriod=30 Sep 10 10:44:57.748384 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:57.748289 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 10:44:58.530412 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.530377 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerID="9f2108c5c27a0062a69832db4a621202ef2ea6ded998c373586579389117a4bf" exitCode=0 Sep 10 10:44:58.530412 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.530405 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerID="80580f9fc9d8e06721564e6c233725bd42653585a4a6fa4cb6d5d2456e312023" exitCode=0 Sep 10 10:44:58.530857 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.530486 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"9f2108c5c27a0062a69832db4a621202ef2ea6ded998c373586579389117a4bf"} Sep 10 10:44:58.530857 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.530535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"80580f9fc9d8e06721564e6c233725bd42653585a4a6fa4cb6d5d2456e312023"} Sep 10 10:44:58.533262 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.533229 2556 generic.go:356] "Generic (PLEG): container finished" podID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerID="b0789a306de7cac86c4bd1c4c2296b7a7c40f014c64a290380e47a0c2867032b" exitCode=0 Sep 10 10:44:58.533262 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.533253 2556 generic.go:356] "Generic (PLEG): container finished" podID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerID="34eec097e3a94ec4b33885a6e6bf3bbad52abf9355caa4d728b6cb4c818024db" exitCode=0 Sep 10 10:44:58.533416 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.533281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerDied","Data":"b0789a306de7cac86c4bd1c4c2296b7a7c40f014c64a290380e47a0c2867032b"} Sep 10 10:44:58.533416 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:44:58.533332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerDied","Data":"34eec097e3a94ec4b33885a6e6bf3bbad52abf9355caa4d728b6cb4c818024db"} Sep 10 10:45:05.036065 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:05.035962 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 10 10:45:05.239943 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:05.239898 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 10 10:45:07.659502 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:07.659441 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 10:45:07.748159 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:07.748117 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 10:45:15.035416 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:15.035360 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 10 10:45:15.239266 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:15.239219 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 10 10:45:17.659609 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:17.659555 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 10:45:17.748825 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:17.748782 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 10:45:17.749012 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:17.748913 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:45:25.035709 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:25.035663 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 10 10:45:25.036267 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:25.035801 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:45:25.239325 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:25.239279 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 10 10:45:25.239509 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:25.239401 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:45:27.658996 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.658951 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 10:45:27.659496 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.658951 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 10 10:45:27.659496 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.659077 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:45:27.663707 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.663678 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerID="03c79c1122f31ba47fc3f4a5282419a9593e3dcdb11cd1e0633b9bddd8d29605" exitCode=137 Sep 10 10:45:27.663707 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.663701 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerID="072995a9dae7b1a5df62d5bf4d0e8978ceeeed6529b7282ea102c89b0329fd3c" exitCode=137 Sep 10 10:45:27.663913 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.663765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"03c79c1122f31ba47fc3f4a5282419a9593e3dcdb11cd1e0633b9bddd8d29605"} Sep 10 10:45:27.663913 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.663811 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"072995a9dae7b1a5df62d5bf4d0e8978ceeeed6529b7282ea102c89b0329fd3c"} Sep 10 10:45:27.666712 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.666685 2556 generic.go:356] "Generic (PLEG): container finished" podID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerID="e4b137321b500ca6f0852463410f31917e83df54299b7908150aa82aea70962d" exitCode=137 Sep 10 10:45:27.666853 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.666755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerDied","Data":"e4b137321b500ca6f0852463410f31917e83df54299b7908150aa82aea70962d"} Sep 10 10:45:27.666853 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.666801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" event={"ID":"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef","Type":"ContainerDied","Data":"859da0da8ddc6926f0332153a3ba6f7b8e5d028c16edb17b2bb52de014ae64f9"} Sep 10 10:45:27.666853 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.666817 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="859da0da8ddc6926f0332153a3ba6f7b8e5d028c16edb17b2bb52de014ae64f9" Sep 10 10:45:27.711003 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.710971 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:45:27.748734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.748642 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 10 10:45:27.748734 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.748668 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 10:45:27.850132 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850071 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") pod \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " Sep 10 10:45:27.850333 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850164 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls\") pod \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " Sep 10 10:45:27.850333 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850187 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-offline-tls\") pod \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " Sep 10 10:45:27.850333 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850204 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-feast-data\") pod \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " Sep 10 10:45:27.850333 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850234 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-registry-tls\") pod \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " Sep 10 10:45:27.850333 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850291 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfrld\" (UniqueName: \"kubernetes.io/projected/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-kube-api-access-vfrld\") pod \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\" (UID: \"f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef\") " Sep 10 10:45:27.850676 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850633 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 10:45:27.850750 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850731 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:27.850808 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.850784 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-feast-data" (OuterVolumeSpecName: "feast-data") pod "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:45:27.852575 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.852542 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls" (OuterVolumeSpecName: "online-tls") pod "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:27.852575 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.852560 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:27.852762 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.852637 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:27.853013 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.852992 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-kube-api-access-vfrld" (OuterVolumeSpecName: "kube-api-access-vfrld") pod "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" (UID: "f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef"). InnerVolumeSpecName "kube-api-access-vfrld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:45:27.951898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.951855 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-online-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:27.951898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.951892 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-ui-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:27.951898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.951901 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-offline-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:27.951898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.951908 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-feast-data\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:27.952203 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:27.951917 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfrld\" (UniqueName: \"kubernetes.io/projected/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef-kube-api-access-vfrld\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.232114 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.232064 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:45:28.354636 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.354589 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmm22\" (UniqueName: \"kubernetes.io/projected/ec10e2aa-605e-4262-b292-9b35d99d2c63-kube-api-access-fmm22\") pod \"ec10e2aa-605e-4262-b292-9b35d99d2c63\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " Sep 10 10:45:28.354835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.354654 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-offline-tls\") pod \"ec10e2aa-605e-4262-b292-9b35d99d2c63\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " Sep 10 10:45:28.354835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.354703 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-registry-tls\") pod \"ec10e2aa-605e-4262-b292-9b35d99d2c63\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " Sep 10 10:45:28.354835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.354758 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-online-tls\") pod \"ec10e2aa-605e-4262-b292-9b35d99d2c63\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " Sep 10 10:45:28.354835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.354787 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec10e2aa-605e-4262-b292-9b35d99d2c63-feast-data\") pod \"ec10e2aa-605e-4262-b292-9b35d99d2c63\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " Sep 10 10:45:28.354835 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.354816 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-ui-tls\") pod \"ec10e2aa-605e-4262-b292-9b35d99d2c63\" (UID: \"ec10e2aa-605e-4262-b292-9b35d99d2c63\") " Sep 10 10:45:28.355476 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.355439 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec10e2aa-605e-4262-b292-9b35d99d2c63-feast-data" (OuterVolumeSpecName: "feast-data") pod "ec10e2aa-605e-4262-b292-9b35d99d2c63" (UID: "ec10e2aa-605e-4262-b292-9b35d99d2c63"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:45:28.357050 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.356981 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec10e2aa-605e-4262-b292-9b35d99d2c63-kube-api-access-fmm22" (OuterVolumeSpecName: "kube-api-access-fmm22") pod "ec10e2aa-605e-4262-b292-9b35d99d2c63" (UID: "ec10e2aa-605e-4262-b292-9b35d99d2c63"). InnerVolumeSpecName "kube-api-access-fmm22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:45:28.357050 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.357003 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-online-tls" (OuterVolumeSpecName: "online-tls") pod "ec10e2aa-605e-4262-b292-9b35d99d2c63" (UID: "ec10e2aa-605e-4262-b292-9b35d99d2c63"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:28.357050 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.356989 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ec10e2aa-605e-4262-b292-9b35d99d2c63" (UID: "ec10e2aa-605e-4262-b292-9b35d99d2c63"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:28.357291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.357256 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ec10e2aa-605e-4262-b292-9b35d99d2c63" (UID: "ec10e2aa-605e-4262-b292-9b35d99d2c63"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:28.357291 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.357279 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ec10e2aa-605e-4262-b292-9b35d99d2c63" (UID: "ec10e2aa-605e-4262-b292-9b35d99d2c63"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:45:28.455466 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.455425 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmm22\" (UniqueName: \"kubernetes.io/projected/ec10e2aa-605e-4262-b292-9b35d99d2c63-kube-api-access-fmm22\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.455466 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.455459 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-offline-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.455466 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.455469 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.455466 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.455477 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-online-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.455737 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.455484 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec10e2aa-605e-4262-b292-9b35d99d2c63-feast-data\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.455737 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.455492 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ec10e2aa-605e-4262-b292-9b35d99d2c63-ui-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:45:28.673895 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.673807 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" Sep 10 10:45:28.673895 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.673849 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn" Sep 10 10:45:28.674386 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.673805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj" event={"ID":"ec10e2aa-605e-4262-b292-9b35d99d2c63","Type":"ContainerDied","Data":"66d3ce834711fe1b495433642ed9ae80ac0dfaa24f2edbc4e1f7e09d8a441243"} Sep 10 10:45:28.674386 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.673944 2556 scope.go:117] "RemoveContainer" containerID="9f2108c5c27a0062a69832db4a621202ef2ea6ded998c373586579389117a4bf" Sep 10 10:45:28.683772 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.683745 2556 scope.go:117] "RemoveContainer" containerID="03c79c1122f31ba47fc3f4a5282419a9593e3dcdb11cd1e0633b9bddd8d29605" Sep 10 10:45:28.693544 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.693522 2556 scope.go:117] "RemoveContainer" containerID="80580f9fc9d8e06721564e6c233725bd42653585a4a6fa4cb6d5d2456e312023" Sep 10 10:45:28.701565 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.701531 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj"] Sep 10 10:45:28.704166 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.704142 2556 scope.go:117] "RemoveContainer" containerID="072995a9dae7b1a5df62d5bf4d0e8978ceeeed6529b7282ea102c89b0329fd3c" Sep 10 10:45:28.704966 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.704935 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-788c8d4b7c-dlxsj"] Sep 10 10:45:28.713173 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.713150 2556 scope.go:117] "RemoveContainer" containerID="66f446982332391c085797cd55a6a069df4e2bc2c9e6bb38a01dda58c43e4789" Sep 10 10:45:28.716345 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.716320 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn"] Sep 10 10:45:28.721710 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.721673 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7b4c7d97f8-ggfdn"] Sep 10 10:45:28.723135 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:28.723115 2556 scope.go:117] "RemoveContainer" containerID="562762d426a279a6eb415b9f5864ed7f247d3fc3044514fa592789b510ac1f8d" Sep 10 10:45:29.709033 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:29.708989 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" path="/var/lib/kubelet/pods/ec10e2aa-605e-4262-b292-9b35d99d2c63/volumes" Sep 10 10:45:29.709657 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:29.709641 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" path="/var/lib/kubelet/pods/f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef/volumes" Sep 10 10:45:40.749867 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.749820 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-2b52p"] Sep 10 10:45:40.750380 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750312 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="feast-apply" Sep 10 10:45:40.750380 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750333 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="feast-apply" Sep 10 10:45:40.750380 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750344 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" Sep 10 10:45:40.750380 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750352 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" Sep 10 10:45:40.750380 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750363 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="feast-init" Sep 10 10:45:40.750380 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750372 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="feast-init" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750385 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750394 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750403 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750411 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750423 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="feast-init" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750442 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="feast-init" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750471 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750479 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750488 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="offline" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750498 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="offline" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750512 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="feast-apply" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750520 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="feast-apply" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750530 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750539 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750548 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750557 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750663 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="ui" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750675 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="online" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750685 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="registry" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750694 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="online" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750703 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="ui" Sep 10 10:45:40.750708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750714 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c5b4d9-1ee3-4150-a1f7-81b0180a9cef" containerName="offline" Sep 10 10:45:40.751693 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.750725 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec10e2aa-605e-4262-b292-9b35d99d2c63" containerName="offline" Sep 10 10:45:40.755392 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.755365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:40.757469 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.757434 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2b52p"] Sep 10 10:45:40.757652 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.757635 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 10 10:45:40.757708 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.757638 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 10 10:45:40.758511 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.758494 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-wch7j\"" Sep 10 10:45:40.758618 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.758549 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 10 10:45:40.862686 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.862649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-postgresdata\") pod \"postgres-864846d4f5-2b52p\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:40.862877 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.862695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr5tj\" (UniqueName: \"kubernetes.io/projected/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-kube-api-access-xr5tj\") pod \"postgres-864846d4f5-2b52p\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:40.963990 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.963947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-postgresdata\") pod \"postgres-864846d4f5-2b52p\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:40.964199 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.963995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5tj\" (UniqueName: \"kubernetes.io/projected/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-kube-api-access-xr5tj\") pod \"postgres-864846d4f5-2b52p\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:40.964446 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.964420 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-postgresdata\") pod \"postgres-864846d4f5-2b52p\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:40.973972 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:40.973945 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr5tj\" (UniqueName: \"kubernetes.io/projected/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-kube-api-access-xr5tj\") pod \"postgres-864846d4f5-2b52p\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:41.080787 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:41.080744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:45:41.352282 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:41.352193 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2b52p"] Sep 10 10:45:41.356168 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:45:41.356136 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a0db8d7_9e8d_4c2f_9ca1_184ac276141b.slice/crio-5e5af9b4484d4c1031ddb7e0a497504491988268a4854ec9a79bc79de2eba9a2 WatchSource:0}: Error finding container 5e5af9b4484d4c1031ddb7e0a497504491988268a4854ec9a79bc79de2eba9a2: Status 404 returned error can't find the container with id 5e5af9b4484d4c1031ddb7e0a497504491988268a4854ec9a79bc79de2eba9a2 Sep 10 10:45:41.357944 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:41.357925 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 10:45:41.733650 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:41.733563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2b52p" event={"ID":"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b","Type":"ContainerStarted","Data":"5e5af9b4484d4c1031ddb7e0a497504491988268a4854ec9a79bc79de2eba9a2"} Sep 10 10:45:47.763272 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:47.763224 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2b52p" event={"ID":"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b","Type":"ContainerStarted","Data":"40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441"} Sep 10 10:45:47.778502 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:47.778447 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-2b52p" podStartSLOduration=2.189118116 podStartE2EDuration="7.778422315s" totalImagesPullingTime="5.589304199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:45:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:45:47.777851445 +0000 UTC m=+670.583918140" watchObservedRunningTime="2026-09-10 10:45:47.778422315 +0000 UTC m=+670.584489011" Sep 10 10:45:51.553698 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.553653 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z"] Sep 10 10:45:51.559319 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.559288 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.561711 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.561666 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 10 10:45:51.561711 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.561697 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 10 10:45:51.561711 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.561708 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 10 10:45:51.561955 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.561675 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 10 10:45:51.561955 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.561789 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-clxlj\"" Sep 10 10:45:51.569661 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.569634 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z"] Sep 10 10:45:51.654970 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.654930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-offline-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.655197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.654984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e4b2f-ed08-46d7-b62e-e770804e6171-feast-data\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.655197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.655040 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-registry-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.655197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.655074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lms97\" (UniqueName: \"kubernetes.io/projected/1c2e4b2f-ed08-46d7-b62e-e770804e6171-kube-api-access-lms97\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.655197 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.655179 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.756587 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.756546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-offline-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.756799 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.756702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e4b2f-ed08-46d7-b62e-e770804e6171-feast-data\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.756799 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.756737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-registry-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.756799 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.756754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lms97\" (UniqueName: \"kubernetes.io/projected/1c2e4b2f-ed08-46d7-b62e-e770804e6171-kube-api-access-lms97\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.756978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.756810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.756978 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:45:51.756944 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found Sep 10 10:45:51.757079 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:45:51.757018 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls podName:1c2e4b2f-ed08-46d7-b62e-e770804e6171 nodeName:}" failed. No retries permitted until 2026-09-10 10:45:52.256996079 +0000 UTC m=+675.063062756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls") pod "feast-credit-scoring-84c9757d7f-fnj9z" (UID: "1c2e4b2f-ed08-46d7-b62e-e770804e6171") : secret "feast-credit-scoring-online-tls" not found Sep 10 10:45:51.757195 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.757151 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e4b2f-ed08-46d7-b62e-e770804e6171-feast-data\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.759208 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.759180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-offline-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.759335 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.759296 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-registry-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:51.765651 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:51.765614 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lms97\" (UniqueName: \"kubernetes.io/projected/1c2e4b2f-ed08-46d7-b62e-e770804e6171-kube-api-access-lms97\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:52.260801 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:52.260759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:52.263309 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:52.263283 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls\") pod \"feast-credit-scoring-84c9757d7f-fnj9z\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:52.469902 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:52.469855 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:45:52.751001 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:52.750969 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z"] Sep 10 10:45:52.752903 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:45:52.752877 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2e4b2f_ed08_46d7_b62e_e770804e6171.slice/crio-821dd42d810c3c349a2eabcc8884a8dcea5d64c89eeef1500a6e1ab87e64784b WatchSource:0}: Error finding container 821dd42d810c3c349a2eabcc8884a8dcea5d64c89eeef1500a6e1ab87e64784b: Status 404 returned error can't find the container with id 821dd42d810c3c349a2eabcc8884a8dcea5d64c89eeef1500a6e1ab87e64784b Sep 10 10:45:52.785752 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:52.785667 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerStarted","Data":"821dd42d810c3c349a2eabcc8884a8dcea5d64c89eeef1500a6e1ab87e64784b"} Sep 10 10:45:53.791665 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:53.791624 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerStarted","Data":"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9"} Sep 10 10:45:54.798502 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:54.798464 2556 generic.go:356] "Generic (PLEG): container finished" podID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerID="0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9" exitCode=0 Sep 10 10:45:54.798920 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:54.798513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerDied","Data":"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9"} Sep 10 10:45:55.806622 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:45:55.806578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerStarted","Data":"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387"} Sep 10 10:46:02.847021 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:02.846986 2556 generic.go:356] "Generic (PLEG): container finished" podID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerID="c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387" exitCode=0 Sep 10 10:46:02.847443 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:02.847069 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerDied","Data":"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387"} Sep 10 10:46:03.856192 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:03.856149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerStarted","Data":"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec"} Sep 10 10:46:03.856615 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:03.856233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerStarted","Data":"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665"} Sep 10 10:46:03.856615 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:03.856261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerStarted","Data":"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a"} Sep 10 10:46:03.881714 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:03.881649 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podStartSLOduration=12.881626105 podStartE2EDuration="12.881626105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:46:03.879319706 +0000 UTC m=+686.685386431" watchObservedRunningTime="2026-09-10 10:46:03.881626105 +0000 UTC m=+686.687692866" Sep 10 10:46:04.470473 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:04.470411 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:04.470688 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:04.470513 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:04.470688 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:04.470544 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:04.472598 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:04.472559 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 10 10:46:04.472768 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:04.472616 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 10 10:46:04.472768 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:04.472571 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 10 10:46:07.470809 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:07.470755 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 10 10:46:07.470809 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:07.470793 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 10 10:46:07.471404 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:07.470755 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 10 10:46:10.471114 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:10.470916 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 10 10:46:10.471114 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:10.470966 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 10 10:46:10.471114 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:10.470912 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 10 10:46:12.470448 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:12.470387 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:12.470989 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:12.470495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:12.470989 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:12.470521 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:13.471330 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:13.471016 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 10 10:46:13.472154 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:13.472124 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:13.473228 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:13.473199 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:13.477845 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:13.477813 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:13.915635 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:13.915600 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:16.470285 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:16.470240 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 10 10:46:19.471363 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:19.471329 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:46:19.472286 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:46:19.472262 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:47:31.527701 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.527661 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z"] Sep 10 10:47:31.528263 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.527915 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" containerID="cri-o://d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a" gracePeriod=30 Sep 10 10:47:31.528263 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.528013 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" containerID="cri-o://d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665" gracePeriod=30 Sep 10 10:47:31.528263 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.528002 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" containerID="cri-o://9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec" gracePeriod=30 Sep 10 10:47:31.545783 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.545739 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2b52p"] Sep 10 10:47:31.545965 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.545919 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-2b52p" podUID="2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" containerName="postgres" containerID="cri-o://40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441" gracePeriod=30 Sep 10 10:47:31.804438 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.804408 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:47:31.912343 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.912297 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr5tj\" (UniqueName: \"kubernetes.io/projected/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-kube-api-access-xr5tj\") pod \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " Sep 10 10:47:31.912343 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.912342 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-postgresdata\") pod \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\" (UID: \"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b\") " Sep 10 10:47:31.914592 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.914545 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-kube-api-access-xr5tj" (OuterVolumeSpecName: "kube-api-access-xr5tj") pod "2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" (UID: "2a0db8d7-9e8d-4c2f-9ca1-184ac276141b"). InnerVolumeSpecName "kube-api-access-xr5tj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:47:31.944415 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:31.944362 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" (UID: "2a0db8d7-9e8d-4c2f-9ca1-184ac276141b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:47:32.013703 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.013667 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr5tj\" (UniqueName: \"kubernetes.io/projected/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-kube-api-access-xr5tj\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:47:32.013703 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.013698 2556 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b-postgresdata\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:47:32.279010 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.278972 2556 generic.go:356] "Generic (PLEG): container finished" podID="2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" containerID="40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441" exitCode=0 Sep 10 10:47:32.279254 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.279022 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2b52p" Sep 10 10:47:32.279254 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.279063 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2b52p" event={"ID":"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b","Type":"ContainerDied","Data":"40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441"} Sep 10 10:47:32.279254 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.279144 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2b52p" event={"ID":"2a0db8d7-9e8d-4c2f-9ca1-184ac276141b","Type":"ContainerDied","Data":"5e5af9b4484d4c1031ddb7e0a497504491988268a4854ec9a79bc79de2eba9a2"} Sep 10 10:47:32.279254 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.279169 2556 scope.go:117] "RemoveContainer" containerID="40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441" Sep 10 10:47:32.288695 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.288674 2556 scope.go:117] "RemoveContainer" containerID="40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441" Sep 10 10:47:32.289060 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:47:32.289029 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441\": container with ID starting with 40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441 not found: ID does not exist" containerID="40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441" Sep 10 10:47:32.289202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.289069 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441"} err="failed to get container status \"40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441\": rpc error: code = NotFound desc = could not find container \"40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441\": container with ID starting with 40764a7c36e6683bb13fd7c23cfaaacefc9e84e21054e6efa441d92c70b3b441 not found: ID does not exist" Sep 10 10:47:32.300745 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.300706 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2b52p"] Sep 10 10:47:32.304994 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:32.304957 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2b52p"] Sep 10 10:47:33.287532 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:33.287497 2556 generic.go:356] "Generic (PLEG): container finished" podID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerID="d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665" exitCode=0 Sep 10 10:47:33.287922 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:33.287568 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerDied","Data":"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665"} Sep 10 10:47:33.709010 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:33.708968 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" path="/var/lib/kubelet/pods/2a0db8d7-9e8d-4c2f-9ca1-184ac276141b/volumes" Sep 10 10:47:33.911587 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:33.911545 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 10 10:47:43.910957 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:43.910904 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 10 10:47:53.910977 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:53.910926 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 10 10:47:53.911525 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:47:53.911138 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:48:02.179212 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.179178 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:48:02.280311 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.280275 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e4b2f-ed08-46d7-b62e-e770804e6171-feast-data\") pod \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " Sep 10 10:48:02.280507 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.280364 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls\") pod \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " Sep 10 10:48:02.280507 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.280391 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lms97\" (UniqueName: \"kubernetes.io/projected/1c2e4b2f-ed08-46d7-b62e-e770804e6171-kube-api-access-lms97\") pod \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " Sep 10 10:48:02.280507 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.280418 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-registry-tls\") pod \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " Sep 10 10:48:02.280507 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.280460 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-offline-tls\") pod \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\" (UID: \"1c2e4b2f-ed08-46d7-b62e-e770804e6171\") " Sep 10 10:48:02.282807 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.282763 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1c2e4b2f-ed08-46d7-b62e-e770804e6171" (UID: "1c2e4b2f-ed08-46d7-b62e-e770804e6171"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:48:02.282807 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.282789 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1c2e4b2f-ed08-46d7-b62e-e770804e6171" (UID: "1c2e4b2f-ed08-46d7-b62e-e770804e6171"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:48:02.283077 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.283046 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls" (OuterVolumeSpecName: "online-tls") pod "1c2e4b2f-ed08-46d7-b62e-e770804e6171" (UID: "1c2e4b2f-ed08-46d7-b62e-e770804e6171"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:48:02.283142 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.283058 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2e4b2f-ed08-46d7-b62e-e770804e6171-kube-api-access-lms97" (OuterVolumeSpecName: "kube-api-access-lms97") pod "1c2e4b2f-ed08-46d7-b62e-e770804e6171" (UID: "1c2e4b2f-ed08-46d7-b62e-e770804e6171"). InnerVolumeSpecName "kube-api-access-lms97". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:48:02.288855 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.288819 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2e4b2f-ed08-46d7-b62e-e770804e6171-feast-data" (OuterVolumeSpecName: "feast-data") pod "1c2e4b2f-ed08-46d7-b62e-e770804e6171" (UID: "1c2e4b2f-ed08-46d7-b62e-e770804e6171"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:48:02.381553 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.381507 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-offline-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:48:02.381553 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.381545 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e4b2f-ed08-46d7-b62e-e770804e6171-feast-data\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:48:02.381553 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.381558 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-online-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:48:02.381812 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.381570 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lms97\" (UniqueName: \"kubernetes.io/projected/1c2e4b2f-ed08-46d7-b62e-e770804e6171-kube-api-access-lms97\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:48:02.381812 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.381582 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1c2e4b2f-ed08-46d7-b62e-e770804e6171-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:48:02.419074 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419038 2556 generic.go:356] "Generic (PLEG): container finished" podID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerID="9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec" exitCode=137 Sep 10 10:48:02.419074 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419067 2556 generic.go:356] "Generic (PLEG): container finished" podID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerID="d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a" exitCode=137 Sep 10 10:48:02.419354 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419132 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" Sep 10 10:48:02.419354 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerDied","Data":"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec"} Sep 10 10:48:02.419354 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419203 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerDied","Data":"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a"} Sep 10 10:48:02.419354 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419231 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z" event={"ID":"1c2e4b2f-ed08-46d7-b62e-e770804e6171","Type":"ContainerDied","Data":"821dd42d810c3c349a2eabcc8884a8dcea5d64c89eeef1500a6e1ab87e64784b"} Sep 10 10:48:02.419354 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.419274 2556 scope.go:117] "RemoveContainer" containerID="9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec" Sep 10 10:48:02.429162 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.429141 2556 scope.go:117] "RemoveContainer" containerID="d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665" Sep 10 10:48:02.438087 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.438062 2556 scope.go:117] "RemoveContainer" containerID="d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a" Sep 10 10:48:02.441666 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.441598 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z"] Sep 10 10:48:02.445651 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.445614 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9757d7f-fnj9z"] Sep 10 10:48:02.448503 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.448482 2556 scope.go:117] "RemoveContainer" containerID="c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387" Sep 10 10:48:02.457199 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.457176 2556 scope.go:117] "RemoveContainer" containerID="0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9" Sep 10 10:48:02.465578 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.465545 2556 scope.go:117] "RemoveContainer" containerID="9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec" Sep 10 10:48:02.465932 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:48:02.465912 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec\": container with ID starting with 9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec not found: ID does not exist" containerID="9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec" Sep 10 10:48:02.465986 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.465941 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec"} err="failed to get container status \"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec\": rpc error: code = NotFound desc = could not find container \"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec\": container with ID starting with 9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec not found: ID does not exist" Sep 10 10:48:02.465986 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.465960 2556 scope.go:117] "RemoveContainer" containerID="d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665" Sep 10 10:48:02.466262 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:48:02.466246 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665\": container with ID starting with d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665 not found: ID does not exist" containerID="d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665" Sep 10 10:48:02.466317 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.466266 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665"} err="failed to get container status \"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665\": rpc error: code = NotFound desc = could not find container \"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665\": container with ID starting with d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665 not found: ID does not exist" Sep 10 10:48:02.466317 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.466279 2556 scope.go:117] "RemoveContainer" containerID="d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a" Sep 10 10:48:02.466531 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:48:02.466511 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a\": container with ID starting with d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a not found: ID does not exist" containerID="d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a" Sep 10 10:48:02.466581 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.466540 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a"} err="failed to get container status \"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a\": rpc error: code = NotFound desc = could not find container \"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a\": container with ID starting with d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a not found: ID does not exist" Sep 10 10:48:02.466581 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.466560 2556 scope.go:117] "RemoveContainer" containerID="c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387" Sep 10 10:48:02.466821 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:48:02.466790 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387\": container with ID starting with c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387 not found: ID does not exist" containerID="c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387" Sep 10 10:48:02.466869 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.466824 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387"} err="failed to get container status \"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387\": rpc error: code = NotFound desc = could not find container \"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387\": container with ID starting with c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387 not found: ID does not exist" Sep 10 10:48:02.466869 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.466839 2556 scope.go:117] "RemoveContainer" containerID="0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9" Sep 10 10:48:02.467062 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:48:02.467045 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9\": container with ID starting with 0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9 not found: ID does not exist" containerID="0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9" Sep 10 10:48:02.467202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467065 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9"} err="failed to get container status \"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9\": rpc error: code = NotFound desc = could not find container \"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9\": container with ID starting with 0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9 not found: ID does not exist" Sep 10 10:48:02.467202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467080 2556 scope.go:117] "RemoveContainer" containerID="9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec" Sep 10 10:48:02.467391 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467371 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec"} err="failed to get container status \"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec\": rpc error: code = NotFound desc = could not find container \"9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec\": container with ID starting with 9913d3827f3802f9010007cdc12b74504c4e6db34f74283ac271113b9187e1ec not found: ID does not exist" Sep 10 10:48:02.467436 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467392 2556 scope.go:117] "RemoveContainer" containerID="d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665" Sep 10 10:48:02.467641 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467621 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665"} err="failed to get container status \"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665\": rpc error: code = NotFound desc = could not find container \"d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665\": container with ID starting with d08ca07375f521de54c3e7152e88fb4b8e0e0fe74f01fc89a00c5a985e58e665 not found: ID does not exist" Sep 10 10:48:02.467724 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467644 2556 scope.go:117] "RemoveContainer" containerID="d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a" Sep 10 10:48:02.467921 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467901 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a"} err="failed to get container status \"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a\": rpc error: code = NotFound desc = could not find container \"d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a\": container with ID starting with d0715a54df23d0816641ba60b6b240a7ce54db656750b3c32ab28c9a110a8a3a not found: ID does not exist" Sep 10 10:48:02.467971 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.467921 2556 scope.go:117] "RemoveContainer" containerID="c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387" Sep 10 10:48:02.468147 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.468130 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387"} err="failed to get container status \"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387\": rpc error: code = NotFound desc = could not find container \"c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387\": container with ID starting with c277d6176caab5cff1f535d11279160f3cab23b669600db13ea6254791018387 not found: ID does not exist" Sep 10 10:48:02.468147 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.468147 2556 scope.go:117] "RemoveContainer" containerID="0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9" Sep 10 10:48:02.468362 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:02.468346 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9"} err="failed to get container status \"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9\": rpc error: code = NotFound desc = could not find container \"0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9\": container with ID starting with 0d0bdbb278f8c790c9b861dafbdcf6a611d4d49a0f37d564894fe23d25a740a9 not found: ID does not exist" Sep 10 10:48:03.708544 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:48:03.708505 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" path="/var/lib/kubelet/pods/1c2e4b2f-ed08-46d7-b62e-e770804e6171/volumes" Sep 10 10:49:37.634065 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:49:37.633991 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:49:37.635136 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:49:37.635086 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:49:37.684289 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:49:37.684252 2556 scope.go:117] "RemoveContainer" containerID="41c96d7f2df5bb2bc007b9e140fa2a74de4fccccd16d92a5ea7284eb0c0ba4f9" Sep 10 10:49:37.693970 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:49:37.693942 2556 scope.go:117] "RemoveContainer" containerID="da687cf9266c42e0341f4af6f51329bf7bf720fa8c33711e662f429e6b488ed5" Sep 10 10:50:06.627612 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627574 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-g5zcr"] Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627895 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" containerName="postgres" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627906 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" containerName="postgres" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627918 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627924 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627936 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627942 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627951 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="feast-apply" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627956 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="feast-apply" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627964 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="feast-init" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627970 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="feast-init" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627978 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.627983 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.628043 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="registry" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.628052 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="online" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.628064 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a0db8d7-9e8d-4c2f-9ca1-184ac276141b" containerName="postgres" Sep 10 10:50:06.630038 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.628073 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2e4b2f-ed08-46d7-b62e-e770804e6171" containerName="offline" Sep 10 10:50:06.630919 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.630897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:50:06.633459 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.633434 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-7h9jg\"" Sep 10 10:50:06.633607 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.633466 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 10 10:50:06.634389 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.634369 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 10 10:50:06.645762 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.645730 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-g5zcr"] Sep 10 10:50:06.804278 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.804238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltk29\" (UniqueName: \"kubernetes.io/projected/0bbebc57-55f8-4ba8-95e4-adba39518712-kube-api-access-ltk29\") pod \"redis-69bbd798b6-g5zcr\" (UID: \"0bbebc57-55f8-4ba8-95e4-adba39518712\") " pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:50:06.904780 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.904660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltk29\" (UniqueName: \"kubernetes.io/projected/0bbebc57-55f8-4ba8-95e4-adba39518712-kube-api-access-ltk29\") pod \"redis-69bbd798b6-g5zcr\" (UID: \"0bbebc57-55f8-4ba8-95e4-adba39518712\") " pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:50:06.914470 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.914431 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltk29\" (UniqueName: \"kubernetes.io/projected/0bbebc57-55f8-4ba8-95e4-adba39518712-kube-api-access-ltk29\") pod \"redis-69bbd798b6-g5zcr\" (UID: \"0bbebc57-55f8-4ba8-95e4-adba39518712\") " pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:50:06.951006 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:06.950964 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:50:07.222811 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:07.222728 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-g5zcr"] Sep 10 10:50:07.226202 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:50:07.226153 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bbebc57_55f8_4ba8_95e4_adba39518712.slice/crio-02f4e1ca8ce0585469b20b143e1ef65e06dae529426632f0e63f2137eb5933ef WatchSource:0}: Error finding container 02f4e1ca8ce0585469b20b143e1ef65e06dae529426632f0e63f2137eb5933ef: Status 404 returned error can't find the container with id 02f4e1ca8ce0585469b20b143e1ef65e06dae529426632f0e63f2137eb5933ef Sep 10 10:50:07.968057 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:07.968009 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" event={"ID":"0bbebc57-55f8-4ba8-95e4-adba39518712","Type":"ContainerStarted","Data":"02f4e1ca8ce0585469b20b143e1ef65e06dae529426632f0e63f2137eb5933ef"} Sep 10 10:50:08.974348 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:08.974308 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" event={"ID":"0bbebc57-55f8-4ba8-95e4-adba39518712","Type":"ContainerStarted","Data":"6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942"} Sep 10 10:50:08.989391 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:08.989333 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" podStartSLOduration=1.651877425 podStartE2EDuration="2.989314009s" totalImagesPullingTime="1.337436584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:50:08.988318843 +0000 UTC m=+931.794385539" watchObservedRunningTime="2026-09-10 10:50:08.989314009 +0000 UTC m=+931.795380703" Sep 10 10:50:12.087642 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.087604 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-pm94l"] Sep 10 10:50:12.091235 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.091208 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.093556 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.093528 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 10 10:50:12.098255 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.098225 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-pm94l"] Sep 10 10:50:12.248984 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.248946 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-429js\" (UniqueName: \"kubernetes.io/projected/48ffb236-a481-400a-940d-269eda99886b-kube-api-access-429js\") pod \"postgres-864846d4f5-pm94l\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.249221 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.249003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/48ffb236-a481-400a-940d-269eda99886b-postgresdata\") pod \"postgres-864846d4f5-pm94l\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.350526 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.350443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-429js\" (UniqueName: \"kubernetes.io/projected/48ffb236-a481-400a-940d-269eda99886b-kube-api-access-429js\") pod \"postgres-864846d4f5-pm94l\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.350526 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.350507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/48ffb236-a481-400a-940d-269eda99886b-postgresdata\") pod \"postgres-864846d4f5-pm94l\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.350847 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.350832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/48ffb236-a481-400a-940d-269eda99886b-postgresdata\") pod \"postgres-864846d4f5-pm94l\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.359826 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.359784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-429js\" (UniqueName: \"kubernetes.io/projected/48ffb236-a481-400a-940d-269eda99886b-kube-api-access-429js\") pod \"postgres-864846d4f5-pm94l\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.402231 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.402183 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:50:12.674717 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.674590 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-pm94l"] Sep 10 10:50:12.676934 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:50:12.676897 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48ffb236_a481_400a_940d_269eda99886b.slice/crio-edf4858fb5bc265e7ec86027fbfb99f0ecbbf458f5f70a6a13eb253ae5d2ccfd WatchSource:0}: Error finding container edf4858fb5bc265e7ec86027fbfb99f0ecbbf458f5f70a6a13eb253ae5d2ccfd: Status 404 returned error can't find the container with id edf4858fb5bc265e7ec86027fbfb99f0ecbbf458f5f70a6a13eb253ae5d2ccfd Sep 10 10:50:12.996921 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.996821 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" event={"ID":"48ffb236-a481-400a-940d-269eda99886b","Type":"ContainerStarted","Data":"c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367"} Sep 10 10:50:12.996921 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:12.996872 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" event={"ID":"48ffb236-a481-400a-940d-269eda99886b","Type":"ContainerStarted","Data":"edf4858fb5bc265e7ec86027fbfb99f0ecbbf458f5f70a6a13eb253ae5d2ccfd"} Sep 10 10:50:13.013656 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:13.013589 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" podStartSLOduration=1.013570513 podStartE2EDuration="1.013570513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:50:13.012129873 +0000 UTC m=+935.818196590" watchObservedRunningTime="2026-09-10 10:50:13.013570513 +0000 UTC m=+935.819637207" Sep 10 10:50:17.686407 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.686368 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc"] Sep 10 10:50:17.690151 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.690124 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.693202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693170 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 10 10:50:17.693409 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693201 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 10 10:50:17.693409 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693201 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-p84qb\"" Sep 10 10:50:17.693782 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693762 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmkwk\" (UniqueName: \"kubernetes.io/projected/eab78389-0e9e-49fd-914a-eda1d919822d-kube-api-access-wmkwk\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.693856 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eab78389-0e9e-49fd-914a-eda1d919822d-feast-data\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.693856 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-registry-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.693856 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693832 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 10 10:50:17.693978 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.693957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.751415 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.751371 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc"] Sep 10 10:50:17.794939 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.794900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.795177 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.794953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmkwk\" (UniqueName: \"kubernetes.io/projected/eab78389-0e9e-49fd-914a-eda1d919822d-kube-api-access-wmkwk\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.795177 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.794978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eab78389-0e9e-49fd-914a-eda1d919822d-feast-data\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.795177 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.794995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-registry-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.795177 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:50:17.795041 2556 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found Sep 10 10:50:17.795177 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:50:17.795141 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls podName:eab78389-0e9e-49fd-914a-eda1d919822d nodeName:}" failed. No retries permitted until 2026-09-10 10:50:18.295124177 +0000 UTC m=+941.101190850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls") pod "feast-credit-scoring-8c4ddc6c7-4kngc" (UID: "eab78389-0e9e-49fd-914a-eda1d919822d") : secret "feast-credit-scoring-online-tls" not found Sep 10 10:50:17.795510 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.795490 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eab78389-0e9e-49fd-914a-eda1d919822d-feast-data\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.797577 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.797554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-registry-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:17.805826 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:17.805796 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmkwk\" (UniqueName: \"kubernetes.io/projected/eab78389-0e9e-49fd-914a-eda1d919822d-kube-api-access-wmkwk\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:18.298810 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:18.298772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:18.301331 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:18.301304 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls\") pod \"feast-credit-scoring-8c4ddc6c7-4kngc\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:18.600849 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:18.600808 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:18.879266 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:18.879240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc"] Sep 10 10:50:18.881454 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:50:18.881427 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab78389_0e9e_49fd_914a_eda1d919822d.slice/crio-466fc2af4ba385945bda0ecffd010ff8ecdfd1665347782592dba6a8534a2f13 WatchSource:0}: Error finding container 466fc2af4ba385945bda0ecffd010ff8ecdfd1665347782592dba6a8534a2f13: Status 404 returned error can't find the container with id 466fc2af4ba385945bda0ecffd010ff8ecdfd1665347782592dba6a8534a2f13 Sep 10 10:50:19.026032 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:19.025986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerStarted","Data":"26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d"} Sep 10 10:50:19.026229 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:19.026048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerStarted","Data":"466fc2af4ba385945bda0ecffd010ff8ecdfd1665347782592dba6a8534a2f13"} Sep 10 10:50:21.036494 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:21.036383 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab78389-0e9e-49fd-914a-eda1d919822d" containerID="26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d" exitCode=0 Sep 10 10:50:21.036494 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:21.036436 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerDied","Data":"26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d"} Sep 10 10:50:22.043904 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:22.043864 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerStarted","Data":"9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f"} Sep 10 10:50:29.085510 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:29.085473 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab78389-0e9e-49fd-914a-eda1d919822d" containerID="9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f" exitCode=0 Sep 10 10:50:29.086034 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:29.085517 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerDied","Data":"9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f"} Sep 10 10:50:30.094657 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.094616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerStarted","Data":"fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16"} Sep 10 10:50:30.095179 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.094678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerStarted","Data":"ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769"} Sep 10 10:50:30.117152 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.117069 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podStartSLOduration=13.117045504 podStartE2EDuration="13.117045504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:50:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:50:30.116372902 +0000 UTC m=+952.922439614" watchObservedRunningTime="2026-09-10 10:50:30.117045504 +0000 UTC m=+952.923112199" Sep 10 10:50:30.601952 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.601908 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:30.602156 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.601997 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:30.603673 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.603635 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 10:50:30.603814 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:30.603688 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 10:50:33.601913 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:33.601863 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 10:50:33.602332 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:33.601902 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 10:50:36.601962 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:36.601908 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 10:50:36.608464 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:36.608419 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:36.609047 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:36.609023 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:36.612567 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:36.612538 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:37.710142 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:37.710086 2556 scope.go:117] "RemoveContainer" containerID="34eec097e3a94ec4b33885a6e6bf3bbad52abf9355caa4d728b6cb4c818024db" Sep 10 10:50:37.720650 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:37.720624 2556 scope.go:117] "RemoveContainer" containerID="b0789a306de7cac86c4bd1c4c2296b7a7c40f014c64a290380e47a0c2867032b" Sep 10 10:50:37.730228 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:37.730202 2556 scope.go:117] "RemoveContainer" containerID="e4b137321b500ca6f0852463410f31917e83df54299b7908150aa82aea70962d" Sep 10 10:50:38.601153 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:38.601107 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:39.601776 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:39.601726 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 10:50:42.601976 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:42.601936 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:42.609460 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:42.603870 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:50:43.590883 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.590835 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955"] Sep 10 10:50:43.596653 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.596624 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.598880 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.598849 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 10 10:50:43.598880 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.598871 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-nljwf\"" Sep 10 10:50:43.599068 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.598899 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 10 10:50:43.599068 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.598870 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 10 10:50:43.604026 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.603993 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955"] Sep 10 10:50:43.711644 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.711610 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-registry-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.711644 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.711646 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f2683db3-6284-4747-858b-8e1dc431e676-feast-data\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.711860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.711679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbfb2\" (UniqueName: \"kubernetes.io/projected/f2683db3-6284-4747-858b-8e1dc431e676-kube-api-access-lbfb2\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.711860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.711741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.812411 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.812370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbfb2\" (UniqueName: \"kubernetes.io/projected/f2683db3-6284-4747-858b-8e1dc431e676-kube-api-access-lbfb2\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.812411 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.812413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.812674 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:50:43.812524 2556 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found Sep 10 10:50:43.812674 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:50:43.812572 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls podName:f2683db3-6284-4747-858b-8e1dc431e676 nodeName:}" failed. No retries permitted until 2026-09-10 10:50:44.312555936 +0000 UTC m=+967.118622620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls") pod "feast-driver-ranking-567dcf7f98-br955" (UID: "f2683db3-6284-4747-858b-8e1dc431e676") : secret "feast-driver-ranking-online-tls" not found Sep 10 10:50:43.812674 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.812610 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-registry-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.812674 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.812662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f2683db3-6284-4747-858b-8e1dc431e676-feast-data\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.813068 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.813052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f2683db3-6284-4747-858b-8e1dc431e676-feast-data\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.815177 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.815154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-registry-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:43.822252 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:43.822222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbfb2\" (UniqueName: \"kubernetes.io/projected/f2683db3-6284-4747-858b-8e1dc431e676-kube-api-access-lbfb2\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:44.315872 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:44.315833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:44.318392 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:44.318369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls\") pod \"feast-driver-ranking-567dcf7f98-br955\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:44.508714 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:44.508670 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:44.786990 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:44.786958 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955"] Sep 10 10:50:44.788755 ip-10-0-143-147 kubenswrapper[2556]: W0910 10:50:44.788727 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2683db3_6284_4747_858b_8e1dc431e676.slice/crio-5c5eb270d71e63300cb17870d7c14155777db8b2f3bac3ac0c699a1ec5080c72 WatchSource:0}: Error finding container 5c5eb270d71e63300cb17870d7c14155777db8b2f3bac3ac0c699a1ec5080c72: Status 404 returned error can't find the container with id 5c5eb270d71e63300cb17870d7c14155777db8b2f3bac3ac0c699a1ec5080c72 Sep 10 10:50:45.175234 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:45.175194 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerStarted","Data":"8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b"} Sep 10 10:50:45.175413 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:45.175250 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerStarted","Data":"5c5eb270d71e63300cb17870d7c14155777db8b2f3bac3ac0c699a1ec5080c72"} Sep 10 10:50:50.199952 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:50.199912 2556 generic.go:356] "Generic (PLEG): container finished" podID="f2683db3-6284-4747-858b-8e1dc431e676" containerID="8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b" exitCode=0 Sep 10 10:50:50.200439 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:50.199962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerDied","Data":"8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b"} Sep 10 10:50:51.207652 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:51.207612 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerStarted","Data":"f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083"} Sep 10 10:50:58.241730 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:58.241615 2556 generic.go:356] "Generic (PLEG): container finished" podID="f2683db3-6284-4747-858b-8e1dc431e676" containerID="f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083" exitCode=0 Sep 10 10:50:58.241730 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:58.241690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerDied","Data":"f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083"} Sep 10 10:50:59.249750 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.249715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerStarted","Data":"566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024"} Sep 10 10:50:59.250182 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.249770 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerStarted","Data":"9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359"} Sep 10 10:50:59.272555 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.272493 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podStartSLOduration=16.272472684 podStartE2EDuration="16.272472684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 10:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 10:50:59.27057412 +0000 UTC m=+982.076640828" watchObservedRunningTime="2026-09-10 10:50:59.272472684 +0000 UTC m=+982.078539378" Sep 10 10:50:59.509202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.509110 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:59.509351 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.509223 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:50:59.511107 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.511051 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Sep 10 10:50:59.511231 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:50:59.511055 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 10 10:51:02.509219 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:02.509107 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Sep 10 10:51:02.509764 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:02.509124 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 10 10:51:04.509461 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:04.509422 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:51:04.509967 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:04.509495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:51:05.509699 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:05.509647 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Sep 10 10:51:05.516440 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:05.516396 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:51:05.520267 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:05.520237 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:51:08.509996 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:08.509946 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Sep 10 10:51:11.509942 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:11.509899 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:51:11.510703 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:51:11.510679 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:52:35.660375 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.660284 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk"] Sep 10 10:52:35.660897 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.660532 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" podUID="dde72c02-3451-4bbe-a910-acb8aedbe278" containerName="manager" containerID="cri-o://8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca" gracePeriod=10 Sep 10 10:52:35.926932 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.926895 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:52:35.976438 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.976344 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvhb9\" (UniqueName: \"kubernetes.io/projected/dde72c02-3451-4bbe-a910-acb8aedbe278-kube-api-access-tvhb9\") pod \"dde72c02-3451-4bbe-a910-acb8aedbe278\" (UID: \"dde72c02-3451-4bbe-a910-acb8aedbe278\") " Sep 10 10:52:35.980204 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.980158 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dde72c02-3451-4bbe-a910-acb8aedbe278-kube-api-access-tvhb9" (OuterVolumeSpecName: "kube-api-access-tvhb9") pod "dde72c02-3451-4bbe-a910-acb8aedbe278" (UID: "dde72c02-3451-4bbe-a910-acb8aedbe278"). InnerVolumeSpecName "kube-api-access-tvhb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:52:35.989937 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.989894 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc"] Sep 10 10:52:35.990246 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.990208 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" containerID="cri-o://ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769" gracePeriod=30 Sep 10 10:52:35.990388 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.990260 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" containerID="cri-o://fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16" gracePeriod=30 Sep 10 10:52:35.997046 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.997007 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955"] Sep 10 10:52:35.997353 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.997294 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" containerID="cri-o://9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359" gracePeriod=30 Sep 10 10:52:35.997353 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:35.997334 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" containerID="cri-o://566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024" gracePeriod=30 Sep 10 10:52:36.077408 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.077365 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvhb9\" (UniqueName: \"kubernetes.io/projected/dde72c02-3451-4bbe-a910-acb8aedbe278-kube-api-access-tvhb9\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:52:36.609769 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.609711 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 10:52:36.725652 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.725615 2556 generic.go:356] "Generic (PLEG): container finished" podID="dde72c02-3451-4bbe-a910-acb8aedbe278" containerID="8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca" exitCode=0 Sep 10 10:52:36.726083 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.725672 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" event={"ID":"dde72c02-3451-4bbe-a910-acb8aedbe278","Type":"ContainerDied","Data":"8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca"} Sep 10 10:52:36.726083 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.725690 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" Sep 10 10:52:36.726083 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.725751 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk" event={"ID":"dde72c02-3451-4bbe-a910-acb8aedbe278","Type":"ContainerDied","Data":"8c57aadee68aac5bd5d1a48bfb9e14de1f15ee6f67ddb3610427c4a81b8bb096"} Sep 10 10:52:36.726083 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.725775 2556 scope.go:117] "RemoveContainer" containerID="8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca" Sep 10 10:52:36.734775 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.734742 2556 scope.go:117] "RemoveContainer" containerID="8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca" Sep 10 10:52:36.735238 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:52:36.735210 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca\": container with ID starting with 8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca not found: ID does not exist" containerID="8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca" Sep 10 10:52:36.735313 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.735250 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca"} err="failed to get container status \"8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca\": rpc error: code = NotFound desc = could not find container \"8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca\": container with ID starting with 8605d522f852c172058f6be3defb146c9e3952d35a138932405c89d00b4a32ca not found: ID does not exist" Sep 10 10:52:36.750501 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.750449 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk"] Sep 10 10:52:36.756769 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:36.756726 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-54c97fbb48-8fcrk"] Sep 10 10:52:37.708830 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:37.708797 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde72c02-3451-4bbe-a910-acb8aedbe278" path="/var/lib/kubelet/pods/dde72c02-3451-4bbe-a910-acb8aedbe278/volumes" Sep 10 10:52:37.732154 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:37.732123 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerDied","Data":"566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024"} Sep 10 10:52:37.732568 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:37.732124 2556 generic.go:356] "Generic (PLEG): container finished" podID="f2683db3-6284-4747-858b-8e1dc431e676" containerID="566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024" exitCode=0 Sep 10 10:52:37.734698 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:37.734672 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab78389-0e9e-49fd-914a-eda1d919822d" containerID="fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16" exitCode=0 Sep 10 10:52:37.734842 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:37.734740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerDied","Data":"fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16"} Sep 10 10:52:38.289699 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.289661 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-pm94l"] Sep 10 10:52:38.289889 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.289850 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" podUID="48ffb236-a481-400a-940d-269eda99886b" containerName="postgres" containerID="cri-o://c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367" gracePeriod=30 Sep 10 10:52:38.294836 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.294804 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-g5zcr"] Sep 10 10:52:38.295059 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.295016 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" podUID="0bbebc57-55f8-4ba8-95e4-adba39518712" containerName="redis" containerID="cri-o://6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942" gracePeriod=30 Sep 10 10:52:38.557740 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.557711 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:52:38.561000 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.560974 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:52:38.602779 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.602721 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltk29\" (UniqueName: \"kubernetes.io/projected/0bbebc57-55f8-4ba8-95e4-adba39518712-kube-api-access-ltk29\") pod \"0bbebc57-55f8-4ba8-95e4-adba39518712\" (UID: \"0bbebc57-55f8-4ba8-95e4-adba39518712\") " Sep 10 10:52:38.602961 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.602877 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-429js\" (UniqueName: \"kubernetes.io/projected/48ffb236-a481-400a-940d-269eda99886b-kube-api-access-429js\") pod \"48ffb236-a481-400a-940d-269eda99886b\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " Sep 10 10:52:38.602961 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.602925 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/48ffb236-a481-400a-940d-269eda99886b-postgresdata\") pod \"48ffb236-a481-400a-940d-269eda99886b\" (UID: \"48ffb236-a481-400a-940d-269eda99886b\") " Sep 10 10:52:38.605216 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.605177 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ffb236-a481-400a-940d-269eda99886b-kube-api-access-429js" (OuterVolumeSpecName: "kube-api-access-429js") pod "48ffb236-a481-400a-940d-269eda99886b" (UID: "48ffb236-a481-400a-940d-269eda99886b"). InnerVolumeSpecName "kube-api-access-429js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:52:38.605360 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.605233 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bbebc57-55f8-4ba8-95e4-adba39518712-kube-api-access-ltk29" (OuterVolumeSpecName: "kube-api-access-ltk29") pod "0bbebc57-55f8-4ba8-95e4-adba39518712" (UID: "0bbebc57-55f8-4ba8-95e4-adba39518712"). InnerVolumeSpecName "kube-api-access-ltk29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:52:38.636040 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.635997 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ffb236-a481-400a-940d-269eda99886b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "48ffb236-a481-400a-940d-269eda99886b" (UID: "48ffb236-a481-400a-940d-269eda99886b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:52:38.704384 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.704340 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-429js\" (UniqueName: \"kubernetes.io/projected/48ffb236-a481-400a-940d-269eda99886b-kube-api-access-429js\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:52:38.704384 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.704378 2556 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/48ffb236-a481-400a-940d-269eda99886b-postgresdata\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:52:38.704384 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.704388 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltk29\" (UniqueName: \"kubernetes.io/projected/0bbebc57-55f8-4ba8-95e4-adba39518712-kube-api-access-ltk29\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:52:38.741276 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.741239 2556 generic.go:356] "Generic (PLEG): container finished" podID="48ffb236-a481-400a-940d-269eda99886b" containerID="c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367" exitCode=0 Sep 10 10:52:38.741763 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.741289 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" Sep 10 10:52:38.741763 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.741327 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" event={"ID":"48ffb236-a481-400a-940d-269eda99886b","Type":"ContainerDied","Data":"c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367"} Sep 10 10:52:38.741763 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.741364 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-pm94l" event={"ID":"48ffb236-a481-400a-940d-269eda99886b","Type":"ContainerDied","Data":"edf4858fb5bc265e7ec86027fbfb99f0ecbbf458f5f70a6a13eb253ae5d2ccfd"} Sep 10 10:52:38.741763 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.741381 2556 scope.go:117] "RemoveContainer" containerID="c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367" Sep 10 10:52:38.742765 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.742742 2556 generic.go:356] "Generic (PLEG): container finished" podID="0bbebc57-55f8-4ba8-95e4-adba39518712" containerID="6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942" exitCode=0 Sep 10 10:52:38.742860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.742796 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" Sep 10 10:52:38.742860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.742805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" event={"ID":"0bbebc57-55f8-4ba8-95e4-adba39518712","Type":"ContainerDied","Data":"6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942"} Sep 10 10:52:38.742860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.742834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-g5zcr" event={"ID":"0bbebc57-55f8-4ba8-95e4-adba39518712","Type":"ContainerDied","Data":"02f4e1ca8ce0585469b20b143e1ef65e06dae529426632f0e63f2137eb5933ef"} Sep 10 10:52:38.751797 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.751779 2556 scope.go:117] "RemoveContainer" containerID="c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367" Sep 10 10:52:38.752205 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:52:38.752180 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367\": container with ID starting with c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367 not found: ID does not exist" containerID="c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367" Sep 10 10:52:38.752320 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.752216 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367"} err="failed to get container status \"c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367\": rpc error: code = NotFound desc = could not find container \"c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367\": container with ID starting with c68e6c33160ac767b0529098df377e0d29827d8c671c7bb1f0444ede726e5367 not found: ID does not exist" Sep 10 10:52:38.752320 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.752242 2556 scope.go:117] "RemoveContainer" containerID="6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942" Sep 10 10:52:38.760383 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.760360 2556 scope.go:117] "RemoveContainer" containerID="6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942" Sep 10 10:52:38.760713 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:52:38.760696 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942\": container with ID starting with 6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942 not found: ID does not exist" containerID="6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942" Sep 10 10:52:38.760844 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.760721 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942"} err="failed to get container status \"6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942\": rpc error: code = NotFound desc = could not find container \"6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942\": container with ID starting with 6da8203e0ca05b38ade8d8b20bf3dafc15a46fbc48e2992dfd92fedccacd4942 not found: ID does not exist" Sep 10 10:52:38.762887 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.762859 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-pm94l"] Sep 10 10:52:38.766898 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.766871 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-pm94l"] Sep 10 10:52:38.778692 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.778649 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-g5zcr"] Sep 10 10:52:38.780854 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:38.780823 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-g5zcr"] Sep 10 10:52:39.709048 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:39.708961 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bbebc57-55f8-4ba8-95e4-adba39518712" path="/var/lib/kubelet/pods/0bbebc57-55f8-4ba8-95e4-adba39518712/volumes" Sep 10 10:52:39.709345 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:39.709330 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ffb236-a481-400a-940d-269eda99886b" path="/var/lib/kubelet/pods/48ffb236-a481-400a-940d-269eda99886b/volumes" Sep 10 10:52:45.517532 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:45.517480 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 10 10:52:46.609942 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:46.609891 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 10:52:55.517059 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:55.517004 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 10 10:52:56.609452 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:56.609407 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 10:52:56.609860 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:52:56.609525 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:53:05.517328 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:05.517282 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 10 10:53:05.517742 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:05.517408 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:53:06.676202 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.676172 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:53:06.678932 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.678910 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:53:06.846308 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846272 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-registry-tls\") pod \"f2683db3-6284-4747-858b-8e1dc431e676\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " Sep 10 10:53:06.846487 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846323 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-registry-tls\") pod \"eab78389-0e9e-49fd-914a-eda1d919822d\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " Sep 10 10:53:06.846487 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846446 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls\") pod \"f2683db3-6284-4747-858b-8e1dc431e676\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " Sep 10 10:53:06.846579 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846495 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbfb2\" (UniqueName: \"kubernetes.io/projected/f2683db3-6284-4747-858b-8e1dc431e676-kube-api-access-lbfb2\") pod \"f2683db3-6284-4747-858b-8e1dc431e676\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " Sep 10 10:53:06.846579 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846519 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmkwk\" (UniqueName: \"kubernetes.io/projected/eab78389-0e9e-49fd-914a-eda1d919822d-kube-api-access-wmkwk\") pod \"eab78389-0e9e-49fd-914a-eda1d919822d\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " Sep 10 10:53:06.846579 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846541 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eab78389-0e9e-49fd-914a-eda1d919822d-feast-data\") pod \"eab78389-0e9e-49fd-914a-eda1d919822d\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " Sep 10 10:53:06.846736 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846596 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f2683db3-6284-4747-858b-8e1dc431e676-feast-data\") pod \"f2683db3-6284-4747-858b-8e1dc431e676\" (UID: \"f2683db3-6284-4747-858b-8e1dc431e676\") " Sep 10 10:53:06.846736 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.846661 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls\") pod \"eab78389-0e9e-49fd-914a-eda1d919822d\" (UID: \"eab78389-0e9e-49fd-914a-eda1d919822d\") " Sep 10 10:53:06.847888 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.847826 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2683db3-6284-4747-858b-8e1dc431e676-feast-data" (OuterVolumeSpecName: "feast-data") pod "f2683db3-6284-4747-858b-8e1dc431e676" (UID: "f2683db3-6284-4747-858b-8e1dc431e676"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:53:06.849165 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.849125 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls" (OuterVolumeSpecName: "online-tls") pod "f2683db3-6284-4747-858b-8e1dc431e676" (UID: "f2683db3-6284-4747-858b-8e1dc431e676"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:53:06.849165 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.849126 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eab78389-0e9e-49fd-914a-eda1d919822d" (UID: "eab78389-0e9e-49fd-914a-eda1d919822d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:53:06.849165 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.849128 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2683db3-6284-4747-858b-8e1dc431e676-kube-api-access-lbfb2" (OuterVolumeSpecName: "kube-api-access-lbfb2") pod "f2683db3-6284-4747-858b-8e1dc431e676" (UID: "f2683db3-6284-4747-858b-8e1dc431e676"). InnerVolumeSpecName "kube-api-access-lbfb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:53:06.849450 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.849189 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f2683db3-6284-4747-858b-8e1dc431e676" (UID: "f2683db3-6284-4747-858b-8e1dc431e676"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:53:06.849450 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.849298 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls" (OuterVolumeSpecName: "online-tls") pod "eab78389-0e9e-49fd-914a-eda1d919822d" (UID: "eab78389-0e9e-49fd-914a-eda1d919822d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 10:53:06.849450 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.849304 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab78389-0e9e-49fd-914a-eda1d919822d-kube-api-access-wmkwk" (OuterVolumeSpecName: "kube-api-access-wmkwk") pod "eab78389-0e9e-49fd-914a-eda1d919822d" (UID: "eab78389-0e9e-49fd-914a-eda1d919822d"). InnerVolumeSpecName "kube-api-access-wmkwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 10:53:06.856957 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.856906 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab78389-0e9e-49fd-914a-eda1d919822d-feast-data" (OuterVolumeSpecName: "feast-data") pod "eab78389-0e9e-49fd-914a-eda1d919822d" (UID: "eab78389-0e9e-49fd-914a-eda1d919822d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 10:53:06.874601 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.874568 2556 generic.go:356] "Generic (PLEG): container finished" podID="f2683db3-6284-4747-858b-8e1dc431e676" containerID="9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359" exitCode=137 Sep 10 10:53:06.874798 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.874638 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" Sep 10 10:53:06.874798 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.874649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerDied","Data":"9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359"} Sep 10 10:53:06.874798 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.874712 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955" event={"ID":"f2683db3-6284-4747-858b-8e1dc431e676","Type":"ContainerDied","Data":"5c5eb270d71e63300cb17870d7c14155777db8b2f3bac3ac0c699a1ec5080c72"} Sep 10 10:53:06.874798 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.874731 2556 scope.go:117] "RemoveContainer" containerID="566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024" Sep 10 10:53:06.877212 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.877181 2556 generic.go:356] "Generic (PLEG): container finished" podID="eab78389-0e9e-49fd-914a-eda1d919822d" containerID="ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769" exitCode=137 Sep 10 10:53:06.877338 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.877231 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerDied","Data":"ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769"} Sep 10 10:53:06.877338 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.877273 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" Sep 10 10:53:06.877443 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.877276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" event={"ID":"eab78389-0e9e-49fd-914a-eda1d919822d","Type":"ContainerDied","Data":"466fc2af4ba385945bda0ecffd010ff8ecdfd1665347782592dba6a8534a2f13"} Sep 10 10:53:06.884773 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.884754 2556 scope.go:117] "RemoveContainer" containerID="9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359" Sep 10 10:53:06.893558 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.893532 2556 scope.go:117] "RemoveContainer" containerID="f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083" Sep 10 10:53:06.898807 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.898774 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955"] Sep 10 10:53:06.902759 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.902474 2556 scope.go:117] "RemoveContainer" containerID="8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b" Sep 10 10:53:06.904395 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.904368 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567dcf7f98-br955"] Sep 10 10:53:06.911377 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.911353 2556 scope.go:117] "RemoveContainer" containerID="566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024" Sep 10 10:53:06.911723 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.911702 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024\": container with ID starting with 566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024 not found: ID does not exist" containerID="566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024" Sep 10 10:53:06.911805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.911734 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024"} err="failed to get container status \"566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024\": rpc error: code = NotFound desc = could not find container \"566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024\": container with ID starting with 566b68f4a3de74d4af79f949a4e639339c6de30c67be58389581ae62ff55c024 not found: ID does not exist" Sep 10 10:53:06.911805 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.911754 2556 scope.go:117] "RemoveContainer" containerID="9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359" Sep 10 10:53:06.912065 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.912048 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359\": container with ID starting with 9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359 not found: ID does not exist" containerID="9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359" Sep 10 10:53:06.912127 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.912079 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359"} err="failed to get container status \"9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359\": rpc error: code = NotFound desc = could not find container \"9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359\": container with ID starting with 9d9cee3e02ec89f6d15d562cebc9ba675f5776343e4d774358ea97387f4f4359 not found: ID does not exist" Sep 10 10:53:06.912127 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.912110 2556 scope.go:117] "RemoveContainer" containerID="f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083" Sep 10 10:53:06.912395 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.912372 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083\": container with ID starting with f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083 not found: ID does not exist" containerID="f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083" Sep 10 10:53:06.912449 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.912402 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083"} err="failed to get container status \"f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083\": rpc error: code = NotFound desc = could not find container \"f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083\": container with ID starting with f0df38611e52fcf8df3e4d4a3625b2ecfe576b7678e198a53f63dcb0ee50c083 not found: ID does not exist" Sep 10 10:53:06.912449 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.912423 2556 scope.go:117] "RemoveContainer" containerID="8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b" Sep 10 10:53:06.912717 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.912695 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b\": container with ID starting with 8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b not found: ID does not exist" containerID="8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b" Sep 10 10:53:06.912821 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.912717 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b"} err="failed to get container status \"8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b\": rpc error: code = NotFound desc = could not find container \"8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b\": container with ID starting with 8ee3160850e099ae6e87bbb1f90c218f6700c821267a3310c722dda09613dc3b not found: ID does not exist" Sep 10 10:53:06.912821 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.912732 2556 scope.go:117] "RemoveContainer" containerID="fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16" Sep 10 10:53:06.916301 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.916275 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc"] Sep 10 10:53:06.922180 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.922152 2556 scope.go:117] "RemoveContainer" containerID="ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769" Sep 10 10:53:06.922642 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.922617 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc"] Sep 10 10:53:06.930964 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.930938 2556 scope.go:117] "RemoveContainer" containerID="9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f" Sep 10 10:53:06.939177 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.939154 2556 scope.go:117] "RemoveContainer" containerID="26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d" Sep 10 10:53:06.947157 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947115 2556 scope.go:117] "RemoveContainer" containerID="fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16" Sep 10 10:53:06.947446 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947426 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f2683db3-6284-4747-858b-8e1dc431e676-feast-data\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947450 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-online-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947462 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947473 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eab78389-0e9e-49fd-914a-eda1d919822d-registry-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947484 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f2683db3-6284-4747-858b-8e1dc431e676-online-tls\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947498 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbfb2\" (UniqueName: \"kubernetes.io/projected/f2683db3-6284-4747-858b-8e1dc431e676-kube-api-access-lbfb2\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947511 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmkwk\" (UniqueName: \"kubernetes.io/projected/eab78389-0e9e-49fd-914a-eda1d919822d-kube-api-access-wmkwk\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947529 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947525 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eab78389-0e9e-49fd-914a-eda1d919822d-feast-data\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 10:53:06.947799 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.947541 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16\": container with ID starting with fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16 not found: ID does not exist" containerID="fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16" Sep 10 10:53:06.947799 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947568 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16"} err="failed to get container status \"fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16\": rpc error: code = NotFound desc = could not find container \"fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16\": container with ID starting with fba6b25e69ff03bb8f004241490db66eed089a14a85ef58dc83ce0adf24d1d16 not found: ID does not exist" Sep 10 10:53:06.947799 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947594 2556 scope.go:117] "RemoveContainer" containerID="ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769" Sep 10 10:53:06.947929 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.947868 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769\": container with ID starting with ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769 not found: ID does not exist" containerID="ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769" Sep 10 10:53:06.947929 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947889 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769"} err="failed to get container status \"ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769\": rpc error: code = NotFound desc = could not find container \"ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769\": container with ID starting with ec88a1c714b98a73e80167a09efde69987e153c8bf7dc0259ce0d185948b6769 not found: ID does not exist" Sep 10 10:53:06.947929 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.947905 2556 scope.go:117] "RemoveContainer" containerID="9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f" Sep 10 10:53:06.948198 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.948181 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f\": container with ID starting with 9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f not found: ID does not exist" containerID="9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f" Sep 10 10:53:06.948239 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.948203 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f"} err="failed to get container status \"9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f\": rpc error: code = NotFound desc = could not find container \"9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f\": container with ID starting with 9897b4509ce301fa5bf464b6b1adfb06ee0882e42e88aa0c4080ebe2d9397a2f not found: ID does not exist" Sep 10 10:53:06.948239 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.948221 2556 scope.go:117] "RemoveContainer" containerID="26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d" Sep 10 10:53:06.948464 ip-10-0-143-147 kubenswrapper[2556]: E0910 10:53:06.948446 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d\": container with ID starting with 26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d not found: ID does not exist" containerID="26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d" Sep 10 10:53:06.948508 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:06.948469 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d"} err="failed to get container status \"26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d\": rpc error: code = NotFound desc = could not find container \"26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d\": container with ID starting with 26d08de3777b824cd9c45d218b8e466e28eabc60b0a496dfb57181dd79df5b2d not found: ID does not exist" Sep 10 10:53:07.609651 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:07.609599 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-8c4ddc6c7-4kngc" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": context deadline exceeded" Sep 10 10:53:07.708111 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:07.708063 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" path="/var/lib/kubelet/pods/eab78389-0e9e-49fd-914a-eda1d919822d/volumes" Sep 10 10:53:07.708804 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:53:07.708780 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2683db3-6284-4747-858b-8e1dc431e676" path="/var/lib/kubelet/pods/f2683db3-6284-4747-858b-8e1dc431e676/volumes" Sep 10 10:54:37.660914 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:54:37.660880 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:54:37.663454 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:54:37.663424 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:59:37.687056 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:59:37.687024 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 10:59:37.690272 ip-10-0-143-147 kubenswrapper[2556]: I0910 10:59:37.690243 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 11:04:26.521767 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.521725 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7crqc/must-gather-m5kwg"] Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522074 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522085 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522125 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde72c02-3451-4bbe-a910-acb8aedbe278" containerName="manager" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522131 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde72c02-3451-4bbe-a910-acb8aedbe278" containerName="manager" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522138 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bbebc57-55f8-4ba8-95e4-adba39518712" containerName="redis" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522144 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bbebc57-55f8-4ba8-95e4-adba39518712" containerName="redis" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522151 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522156 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522163 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="feast-init" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522168 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="feast-init" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522175 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="feast-apply" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522181 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="feast-apply" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522187 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522191 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522199 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522204 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522215 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ffb236-a481-400a-940d-269eda99886b" containerName="postgres" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522220 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ffb236-a481-400a-940d-269eda99886b" containerName="postgres" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522226 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="feast-apply" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522231 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="feast-apply" Sep 10 11:04:26.522231 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522239 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="feast-init" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522245 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="feast-init" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522296 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bbebc57-55f8-4ba8-95e4-adba39518712" containerName="redis" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522303 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="registry" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522309 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2683db3-6284-4747-858b-8e1dc431e676" containerName="online" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522315 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ffb236-a481-400a-940d-269eda99886b" containerName="postgres" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522320 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde72c02-3451-4bbe-a910-acb8aedbe278" containerName="manager" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522326 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="online" Sep 10 11:04:26.522988 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.522331 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab78389-0e9e-49fd-914a-eda1d919822d" containerName="registry" Sep 10 11:04:26.525419 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.525400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.527744 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.527721 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7crqc\"/\"kube-root-ca.crt\"" Sep 10 11:04:26.528539 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.528521 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7crqc\"/\"openshift-service-ca.crt\"" Sep 10 11:04:26.528654 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.528549 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7crqc\"/\"default-dockercfg-2hcj8\"" Sep 10 11:04:26.533443 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.533423 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7crqc/must-gather-m5kwg"] Sep 10 11:04:26.641597 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.641555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-must-gather-output\") pod \"must-gather-m5kwg\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.641799 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.641671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kbz\" (UniqueName: \"kubernetes.io/projected/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-kube-api-access-92kbz\") pod \"must-gather-m5kwg\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.742452 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.742409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kbz\" (UniqueName: \"kubernetes.io/projected/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-kube-api-access-92kbz\") pod \"must-gather-m5kwg\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.742648 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.742462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-must-gather-output\") pod \"must-gather-m5kwg\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.742760 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.742745 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-must-gather-output\") pod \"must-gather-m5kwg\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.752137 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.752077 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kbz\" (UniqueName: \"kubernetes.io/projected/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-kube-api-access-92kbz\") pod \"must-gather-m5kwg\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:26.852968 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:26.852928 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:27.125073 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:27.124950 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7crqc/must-gather-m5kwg"] Sep 10 11:04:27.127946 ip-10-0-143-147 kubenswrapper[2556]: W0910 11:04:27.127916 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c2aebfe_5f0c_47c0_b9ef_4dc34c6c9b09.slice/crio-e564592f112160e86f269fa4ed0f61b2172ab62f02ef408ad4ef5b93913b4023 WatchSource:0}: Error finding container e564592f112160e86f269fa4ed0f61b2172ab62f02ef408ad4ef5b93913b4023: Status 404 returned error can't find the container with id e564592f112160e86f269fa4ed0f61b2172ab62f02ef408ad4ef5b93913b4023 Sep 10 11:04:27.129888 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:27.129869 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 11:04:27.655765 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:27.655731 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7crqc/must-gather-m5kwg" event={"ID":"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09","Type":"ContainerStarted","Data":"e564592f112160e86f269fa4ed0f61b2172ab62f02ef408ad4ef5b93913b4023"} Sep 10 11:04:34.694283 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:34.694239 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7crqc/must-gather-m5kwg" event={"ID":"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09","Type":"ContainerStarted","Data":"a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a"} Sep 10 11:04:34.694283 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:34.694281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7crqc/must-gather-m5kwg" event={"ID":"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09","Type":"ContainerStarted","Data":"9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7"} Sep 10 11:04:34.711762 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:34.711705 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7crqc/must-gather-m5kwg" podStartSLOduration=2.260955455 podStartE2EDuration="8.711687199s" totalImagesPullingTime="6.450731744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:04:34.710546663 +0000 UTC m=+1797.516613356" watchObservedRunningTime="2026-09-10 11:04:34.711687199 +0000 UTC m=+1797.517753892" Sep 10 11:04:37.724495 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:37.724464 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 11:04:37.729155 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:37.729127 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 11:04:43.737699 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:43.737610 2556 generic.go:356] "Generic (PLEG): container finished" podID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerID="9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7" exitCode=0 Sep 10 11:04:43.737699 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:43.737682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7crqc/must-gather-m5kwg" event={"ID":"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09","Type":"ContainerDied","Data":"9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7"} Sep 10 11:04:43.738173 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:43.737965 2556 scope.go:117] "RemoveContainer" containerID="9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7" Sep 10 11:04:44.436666 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:44.436635 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7crqc_must-gather-m5kwg_9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09/gather/0.log" Sep 10 11:04:47.803860 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:47.803818 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rnkj7_4ed4c76f-8059-4a53-969d-cc5b62a4e493/global-pull-secret-syncer/0.log" Sep 10 11:04:47.909140 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:47.909112 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-srhsr_cf991fb1-c3af-4119-ba10-2ab113c2ea2e/konnectivity-agent/0.log" Sep 10 11:04:47.975513 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:47.975481 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-147.ec2.internal_2f9d76cfc3da1d9db70bee1ecff03cab/haproxy/0.log" Sep 10 11:04:49.753832 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:49.753797 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-7crqc/must-gather-m5kwg"] Sep 10 11:04:49.754291 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:49.753984 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-7crqc/must-gather-m5kwg" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="copy" containerID="cri-o://a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a" gracePeriod=2 Sep 10 11:04:49.758498 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:49.758468 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-7crqc/must-gather-m5kwg"] Sep 10 11:04:49.983032 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:49.983008 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7crqc_must-gather-m5kwg_9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09/copy/0.log" Sep 10 11:04:49.984851 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:49.984834 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:49.986921 ip-10-0-143-147 kubenswrapper[2556]: E0910 11:04:49.986895 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-m5kwg\" is forbidden: User \"system:node:ip-10-0-143-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7crqc\": no relationship found between node 'ip-10-0-143-147.ec2.internal' and this object" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:50.039657 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.039576 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-must-gather-output\") pod \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " Sep 10 11:04:50.039657 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.039634 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92kbz\" (UniqueName: \"kubernetes.io/projected/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-kube-api-access-92kbz\") pod \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\" (UID: \"9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09\") " Sep 10 11:04:50.039964 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.039941 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" (UID: "9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:04:50.041957 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.041927 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-kube-api-access-92kbz" (OuterVolumeSpecName: "kube-api-access-92kbz") pod "9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" (UID: "9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09"). InnerVolumeSpecName "kube-api-access-92kbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:04:50.140680 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.140633 2556 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-must-gather-output\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 11:04:50.140680 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.140672 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92kbz\" (UniqueName: \"kubernetes.io/projected/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09-kube-api-access-92kbz\") on node \"ip-10-0-143-147.ec2.internal\" DevicePath \"\"" Sep 10 11:04:50.769020 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.768987 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7crqc_must-gather-m5kwg_9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09/copy/0.log" Sep 10 11:04:50.769527 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.769342 2556 generic.go:356] "Generic (PLEG): container finished" podID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerID="a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a" exitCode=143 Sep 10 11:04:50.769527 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.769413 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:50.769527 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.769440 2556 scope.go:117] "RemoveContainer" containerID="a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a" Sep 10 11:04:50.772003 ip-10-0-143-147 kubenswrapper[2556]: E0910 11:04:50.771975 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-m5kwg\" is forbidden: User \"system:node:ip-10-0-143-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7crqc\": no relationship found between node 'ip-10-0-143-147.ec2.internal' and this object" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:50.777556 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.777535 2556 scope.go:117] "RemoveContainer" containerID="9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7" Sep 10 11:04:50.779658 ip-10-0-143-147 kubenswrapper[2556]: E0910 11:04:50.779634 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-m5kwg\" is forbidden: User \"system:node:ip-10-0-143-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7crqc\": no relationship found between node 'ip-10-0-143-147.ec2.internal' and this object" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" pod="openshift-must-gather-7crqc/must-gather-m5kwg" Sep 10 11:04:50.790400 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.790374 2556 scope.go:117] "RemoveContainer" containerID="a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a" Sep 10 11:04:50.790756 ip-10-0-143-147 kubenswrapper[2556]: E0910 11:04:50.790736 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a\": container with ID starting with a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a not found: ID does not exist" containerID="a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a" Sep 10 11:04:50.790814 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.790769 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a"} err="failed to get container status \"a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a\": rpc error: code = NotFound desc = could not find container \"a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a\": container with ID starting with a57bcb3ec2a7beca80ae961c7bf7c87fdbf4d977f21fe2ebbc3d99a11570368a not found: ID does not exist" Sep 10 11:04:50.790814 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.790798 2556 scope.go:117] "RemoveContainer" containerID="9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7" Sep 10 11:04:50.791110 ip-10-0-143-147 kubenswrapper[2556]: E0910 11:04:50.791069 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7\": container with ID starting with 9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7 not found: ID does not exist" containerID="9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7" Sep 10 11:04:50.791181 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:50.791117 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7"} err="failed to get container status \"9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7\": rpc error: code = NotFound desc = could not find container \"9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7\": container with ID starting with 9f65c18b1b65f5bc93b58a2993c9cc7da8bc5bff447d7069c2f06540927b34e7 not found: ID does not exist" Sep 10 11:04:51.708763 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:51.708731 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" path="/var/lib/kubelet/pods/9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09/volumes" Sep 10 11:04:51.861251 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:51.861215 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-xvltf_bed4219b-8cd3-44c7-b103-c72a634ae9a5/cluster-monitoring-operator/0.log" Sep 10 11:04:51.885494 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:51.885469 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-wdlk6_4fb695b8-24e1-43e4-8041-4cb927119ab6/kube-state-metrics/0.log" Sep 10 11:04:51.906723 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:51.906644 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-wdlk6_4fb695b8-24e1-43e4-8041-4cb927119ab6/kube-rbac-proxy-main/0.log" Sep 10 11:04:51.933411 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:51.933385 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-wdlk6_4fb695b8-24e1-43e4-8041-4cb927119ab6/kube-rbac-proxy-self/0.log" Sep 10 11:04:52.002697 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.002667 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-6dld5_de65ac04-3715-476d-88d0-6d55513fccd5/monitoring-plugin/0.log" Sep 10 11:04:52.211952 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.211878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqvns_46ec9b3b-087d-409a-93d8-b6cd3d5a520e/node-exporter/0.log" Sep 10 11:04:52.240481 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.240449 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqvns_46ec9b3b-087d-409a-93d8-b6cd3d5a520e/kube-rbac-proxy/0.log" Sep 10 11:04:52.264999 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.264974 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nqvns_46ec9b3b-087d-409a-93d8-b6cd3d5a520e/init-textfile/0.log" Sep 10 11:04:52.586896 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.586851 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-gp28g_6595a226-9771-4612-b955-781ee153883d/prometheus-operator/0.log" Sep 10 11:04:52.608144 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.608116 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-gp28g_6595a226-9771-4612-b955-781ee153883d/kube-rbac-proxy/0.log" Sep 10 11:04:52.810243 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.810212 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c47bc4998-6kq7r_5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a/thanos-query/0.log" Sep 10 11:04:52.835009 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.834981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c47bc4998-6kq7r_5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a/kube-rbac-proxy-web/0.log" Sep 10 11:04:52.866209 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.866130 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c47bc4998-6kq7r_5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a/kube-rbac-proxy/0.log" Sep 10 11:04:52.890232 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.890203 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c47bc4998-6kq7r_5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a/prom-label-proxy/0.log" Sep 10 11:04:52.920730 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.920708 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c47bc4998-6kq7r_5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a/kube-rbac-proxy-rules/0.log" Sep 10 11:04:52.954938 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:52.954907 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c47bc4998-6kq7r_5b7b8b31-cbac-4fe9-aa2b-cf4fa6362d2a/kube-rbac-proxy-metrics/0.log" Sep 10 11:04:54.555712 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:54.555677 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/2.log" Sep 10 11:04:54.559893 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:54.559869 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-lvw66_bf38c067-aa09-4fdd-8a48-843ad63dc145/console-operator/3.log" Sep 10 11:04:55.099951 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.099916 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7"] Sep 10 11:04:55.100246 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.100232 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="copy" Sep 10 11:04:55.100246 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.100247 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="copy" Sep 10 11:04:55.100342 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.100256 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="gather" Sep 10 11:04:55.100342 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.100263 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="gather" Sep 10 11:04:55.100342 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.100315 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="gather" Sep 10 11:04:55.100342 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.100325 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c2aebfe-5f0c-47c0-b9ef-4dc34c6c9b09" containerName="copy" Sep 10 11:04:55.103786 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.103766 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.107262 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.107233 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s64x\"/\"openshift-service-ca.crt\"" Sep 10 11:04:55.107432 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.107335 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9s64x\"/\"default-dockercfg-lqd5z\"" Sep 10 11:04:55.107677 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.107658 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9s64x\"/\"kube-root-ca.crt\"" Sep 10 11:04:55.114969 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.114944 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7"] Sep 10 11:04:55.182428 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.182388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scbk8\" (UniqueName: \"kubernetes.io/projected/9217e6b6-467d-462b-afd2-6a27d0e9087c-kube-api-access-scbk8\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.182428 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.182429 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-proc\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.182860 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.182447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-sys\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.182860 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.182543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-lib-modules\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.182860 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.182570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-podres\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283211 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-lib-modules\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283211 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283209 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-podres\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283410 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283262 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scbk8\" (UniqueName: \"kubernetes.io/projected/9217e6b6-467d-462b-afd2-6a27d0e9087c-kube-api-access-scbk8\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283410 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-proc\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283410 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-sys\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283410 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-lib-modules\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283410 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283385 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-sys\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283410 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283375 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-proc\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.283664 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.283427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9217e6b6-467d-462b-afd2-6a27d0e9087c-podres\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.291913 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.291890 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scbk8\" (UniqueName: \"kubernetes.io/projected/9217e6b6-467d-462b-afd2-6a27d0e9087c-kube-api-access-scbk8\") pod \"perf-node-gather-daemonset-v87m7\" (UID: \"9217e6b6-467d-462b-afd2-6a27d0e9087c\") " pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.416947 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.416862 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.519975 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.519941 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-2mhws_e4ef6d90-01cc-49e9-ade1-03c5f6ce0af9/volume-data-source-validator/0.log" Sep 10 11:04:55.690719 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.690643 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7"] Sep 10 11:04:55.694405 ip-10-0-143-147 kubenswrapper[2556]: W0910 11:04:55.694377 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9217e6b6_467d_462b_afd2_6a27d0e9087c.slice/crio-36ff5b22710d4133e06532b3cb984f5181118b6729b0f57d738cec0ca6f0bb22 WatchSource:0}: Error finding container 36ff5b22710d4133e06532b3cb984f5181118b6729b0f57d738cec0ca6f0bb22: Status 404 returned error can't find the container with id 36ff5b22710d4133e06532b3cb984f5181118b6729b0f57d738cec0ca6f0bb22 Sep 10 11:04:55.791763 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.791730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" event={"ID":"9217e6b6-467d-462b-afd2-6a27d0e9087c","Type":"ContainerStarted","Data":"a2d36b5a038aefc71335a41b043ddc1618925897adcdbe6d1c2170dd2d73ed1d"} Sep 10 11:04:55.791923 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.791787 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" event={"ID":"9217e6b6-467d-462b-afd2-6a27d0e9087c","Type":"ContainerStarted","Data":"36ff5b22710d4133e06532b3cb984f5181118b6729b0f57d738cec0ca6f0bb22"} Sep 10 11:04:55.791923 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.791826 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:04:55.807956 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:55.807847 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" podStartSLOduration=0.807827869 podStartE2EDuration="807.827869ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:04:55.807790675 +0000 UTC m=+1818.613857370" watchObservedRunningTime="2026-09-10 11:04:55.807827869 +0000 UTC m=+1818.613894566" Sep 10 11:04:56.398837 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:56.398807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqhpd_7a1a990e-fa6c-4e25-8464-a5f18ea27e75/dns/0.log" Sep 10 11:04:56.422029 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:56.422000 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqhpd_7a1a990e-fa6c-4e25-8464-a5f18ea27e75/kube-rbac-proxy/0.log" Sep 10 11:04:56.447012 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:56.446985 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zpbg_3bc0df36-7279-4352-9fb6-cb02e3d17a16/dns-node-resolver/0.log" Sep 10 11:04:56.950923 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:56.950893 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcmh4_43dcdf8f-1ed0-414a-ab8c-45d6595436c7/node-ca/0.log" Sep 10 11:04:57.696661 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:57.696635 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dc99bb984-k9f94_1ec7ae5e-c8bf-4bc5-bfb3-61736c0d8d18/router/0.log" Sep 10 11:04:58.057836 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:58.057764 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtct2_86bf8262-4bf1-4a4f-92cd-05ded5c5ecc8/serve-healthcheck-canary/0.log" Sep 10 11:04:58.442823 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:58.442786 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-lzpsv_b0978729-e8b1-4974-a1e9-7fd009be2e84/insights-operator/0.log" Sep 10 11:04:58.443045 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:58.443011 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-lzpsv_b0978729-e8b1-4974-a1e9-7fd009be2e84/insights-operator/1.log" Sep 10 11:04:58.464685 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:58.464661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bd94t_658aaa93-d59c-41b7-91b3-f5f884d86a58/kube-rbac-proxy/0.log" Sep 10 11:04:58.488397 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:58.488366 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bd94t_658aaa93-d59c-41b7-91b3-f5f884d86a58/exporter/0.log" Sep 10 11:04:58.510925 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:04:58.510894 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bd94t_658aaa93-d59c-41b7-91b3-f5f884d86a58/extractor/0.log" Sep 10 11:05:01.806323 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:01.806293 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9s64x/perf-node-gather-daemonset-v87m7" Sep 10 11:05:02.871165 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:02.871128 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-fxzbc_e4bb97fa-c372-4efd-879a-07944f3893bf/kube-storage-version-migrator-operator/1.log" Sep 10 11:05:02.872156 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:02.872131 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-fxzbc_e4bb97fa-c372-4efd-879a-07944f3893bf/kube-storage-version-migrator-operator/0.log" Sep 10 11:05:03.758262 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.758182 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/kube-multus-additional-cni-plugins/0.log" Sep 10 11:05:03.783459 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.783430 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/egress-router-binary-copy/0.log" Sep 10 11:05:03.807634 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.807599 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/cni-plugins/0.log" Sep 10 11:05:03.850691 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.850661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/bond-cni-plugin/0.log" Sep 10 11:05:03.876325 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.876302 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/routeoverride-cni/0.log" Sep 10 11:05:03.900209 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.900180 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/whereabouts-cni-bincopy/0.log" Sep 10 11:05:03.922376 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:03.922349 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bvdl_b08b751d-ba65-4665-bbef-1ac8d98d4ba3/whereabouts-cni/0.log" Sep 10 11:05:04.375034 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:04.375000 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpzpl_cf37d1e7-5be3-42b0-b562-c7472cf86966/kube-multus/0.log" Sep 10 11:05:04.447163 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:04.447138 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cwjm6_b96fbb0c-ffd8-4108-b549-63268fba21e9/network-metrics-daemon/0.log" Sep 10 11:05:04.470974 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:04.470942 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cwjm6_b96fbb0c-ffd8-4108-b549-63268fba21e9/kube-rbac-proxy/0.log" Sep 10 11:05:05.423756 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.423720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/ovn-controller/0.log" Sep 10 11:05:05.442321 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.442293 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/ovn-acl-logging/0.log" Sep 10 11:05:05.466516 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.466487 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/kube-rbac-proxy-node/0.log" Sep 10 11:05:05.488583 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.488558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 11:05:05.509818 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.509782 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/northd/0.log" Sep 10 11:05:05.532837 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.532807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/nbdb/0.log" Sep 10 11:05:05.560643 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.560568 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/sbdb/0.log" Sep 10 11:05:05.599370 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:05.599333 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ggnbq_58d0bc8c-aaf7-44a6-a44b-9eba02f29d5a/ovnkube-controller/0.log" Sep 10 11:05:06.752058 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:06.752028 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-flndl_65f22a38-5419-4d20-b9b3-db7815aa95c6/check-endpoints/0.log" Sep 10 11:05:06.775519 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:06.775494 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-c72pg_a45a92c6-9ea5-4f4a-a813-89ec733ea0db/network-check-target-container/0.log" Sep 10 11:05:07.791901 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:07.791873 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-t9j6j_a4e5221e-de38-4cd6-8f2e-fd063c40d300/iptables-alerter/0.log" Sep 10 11:05:08.552379 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:08.552328 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-ptfpj_96a0671c-73e8-4cbf-b8a7-f967f232613a/tuned/0.log" Sep 10 11:05:10.379713 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:10.379673 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-42zrm_725e4b71-a490-421b-bdde-ac228899337a/cluster-samples-operator/0.log" Sep 10 11:05:10.399369 ip-10-0-143-147 kubenswrapper[2556]: I0910 11:05:10.399343 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-42zrm_725e4b71-a490-421b-bdde-ac228899337a/cluster-samples-operator-watch/0.log"