Sep 08 08:07:37.449901 ip-10-0-130-42 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 08 08:07:37.449916 ip-10-0-130-42 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 08 08:07:37.449926 ip-10-0-130-42 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 08 08:07:37.450145 ip-10-0-130-42 systemd[1]: Failed to start Kubernetes Kubelet. Sep 08 08:07:47.561207 ip-10-0-130-42 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 08 08:07:47.561221 ip-10-0-130-42 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aef717ebb54a48529f0b33dd705fb311 -- Sep 08 08:09:38.487841 ip-10-0-130-42 systemd[1]: Starting Kubernetes Kubelet... Sep 08 08:09:38.872248 ip-10-0-130-42 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 08:09:38.872248 ip-10-0-130-42 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 08:09:38.872248 ip-10-0-130-42 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 08:09:38.872248 ip-10-0-130-42 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 08:09:38.872990 ip-10-0-130-42 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 08:09:38.875340 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.875227 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 08:09:38.879023 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.878995 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:09:38.879023 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879018 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:09:38.879023 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879023 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:09:38.879023 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879029 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:09:38.879023 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879034 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879039 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879043 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879047 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879052 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879056 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879060 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879064 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879074 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879079 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879084 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879090 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879094 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879098 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879102 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879106 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879109 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879113 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879117 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879121 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:09:38.879348 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879125 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879129 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879135 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879139 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879143 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879147 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879151 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879155 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879158 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879162 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879166 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879170 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879175 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879188 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879194 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879201 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879206 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879210 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879224 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:09:38.880273 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879229 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879233 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879238 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879243 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879249 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879255 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879260 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879264 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879269 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879274 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879278 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879282 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879287 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879291 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879296 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879300 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879304 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879308 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879313 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879317 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:09:38.881095 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879324 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879328 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879332 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879336 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879340 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879344 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879348 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879352 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879356 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879360 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879365 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879369 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879374 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879378 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879382 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879387 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879392 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879398 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879421 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:09:38.881963 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879427 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879432 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879437 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879441 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879445 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879449 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879453 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879457 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879462 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879466 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879471 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879475 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879480 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879484 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879488 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879492 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.879497 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880749 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880763 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880768 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:09:38.882779 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880773 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880779 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880783 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880788 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880792 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880797 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880805 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880812 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880816 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880820 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880824 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880829 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880833 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880837 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880841 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880845 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880849 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880853 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880858 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880862 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:09:38.883665 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880866 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880870 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880874 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880879 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880883 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880887 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880892 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880899 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880904 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880909 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880914 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880919 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880925 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880931 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880937 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880942 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880946 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880951 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880955 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:09:38.884382 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880964 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880969 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880973 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880977 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880982 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880986 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880990 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880994 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.880999 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881003 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881007 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881013 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881018 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881023 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881028 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881032 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881037 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881042 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881047 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881052 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:09:38.884925 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881056 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881061 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881065 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881069 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881074 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881078 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881083 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881087 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881091 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881095 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881099 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881102 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881106 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881111 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881115 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881119 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881123 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881127 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881131 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881135 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:09:38.885470 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881139 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881144 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881148 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881154 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881158 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881162 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881194 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881202 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881208 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881212 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881217 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881221 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881226 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881229 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881234 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881238 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881242 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881906 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881917 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:09:38.885997 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881922 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881926 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881931 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881935 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881939 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881943 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881949 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881953 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881958 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881962 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881966 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881969 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881973 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881977 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881981 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881986 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881990 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881994 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.881998 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882002 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:09:38.886535 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882007 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882014 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882020 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882025 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882029 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882034 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882038 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882042 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882046 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882051 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882056 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882061 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882065 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882070 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882074 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882078 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882082 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882086 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882090 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:09:38.887078 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882096 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882100 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882105 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882110 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882114 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882118 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882122 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882126 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882130 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882134 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882139 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882143 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882147 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882151 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882156 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882160 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882164 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882168 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882172 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882176 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882180 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:09:38.887578 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882185 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882189 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882193 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882197 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882201 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882206 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882211 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882215 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882219 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882223 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882227 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882231 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882237 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882241 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882245 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882249 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882253 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882257 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882265 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:09:38.888099 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882271 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882275 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882280 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882284 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882288 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882293 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882298 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882303 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882307 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882311 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882315 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882320 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882324 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882330 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882335 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882339 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882343 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.882348 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882478 2580 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882539 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 08:09:38.888613 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882549 2580 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882556 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882563 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882568 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882575 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882582 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882590 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882595 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882601 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882606 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882611 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882615 2580 flags.go:64] FLAG: --cgroup-root="" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882620 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882628 2580 flags.go:64] FLAG: --client-ca-file="" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882633 2580 flags.go:64] FLAG: --cloud-provider="external" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882638 2580 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882646 2580 flags.go:64] FLAG: --cluster-domain="" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882652 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882658 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882663 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882669 2580 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882676 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882681 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 08:09:38.889114 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882686 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882691 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882696 2580 flags.go:64] FLAG: --contention-profiling="false" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882702 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882707 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882712 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882717 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882723 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882728 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882733 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882737 2580 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882742 2580 flags.go:64] FLAG: --enable-server="true" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882748 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882754 2580 flags.go:64] FLAG: --event-burst="100" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882759 2580 flags.go:64] FLAG: --event-qps="50" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882764 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882771 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882775 2580 flags.go:64] FLAG: --eviction-hard="" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882781 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882786 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882791 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882795 2580 flags.go:64] FLAG: --eviction-soft="" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882801 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882806 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882810 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 08:09:38.889697 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882817 2580 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882825 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882830 2580 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882834 2580 flags.go:64] FLAG: --feature-gates="" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882847 2580 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882852 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882858 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882863 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882869 2580 flags.go:64] FLAG: --healthz-port="10248" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882874 2580 flags.go:64] FLAG: --help="false" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882879 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-130-42.ec2.internal" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882884 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882890 2580 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882895 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882901 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882907 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882912 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882917 2580 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882922 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882926 2580 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882931 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882936 2580 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882941 2580 flags.go:64] FLAG: --kube-reserved="" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882947 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 08:09:38.890367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882953 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882958 2580 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882963 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882968 2580 flags.go:64] FLAG: --lock-file="" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882972 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882979 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882984 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882993 2580 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.882998 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883005 2580 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883010 2580 flags.go:64] FLAG: --logging-format="text" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883015 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883021 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883026 2580 flags.go:64] FLAG: --manifest-url="" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883031 2580 flags.go:64] FLAG: --manifest-url-header="" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883039 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883044 2580 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883050 2580 flags.go:64] FLAG: --max-pods="110" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883055 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883059 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883064 2580 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883069 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883074 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883079 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883084 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 08:09:38.891018 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883096 2580 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883101 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883106 2580 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883111 2580 flags.go:64] FLAG: --pod-cidr="" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883116 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883126 2580 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883131 2580 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883136 2580 flags.go:64] FLAG: --pods-per-core="0" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883141 2580 flags.go:64] FLAG: --port="10250" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883146 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883151 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066677879871c9e63" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883157 2580 flags.go:64] FLAG: --qos-reserved="" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883164 2580 flags.go:64] FLAG: --read-only-port="10255" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883169 2580 flags.go:64] FLAG: --register-node="true" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883174 2580 flags.go:64] FLAG: --register-with-taints="" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883189 2580 flags.go:64] FLAG: --registry-burst="10" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883194 2580 flags.go:64] FLAG: --registry-qps="5" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883201 2580 flags.go:64] FLAG: --reserved-cpus="" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883205 2580 flags.go:64] FLAG: --reserved-memory="" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883212 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883217 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883222 2580 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883227 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883232 2580 flags.go:64] FLAG: --runonce="false" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883237 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 08:09:38.891694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883242 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883248 2580 flags.go:64] FLAG: --seccomp-default="false" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883253 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883257 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883262 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883267 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883272 2580 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883277 2580 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883281 2580 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883286 2580 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883291 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883296 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883300 2580 flags.go:64] FLAG: --system-cgroups="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883305 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883314 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883318 2580 flags.go:64] FLAG: --tls-cert-file="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883325 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883333 2580 flags.go:64] FLAG: --tls-min-version="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883337 2580 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883344 2580 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883364 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883371 2580 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883376 2580 flags.go:64] FLAG: --v="2" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883383 2580 flags.go:64] FLAG: --version="false" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883392 2580 flags.go:64] FLAG: --vmodule="" Sep 08 08:09:38.892308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883398 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.883419 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883611 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883620 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883626 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883631 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883636 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883641 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883647 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883652 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883656 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883662 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883668 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883672 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883676 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883680 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883684 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883688 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883692 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:09:38.893007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883696 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883701 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883705 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883710 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883714 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883720 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883725 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883732 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883736 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883740 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883744 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883749 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883757 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883761 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883765 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883770 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883775 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883779 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883784 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883789 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:09:38.893508 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883794 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883801 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883806 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883810 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883814 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883819 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883824 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883829 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883833 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883838 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883842 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883846 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883850 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883854 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883859 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883863 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883867 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883872 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883877 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:09:38.894004 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883883 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883887 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883891 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883895 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883900 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883906 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883910 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883914 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883918 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883923 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883927 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883931 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883935 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883939 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883944 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883948 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883952 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883956 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883960 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883964 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:09:38.894500 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883969 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883973 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883977 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883981 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883985 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883989 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883993 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.883997 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884001 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884006 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884010 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884014 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884020 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884025 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884029 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884033 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884037 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884043 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884047 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884052 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:09:38.894999 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884056 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884060 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.884102 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.884128 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.892869 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.892897 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.892923 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.892931 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893010 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893018 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893022 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893028 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893032 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893036 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893039 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:09:38.895543 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893043 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893046 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893050 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893055 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893058 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893062 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893066 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893072 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893078 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893083 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893086 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893090 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893094 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893099 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893103 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893107 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893111 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893115 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893118 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:09:38.895968 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893124 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893130 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893135 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893141 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893145 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893149 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893154 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893157 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893160 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893164 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893168 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893172 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893175 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893179 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893183 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893186 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893189 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893193 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893197 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893200 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:09:38.896580 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893204 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893207 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893211 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893215 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893219 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893222 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893226 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893230 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893233 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893236 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893240 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893244 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893249 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893254 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893258 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893263 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893266 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893270 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893274 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893277 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:09:38.897077 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893281 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893284 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893288 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893291 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893296 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893299 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893303 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893306 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893310 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893314 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893317 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893321 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893325 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893329 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893332 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893336 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893339 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893344 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893347 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:09:38.897699 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893351 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893354 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893358 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893362 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893366 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893370 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893374 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893378 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893384 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893389 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893393 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893397 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893440 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893445 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:09:38.898648 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.893468 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893637 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893644 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893649 2580 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893653 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893657 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893662 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893666 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893671 2580 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893675 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893678 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893682 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893686 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893690 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893694 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893697 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893701 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893705 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893710 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893714 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:09:38.899016 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893718 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893722 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893726 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893730 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893734 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893738 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893743 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893747 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893751 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893755 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893759 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893762 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893766 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893770 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893775 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893779 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893783 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893787 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893791 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893794 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:09:38.899561 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893798 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893802 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893806 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893809 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893813 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893816 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893820 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893825 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893829 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893834 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893838 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893841 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893845 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893849 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893852 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893856 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893860 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893863 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893867 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893872 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:09:38.900063 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893876 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893880 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893883 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893887 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893890 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893894 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893898 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893901 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893905 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893909 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893913 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893917 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893920 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893924 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893928 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893932 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893937 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893942 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893947 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893951 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:09:38.900569 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893955 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893959 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893962 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893966 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893970 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893974 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893978 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893981 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893984 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893988 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893992 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.893998 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894004 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894014 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894018 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894023 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894027 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894031 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894035 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:09:38.901050 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:38.894040 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:09:38.901542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.894047 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 08:09:38.901542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.894221 2580 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 08:09:38.901542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.898376 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 08:09:38.901542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.899466 2580 server.go:1019] "Starting client certificate rotation" Sep 08 08:09:38.901542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.899573 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 08:09:38.901542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.900182 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 08:09:38.903298 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.902619 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 08:09:38.910763 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.910734 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 08:09:38.920439 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.920392 2580 log.go:25] "Validated CRI v1 runtime API" Sep 08 08:09:38.924304 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.924282 2580 log.go:25] "Validated CRI v1 image API" Sep 08 08:09:38.925757 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.925733 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 08:09:38.929374 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.929350 2580 fs.go:135] Filesystem UUIDs: map[3521cc94-236f-47c9-8899-668648245776:/dev/nvme0n1p4 48b115af-54bc-4274-8ed2-1e12ff78788b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 08 08:09:38.929457 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.929372 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 08:09:38.934739 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.934719 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 08:09:38.934922 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.934782 2580 manager.go:216] Machine: {Timestamp:2026-09-08 08:09:38.933475115 +0000 UTC m=+0.331424400 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094597 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad631e9f0c791ee9eac0b6d8b1208 SystemUUID:ec2ad631-e9f0-c791-ee9e-ac0b6d8b1208 BootID:aef717eb-b54a-4852-9f0b-33dd705fb311 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:7f:ae:35:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:7f:ae:35:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:26:df:3d:f4:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 08:09:38.935000 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.934923 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 08:09:38.935082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.935069 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 08:09:38.937434 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.937379 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 08:09:38.937582 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.937436 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-42.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 08:09:38.938187 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.938176 2580 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 08:09:38.938223 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.938188 2580 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 08:09:38.938223 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.938197 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 08:09:38.938223 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.938212 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 08:09:38.939556 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.939542 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 08:09:38.943239 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943220 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 08 08:09:38.943384 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943373 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 08:09:38.943433 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943420 2580 kubelet.go:486] "Attempting to sync node with API server" Sep 08 08:09:38.943433 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943431 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 08:09:38.943515 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943447 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 08:09:38.943515 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943457 2580 kubelet.go:398] "Adding apiserver pod source" Sep 08 08:09:38.943515 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943467 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 08:09:38.943885 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943870 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 08:09:38.943964 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.943890 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 08:09:38.945937 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.945912 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 08:09:38.948497 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948480 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 08:09:38.948579 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948520 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 08:09:38.948757 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948744 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 08:09:38.948813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948764 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 08:09:38.948813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948774 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 08:09:38.948813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948781 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 08:09:38.948813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948793 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 08:09:38.948813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.948801 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 08:09:38.949152 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949142 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 08:09:38.949187 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949154 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 08:09:38.949187 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949164 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 08:09:38.949187 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949172 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 08:09:38.949187 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949184 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 08:09:38.949383 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949205 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 08:09:38.949999 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.949961 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 08:09:38.950266 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.950247 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 08:09:38.954425 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.954390 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-42.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 08:09:38.954551 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.954450 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 08:09:38.955696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.955682 2580 server.go:1268] "Started kubelet" Sep 08 08:09:38.955801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.955769 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 08:09:38.956061 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.955769 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 08:09:38.956130 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.956093 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 08:09:38.956639 ip-10-0-130-42 systemd[1]: Started Kubernetes Kubelet. Sep 08 08:09:38.957528 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.957438 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 08:09:38.958032 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.958019 2580 server.go:310] "Adding debug handlers to kubelet server" Sep 08 08:09:38.959293 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.959272 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bttv5" Sep 08 08:09:38.960563 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.960538 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 08:09:38.960675 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.960571 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 08:09:38.961521 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.960575 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-42.ec2.internal.18d34a2027570ba7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-42.ec2.internal,UID:ip-10-0-130-42.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-42.ec2.internal,},FirstTimestamp:2026-09-08 08:09:38.955643815 +0000 UTC m=+0.353593106,LastTimestamp:2026-09-08 08:09:38.955643815 +0000 UTC m=+0.353593106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-42.ec2.internal,}" Sep 08 08:09:38.962633 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.962616 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 08:09:38.963105 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.963084 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 08:09:38.963203 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.963191 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:38.963873 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.963848 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 08:09:38.963873 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.963848 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 08:09:38.963873 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.963877 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 08:09:38.964038 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.963965 2580 reconstruct.go:97] "Volume reconstruction finished" Sep 08 08:09:38.964038 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.963975 2580 reconciler.go:29] "Reconciler: start to sync state" Sep 08 08:09:38.964577 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964560 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 08:09:38.964577 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964575 2580 factory.go:55] Registering systemd factory Sep 08 08:09:38.964700 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964582 2580 factory.go:223] Registration of the systemd container factory successfully Sep 08 08:09:38.964803 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964788 2580 factory.go:153] Registering CRI-O factory Sep 08 08:09:38.964854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964807 2580 factory.go:223] Registration of the crio container factory successfully Sep 08 08:09:38.964854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964826 2580 factory.go:103] Registering Raw factory Sep 08 08:09:38.964854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.964841 2580 manager.go:1196] Started watching for new ooms in manager Sep 08 08:09:38.965272 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.965243 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 08:09:38.965356 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.965337 2580 manager.go:349] Starting recovery of all containers Sep 08 08:09:38.965484 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:38.965454 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-42.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 08:09:38.969111 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.969082 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bttv5" Sep 08 08:09:38.977167 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.977146 2580 manager.go:354] Recovery completed Sep 08 08:09:38.981775 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.981755 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:38.988145 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988115 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:38.988283 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988161 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:38.988283 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988176 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:38.988882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988841 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 08:09:38.988882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988856 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 08:09:38.988882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988871 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:38.988882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.988879 2580 state_mem.go:36] "Initialized new in-memory state store" Sep 08 08:09:38.989637 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.989619 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:38.989730 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.989650 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:38.989730 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.989663 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:38.990682 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.990669 2580 policy_none.go:49] "None policy: Start" Sep 08 08:09:38.990743 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.990686 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 08:09:38.990743 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.990696 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 08:09:38.991974 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:38.991960 2580 policy_none.go:47] "Start" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032341 2580 manager.go:337] "Starting Device Plugin manager" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.032388 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032425 2580 server.go:87] "Starting device plugin registration server" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032753 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032766 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032866 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032959 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.032969 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.033433 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.033484 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.076731 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.078071 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.078128 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.078158 2580 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 08:09:39.079914 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.078208 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 08:09:39.080473 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.080133 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:09:39.133218 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.133102 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:39.134088 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.134070 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:39.134191 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.134103 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:39.134191 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.134126 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:39.134191 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.134151 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.139829 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.139806 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.139910 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.139838 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-42.ec2.internal\": node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.152880 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.152855 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.179068 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.179034 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal"] Sep 08 08:09:39.179139 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.179124 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:39.180073 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.180057 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:39.180163 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.180084 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:39.180163 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.180094 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:39.181354 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.181340 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:39.181502 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.181486 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.181560 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.181523 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:39.182178 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.182157 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:39.182282 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.182192 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:39.182282 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.182211 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:39.183099 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.183074 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:39.183168 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.183102 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:39.183168 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.183119 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:39.184397 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.184381 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.184477 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.184429 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:09:39.185170 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.185152 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:09:39.185247 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.185185 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:09:39.185247 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.185200 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:09:39.207253 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.207226 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-42.ec2.internal\" not found" node="ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.210724 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.210701 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-42.ec2.internal\" not found" node="ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.253589 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.253550 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.265782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.265753 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3eec83538a6b5de42befc4a32d7da43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal\" (UID: \"a3eec83538a6b5de42befc4a32d7da43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.265908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.265787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/639100c0bcc92b941a8949df16e60bc8-config\") pod \"kube-apiserver-proxy-ip-10-0-130-42.ec2.internal\" (UID: \"639100c0bcc92b941a8949df16e60bc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.265908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.265804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3eec83538a6b5de42befc4a32d7da43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal\" (UID: \"a3eec83538a6b5de42befc4a32d7da43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.354163 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.354117 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.366530 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.366506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3eec83538a6b5de42befc4a32d7da43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal\" (UID: \"a3eec83538a6b5de42befc4a32d7da43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.366615 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.366538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3eec83538a6b5de42befc4a32d7da43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal\" (UID: \"a3eec83538a6b5de42befc4a32d7da43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.366615 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.366555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/639100c0bcc92b941a8949df16e60bc8-config\") pod \"kube-apiserver-proxy-ip-10-0-130-42.ec2.internal\" (UID: \"639100c0bcc92b941a8949df16e60bc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.366615 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.366586 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/639100c0bcc92b941a8949df16e60bc8-config\") pod \"kube-apiserver-proxy-ip-10-0-130-42.ec2.internal\" (UID: \"639100c0bcc92b941a8949df16e60bc8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.366715 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.366616 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3eec83538a6b5de42befc4a32d7da43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal\" (UID: \"a3eec83538a6b5de42befc4a32d7da43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.366715 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.366618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3eec83538a6b5de42befc4a32d7da43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal\" (UID: \"a3eec83538a6b5de42befc4a32d7da43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.455052 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.454833 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.512304 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.512263 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.513494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.513469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" Sep 08 08:09:39.556190 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.556129 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.662885 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.662780 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.770530 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.770481 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.874805 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.874768 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:39.899308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.899269 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 08:09:39.899492 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.899475 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 08:09:39.971791 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.971680 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 08:04:39 +0000 UTC" deadline="2028-02-07 23:04:02.482235071 +0000 UTC" Sep 08 08:09:39.971791 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:39.971737 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12422h54m22.510501986s" Sep 08 08:09:39.975942 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:39.975911 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:40.077145 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.077096 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:40.178183 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.178129 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:40.278273 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.278207 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:40.287873 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.287821 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:09:40.378536 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.378486 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:40.478842 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.478787 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-42.ec2.internal\" not found" Sep 08 08:09:40.488482 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.488452 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:09:40.498621 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.498595 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:09:40.567838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.567776 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" Sep 08 08:09:40.580053 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.580012 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 08:09:40.581050 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.581027 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" Sep 08 08:09:40.587827 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.587806 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 08:09:40.947224 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.947135 2580 apiserver.go:52] "Watching apiserver" Sep 08 08:09:40.954854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.954822 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 08:09:40.955893 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.955868 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-77fzv","kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc","openshift-cluster-node-tuning-operator/tuned-976wb","openshift-dns/node-resolver-tqjlv","openshift-image-registry/node-ca-g9pwg","openshift-multus/multus-lthzv","kube-system/global-pull-secret-syncer-wdc7x","kube-system/konnectivity-agent-qrxvm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal","openshift-multus/multus-additional-cni-plugins-zpnjl","openshift-multus/network-metrics-daemon-7dtzg","openshift-network-diagnostics/network-check-target-nmj4j","openshift-network-operator/iptables-alerter-697tt"] Sep 08 08:09:40.957601 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.957582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.959368 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.959346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:40.959476 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.959444 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:40.960847 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.960828 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 08:09:40.960959 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.960935 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.960959 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.960947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.961064 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.961009 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.961064 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.961040 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7ww7j\"" Sep 08 08:09:40.961064 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.961005 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 08:09:40.962206 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.962181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.963417 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.963395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:40.963599 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.963454 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 08:09:40.963740 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.963720 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.963821 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.963720 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bqjj6\"" Sep 08 08:09:40.963896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.963826 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 08:09:40.963896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.963865 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.964724 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.964693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:40.964724 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.964722 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.964908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.964744 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtqmt\"" Sep 08 08:09:40.964908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.964753 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.966106 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.966085 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f5czd\"" Sep 08 08:09:40.966198 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.966111 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:40.966198 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.966144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.966326 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.966309 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.967440 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.967402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.967545 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.967457 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xkp8w\"" Sep 08 08:09:40.967594 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.967573 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 08:09:40.967629 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.967608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:40.968474 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.968231 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.969700 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.969665 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 08:09:40.969866 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.969844 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hn4d7\"" Sep 08 08:09:40.970055 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.970038 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 08:09:40.970934 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.970861 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.971298 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.971272 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 08:09:40.971517 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.971371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:40.972304 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.972228 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 08:09:40.972437 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.972403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 08:09:40.972552 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.972479 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sq8mr\"" Sep 08 08:09:40.972612 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.972552 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 08:09:40.972796 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.972777 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.973838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.973818 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:40.973942 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.973925 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:40.974186 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.974167 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 08:09:40.975004 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.974986 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 08:09:40.975269 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.975253 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:40.975383 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.975270 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x4nzq\"" Sep 08 08:09:40.975468 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.975410 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 08:09:40.975737 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.975720 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 08:09:40.976689 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.976670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:40.976785 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:40.976731 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:40.978193 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.978177 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 08:09:40.978289 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.978254 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 08:09:40.978530 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.978514 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pqtnn\"" Sep 08 08:09:40.983086 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.982942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-cni-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983086 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.982978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-socket-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.983086 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysconfig\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983086 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysctl-conf\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983277 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-sys\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983277 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-host\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983277 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a550aec1-3389-4e89-b02f-1c8eb07f3980-serviceca\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:40.983277 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-cnibin\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983277 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-hostroot\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983277 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-conf-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-etc-kubernetes\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-run\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-lib-modules\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-var-lib-kubelet\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-hosts-file\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983478 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8ce4b78-639d-488e-abe0-f64f444873c3-cni-binary-copy\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-kubelet\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983535 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-tuned\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983558 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-tmp-dir\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983577 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a550aec1-3389-4e89-b02f-1c8eb07f3980-host\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983607 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-socket-dir-parent\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-multus-certs\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-modprobe-d\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983667 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rwhc\" (UniqueName: \"kubernetes.io/projected/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-kube-api-access-4rwhc\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc2kb\" (UniqueName: \"kubernetes.io/projected/a550aec1-3389-4e89-b02f-1c8eb07f3980-kube-api-access-nc2kb\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983708 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-k8s-cni-cncf-io\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-kubernetes\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-systemd\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983818 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-system-cni-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.983838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-registration-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-device-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgsgt\" (UniqueName: \"kubernetes.io/projected/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-kube-api-access-sgsgt\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-netns\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-cni-bin\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-cni-multus\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.983995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-daemon-config\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-sys-fs\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-tmp\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg9mj\" (UniqueName: \"kubernetes.io/projected/c8ce4b78-639d-488e-abe0-f64f444873c3-kube-api-access-xg9mj\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt44g\" (UniqueName: \"kubernetes.io/projected/1cc6b9f4-8934-4b44-9032-abd9564d1592-kube-api-access-bt44g\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:40.984284 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.984184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysctl-d\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:40.995376 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:40.995345 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8k9n7" Sep 08 08:09:41.005934 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.005727 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8k9n7" Sep 08 08:09:41.065405 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.065367 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 08:09:41.084419 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-cni-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.084419 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-sys\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.084608 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-host\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.084608 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-sys\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.084732 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084603 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-host\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.084732 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a550aec1-3389-4e89-b02f-1c8eb07f3980-serviceca\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.084732 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-systemd\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-ovn\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-cni-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-env-overrides\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-cnibin\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-conf-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084834 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-cnibin\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-etc-kubernetes\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.084880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-lib-modules\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084893 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-etc-kubernetes\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-var-lib-kubelet\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-conf-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glsj7\" (UniqueName: \"kubernetes.io/projected/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-kube-api-access-glsj7\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-tuned\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.084987 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-var-lib-kubelet\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085003 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-lib-modules\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a550aec1-3389-4e89-b02f-1c8eb07f3980-host\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94gzf\" (UniqueName: \"kubernetes.io/projected/022f496c-5a6a-4740-82bf-ac92da9ac68b-kube-api-access-94gzf\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-kubelet\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a550aec1-3389-4e89-b02f-1c8eb07f3980-host\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-multus-certs\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-multus-certs\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rwhc\" (UniqueName: \"kubernetes.io/projected/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-kube-api-access-4rwhc\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a550aec1-3389-4e89-b02f-1c8eb07f3980-serviceca\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.085271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-k8s-cni-cncf-io\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085299 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-k8s-cni-cncf-io\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-kubernetes\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085310 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085367 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-kubernetes\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-host-slash\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-system-cni-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-registration-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085503 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-cni-bin\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-system-cni-dir\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-registration-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-cni-netd\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovnkube-script-lib\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-iptables-alerter-script\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.086093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-netns\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-cni-bin\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085779 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-run-netns\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-cni-multus\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-cni-bin\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085851 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-cni-multus\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-sys-fs\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pthwp\" (UniqueName: \"kubernetes.io/projected/b0e723d1-06db-4e84-8fd8-50e671409c4d-kube-api-access-pthwp\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085922 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085962 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-sys-fs\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.085970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg9mj\" (UniqueName: \"kubernetes.io/projected/c8ce4b78-639d-488e-abe0-f64f444873c3-kube-api-access-xg9mj\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt44g\" (UniqueName: \"kubernetes.io/projected/1cc6b9f4-8934-4b44-9032-abd9564d1592-kube-api-access-bt44g\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysctl-d\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.086958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovn-node-metrics-cert\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-socket-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086189 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysctl-d\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysconfig\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysctl-conf\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086260 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysconfig\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-var-lib-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8baef419-3fad-4acd-a31a-6c22f04b8b7a-kubelet-config\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8baef419-3fad-4acd-a31a-6c22f04b8b7a-dbus\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086334 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-socket-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-hostroot\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-run\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086382 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-sysctl-conf\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-hosts-file\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086398 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-hostroot\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-slash\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.087706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-hosts-file\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-run\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovnkube-config\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086491 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-cnibin\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8ce4b78-639d-488e-abe0-f64f444873c3-cni-binary-copy\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-kubelet\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-tmp-dir\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-systemd-units\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086573 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-run-netns\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-node-log\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-system-cni-dir\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086623 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-host-var-lib-kubelet\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-socket-dir-parent\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-socket-dir-parent\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-modprobe-d\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc2kb\" (UniqueName: \"kubernetes.io/projected/a550aec1-3389-4e89-b02f-1c8eb07f3980-kube-api-access-nc2kb\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.088228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf898da0-c482-407f-8b09-20d34e9578f9-konnectivity-ca\") pod \"konnectivity-agent-qrxvm\" (UID: \"cf898da0-c482-407f-8b09-20d34e9578f9\") " pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-run-ovn-kubernetes\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-systemd\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf898da0-c482-407f-8b09-20d34e9578f9-agent-certs\") pod \"konnectivity-agent-qrxvm\" (UID: \"cf898da0-c482-407f-8b09-20d34e9578f9\") " pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-modprobe-d\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086865 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-tmp-dir\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086922 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-systemd\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-device-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgsgt\" (UniqueName: \"kubernetes.io/projected/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-kube-api-access-sgsgt\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.086991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-daemon-config\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cc6b9f4-8934-4b44-9032-abd9564d1592-device-dir\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-tmp\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-log-socket\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087046 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8ce4b78-639d-488e-abe0-f64f444873c3-cni-binary-copy\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087104 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-etc-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.088857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.089542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9h85\" (UniqueName: \"kubernetes.io/projected/01ccc839-5232-4795-a8c8-3fa013abedf0-kube-api-access-z9h85\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.089542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.087468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c8ce4b78-639d-488e-abe0-f64f444873c3-multus-daemon-config\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.089542 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.089533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-tmp\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.089664 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.089555 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-etc-tuned\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.107218 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.107182 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg9mj\" (UniqueName: \"kubernetes.io/projected/c8ce4b78-639d-488e-abe0-f64f444873c3-kube-api-access-xg9mj\") pod \"multus-lthzv\" (UID: \"c8ce4b78-639d-488e-abe0-f64f444873c3\") " pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.107494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.107457 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rwhc\" (UniqueName: \"kubernetes.io/projected/42f31a0e-8ddd-48cf-acb2-5c3a0929c874-kube-api-access-4rwhc\") pod \"tuned-976wb\" (UID: \"42f31a0e-8ddd-48cf-acb2-5c3a0929c874\") " pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.111628 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.111600 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgsgt\" (UniqueName: \"kubernetes.io/projected/115a5fcc-cda3-4a64-b7ee-21200ecdc1cc-kube-api-access-sgsgt\") pod \"node-resolver-tqjlv\" (UID: \"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc\") " pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.111933 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.111912 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:09:41.112037 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.111936 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:09:41.112037 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.111950 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:41.112140 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.112048 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:09:41.612026142 +0000 UTC m=+3.009975430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:41.113291 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.113261 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc2kb\" (UniqueName: \"kubernetes.io/projected/a550aec1-3389-4e89-b02f-1c8eb07f3980-kube-api-access-nc2kb\") pod \"node-ca-g9pwg\" (UID: \"a550aec1-3389-4e89-b02f-1c8eb07f3980\") " pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.113662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.113642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt44g\" (UniqueName: \"kubernetes.io/projected/1cc6b9f4-8934-4b44-9032-abd9564d1592-kube-api-access-bt44g\") pod \"aws-ebs-csi-driver-node-ctzhc\" (UID: \"1cc6b9f4-8934-4b44-9032-abd9564d1592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.188649 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94gzf\" (UniqueName: \"kubernetes.io/projected/022f496c-5a6a-4740-82bf-ac92da9ac68b-kube-api-access-94gzf\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:41.188649 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-kubelet\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-host-slash\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-cni-bin\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188765 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-cni-bin\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188762 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-kubelet\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-host-slash\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-cni-netd\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.188835 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovnkube-script-lib\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.188881 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-iptables-alerter-script\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-cni-netd\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.188905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.188988 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:09:41.688967762 +0000 UTC m=+3.086917036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pthwp\" (UniqueName: \"kubernetes.io/projected/b0e723d1-06db-4e84-8fd8-50e671409c4d-kube-api-access-pthwp\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovn-node-metrics-cert\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189182 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-var-lib-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8baef419-3fad-4acd-a31a-6c22f04b8b7a-kubelet-config\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8baef419-3fad-4acd-a31a-6c22f04b8b7a-dbus\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189308 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-var-lib-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189317 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-slash\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.189363 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8baef419-3fad-4acd-a31a-6c22f04b8b7a-kubelet-config\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189379 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovnkube-config\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189387 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8baef419-3fad-4acd-a31a-6c22f04b8b7a-dbus\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-cnibin\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189424 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-slash\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-systemd-units\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-run-netns\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-node-log\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189555 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-cnibin\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-system-cni-dir\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01ccc839-5232-4795-a8c8-3fa013abedf0-system-cni-dir\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-run-netns\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-node-log\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf898da0-c482-407f-8b09-20d34e9578f9-konnectivity-ca\") pod \"konnectivity-agent-qrxvm\" (UID: \"cf898da0-c482-407f-8b09-20d34e9578f9\") " pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-run-ovn-kubernetes\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189682 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-systemd-units\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189690 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-iptables-alerter-script\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf898da0-c482-407f-8b09-20d34e9578f9-agent-certs\") pod \"konnectivity-agent-qrxvm\" (UID: \"cf898da0-c482-407f-8b09-20d34e9578f9\") " pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189718 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-host-run-ovn-kubernetes\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovnkube-script-lib\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-log-socket\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-etc-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9h85\" (UniqueName: \"kubernetes.io/projected/01ccc839-5232-4795-a8c8-3fa013abedf0-kube-api-access-z9h85\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189948 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovnkube-config\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-systemd\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.189985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-ovn\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-env-overrides\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glsj7\" (UniqueName: \"kubernetes.io/projected/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-kube-api-access-glsj7\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190286 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190299 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190345 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-log-socket\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.190973 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.190384 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190390 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-etc-openvswitch\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-ovn\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190429 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e723d1-06db-4e84-8fd8-50e671409c4d-run-systemd\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.190454 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:09:41.69043597 +0000 UTC m=+3.088385271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cf898da0-c482-407f-8b09-20d34e9578f9-konnectivity-ca\") pod \"konnectivity-agent-qrxvm\" (UID: \"cf898da0-c482-407f-8b09-20d34e9578f9\") " pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190889 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b0e723d1-06db-4e84-8fd8-50e671409c4d-env-overrides\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.191696 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.190909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01ccc839-5232-4795-a8c8-3fa013abedf0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.192040 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.192004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0e723d1-06db-4e84-8fd8-50e671409c4d-ovn-node-metrics-cert\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.192400 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.192378 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cf898da0-c482-407f-8b09-20d34e9578f9-agent-certs\") pod \"konnectivity-agent-qrxvm\" (UID: \"cf898da0-c482-407f-8b09-20d34e9578f9\") " pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.201164 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.201083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94gzf\" (UniqueName: \"kubernetes.io/projected/022f496c-5a6a-4740-82bf-ac92da9ac68b-kube-api-access-94gzf\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:41.201575 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.201553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9h85\" (UniqueName: \"kubernetes.io/projected/01ccc839-5232-4795-a8c8-3fa013abedf0-kube-api-access-z9h85\") pod \"multus-additional-cni-plugins-zpnjl\" (UID: \"01ccc839-5232-4795-a8c8-3fa013abedf0\") " pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.201705 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.201644 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glsj7\" (UniqueName: \"kubernetes.io/projected/fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54-kube-api-access-glsj7\") pod \"iptables-alerter-697tt\" (UID: \"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54\") " pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.202291 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.202271 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pthwp\" (UniqueName: \"kubernetes.io/projected/b0e723d1-06db-4e84-8fd8-50e671409c4d-kube-api-access-pthwp\") pod \"ovnkube-node-77fzv\" (UID: \"b0e723d1-06db-4e84-8fd8-50e671409c4d\") " pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.281717 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.281659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lthzv" Sep 08 08:09:41.303815 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.303778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" Sep 08 08:09:41.331373 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.331320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-976wb" Sep 08 08:09:41.347821 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.347762 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tqjlv" Sep 08 08:09:41.354508 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.354474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g9pwg" Sep 08 08:09:41.373172 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.373139 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:09:41.379546 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.379515 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:09:41.386607 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.386574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-697tt" Sep 08 08:09:41.404397 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.404362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" Sep 08 08:09:41.430723 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.430686 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:09:41.695830 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.695638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:41.695830 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.695744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:41.695830 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.695791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:41.695830 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695812 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695891 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695901 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:09:42.695877492 +0000 UTC m=+4.093826766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695916 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695939 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695956 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.695940 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:09:42.695926006 +0000 UTC m=+4.093875295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:41.696124 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:41.696009 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:09:42.69599655 +0000 UTC m=+4.093945824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:41.875509 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.875456 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc6b9f4_8934_4b44_9032_abd9564d1592.slice/crio-35682db6020739c4987643b49185bfa56ebfcedee8bb7add727cd0419238a82f WatchSource:0}: Error finding container 35682db6020739c4987643b49185bfa56ebfcedee8bb7add727cd0419238a82f: Status 404 returned error can't find the container with id 35682db6020739c4987643b49185bfa56ebfcedee8bb7add727cd0419238a82f Sep 08 08:09:41.875778 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.875748 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfe6cd4_fcd2_4e2b_9ea3_e295e07b3e54.slice/crio-240e9d898e897523407233d1ddfb52ce1bb8d30cea1ee9206ebf80ebcf39917a WatchSource:0}: Error finding container 240e9d898e897523407233d1ddfb52ce1bb8d30cea1ee9206ebf80ebcf39917a: Status 404 returned error can't find the container with id 240e9d898e897523407233d1ddfb52ce1bb8d30cea1ee9206ebf80ebcf39917a Sep 08 08:09:41.880993 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.880964 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e723d1_06db_4e84_8fd8_50e671409c4d.slice/crio-306631aa6310014b3104284b70be808ac4d3331a42bad01404c1f10ce6d9c150 WatchSource:0}: Error finding container 306631aa6310014b3104284b70be808ac4d3331a42bad01404c1f10ce6d9c150: Status 404 returned error can't find the container with id 306631aa6310014b3104284b70be808ac4d3331a42bad01404c1f10ce6d9c150 Sep 08 08:09:41.882375 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:41.882349 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:09:41.882574 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.882544 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f31a0e_8ddd_48cf_acb2_5c3a0929c874.slice/crio-812dea19725ae482920c012ee6db29c902fb3b7c0a1cfb5647ea35f049fc58ac WatchSource:0}: Error finding container 812dea19725ae482920c012ee6db29c902fb3b7c0a1cfb5647ea35f049fc58ac: Status 404 returned error can't find the container with id 812dea19725ae482920c012ee6db29c902fb3b7c0a1cfb5647ea35f049fc58ac Sep 08 08:09:41.893872 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.893839 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf898da0_c482_407f_8b09_20d34e9578f9.slice/crio-6d1785a00ac63673f1c77e16423473e5e80be5fe537f3960530d371e50186a36 WatchSource:0}: Error finding container 6d1785a00ac63673f1c77e16423473e5e80be5fe537f3960530d371e50186a36: Status 404 returned error can't find the container with id 6d1785a00ac63673f1c77e16423473e5e80be5fe537f3960530d371e50186a36 Sep 08 08:09:41.906300 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.906273 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ce4b78_639d_488e_abe0_f64f444873c3.slice/crio-65869b18f92f897a95f9cfa34ad3888a401b1e422dc0a61615a5f586ac5255c0 WatchSource:0}: Error finding container 65869b18f92f897a95f9cfa34ad3888a401b1e422dc0a61615a5f586ac5255c0: Status 404 returned error can't find the container with id 65869b18f92f897a95f9cfa34ad3888a401b1e422dc0a61615a5f586ac5255c0 Sep 08 08:09:41.935701 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:41.935665 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda550aec1_3389_4e89_b02f_1c8eb07f3980.slice/crio-a618abc22cd74ca405f6f5dd8a62684c9dd75878e932e0af3e2422841a4bfbd8 WatchSource:0}: Error finding container a618abc22cd74ca405f6f5dd8a62684c9dd75878e932e0af3e2422841a4bfbd8: Status 404 returned error can't find the container with id a618abc22cd74ca405f6f5dd8a62684c9dd75878e932e0af3e2422841a4bfbd8 Sep 08 08:09:42.007772 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.007645 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 08:04:41 +0000 UTC" deadline="2028-06-06 06:32:30.218855414 +0000 UTC" Sep 08 08:09:42.007772 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.007706 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15286h22m48.211152145s" Sep 08 08:09:42.079468 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.079413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:42.079621 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.079554 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:42.085276 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.085222 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-976wb" event={"ID":"42f31a0e-8ddd-48cf-acb2-5c3a0929c874","Type":"ContainerStarted","Data":"812dea19725ae482920c012ee6db29c902fb3b7c0a1cfb5647ea35f049fc58ac"} Sep 08 08:09:42.086684 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.086644 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"306631aa6310014b3104284b70be808ac4d3331a42bad01404c1f10ce6d9c150"} Sep 08 08:09:42.087846 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.087817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-697tt" event={"ID":"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54","Type":"ContainerStarted","Data":"240e9d898e897523407233d1ddfb52ce1bb8d30cea1ee9206ebf80ebcf39917a"} Sep 08 08:09:42.089020 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.088996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" event={"ID":"1cc6b9f4-8934-4b44-9032-abd9564d1592","Type":"ContainerStarted","Data":"35682db6020739c4987643b49185bfa56ebfcedee8bb7add727cd0419238a82f"} Sep 08 08:09:42.090213 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.090186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g9pwg" event={"ID":"a550aec1-3389-4e89-b02f-1c8eb07f3980","Type":"ContainerStarted","Data":"a618abc22cd74ca405f6f5dd8a62684c9dd75878e932e0af3e2422841a4bfbd8"} Sep 08 08:09:42.091379 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.091341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lthzv" event={"ID":"c8ce4b78-639d-488e-abe0-f64f444873c3","Type":"ContainerStarted","Data":"65869b18f92f897a95f9cfa34ad3888a401b1e422dc0a61615a5f586ac5255c0"} Sep 08 08:09:42.092409 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.092384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qrxvm" event={"ID":"cf898da0-c482-407f-8b09-20d34e9578f9","Type":"ContainerStarted","Data":"6d1785a00ac63673f1c77e16423473e5e80be5fe537f3960530d371e50186a36"} Sep 08 08:09:42.703014 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.702971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:42.703212 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.703040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:42.703212 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:42.703091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:42.703355 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703246 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:42.703355 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703311 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:09:44.703291983 +0000 UTC m=+6.101241263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:42.703787 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703765 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:42.703869 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703829 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:09:44.703812026 +0000 UTC m=+6.101761302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:42.703942 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703911 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:09:42.703942 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703932 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:09:42.704038 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703946 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:42.704038 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:42.703985 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:09:44.70397342 +0000 UTC m=+6.101922695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:43.008690 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:43.008573 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 08:04:41 +0000 UTC" deadline="2028-04-26 19:52:09.620934456 +0000 UTC" Sep 08 08:09:43.008690 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:43.008624 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14315h42m26.612315863s" Sep 08 08:09:43.081464 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:43.081398 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:43.081658 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:43.081564 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:43.082050 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:43.082028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:43.082169 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:43.082144 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:44.078916 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:44.078874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:44.079681 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.079180 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:44.103798 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:44.103707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" event={"ID":"a3eec83538a6b5de42befc4a32d7da43","Type":"ContainerStarted","Data":"f408601539e5e41d0c238ec748dc2fdc1a5617ab46a837092f232efa4890ddb3"} Sep 08 08:09:44.721665 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:44.721608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:44.721879 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:44.721690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:44.721879 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:44.721761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:44.721997 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.721929 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:44.722184 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722066 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:09:48.721980809 +0000 UTC m=+10.119930211 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:44.722286 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722273 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:44.722350 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722331 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:09:48.722314389 +0000 UTC m=+10.120263673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:44.722508 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722486 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:09:44.722568 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722516 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:09:44.722568 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722532 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:44.722688 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:44.722591 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:09:48.722574331 +0000 UTC m=+10.120523606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:45.083360 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:45.083242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:45.083360 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:45.083265 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:45.083931 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:45.083373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:45.083931 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:45.083497 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:46.078857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:46.078775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:46.079083 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:46.078927 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:47.078738 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:47.078650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:47.079243 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:47.078818 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:47.079243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:47.079218 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:47.079398 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:47.079364 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:48.078960 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:48.078876 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:48.079531 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.079019 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:48.758814 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:48.758764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:48.759009 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:48.758861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:48.759009 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:48.758895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:48.759125 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759051 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:09:48.759125 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759075 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:09:48.759125 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759089 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:48.759264 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759152 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:09:56.759132935 +0000 UTC m=+18.157082228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:48.759264 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759207 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:48.759380 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759273 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:09:56.759255557 +0000 UTC m=+18.157204845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:48.759380 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759251 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:48.759380 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:48.759339 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:09:56.759322663 +0000 UTC m=+18.157271939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:49.080951 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:49.080221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:49.080951 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:49.080348 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:49.080951 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:49.080738 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:49.080951 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:49.080847 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:50.079242 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:50.079201 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:50.079461 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:50.079337 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:51.079422 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:51.079370 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:51.079878 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:51.079531 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:51.079878 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:51.079370 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:51.079878 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:51.079699 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:52.078857 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:52.078823 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:52.079045 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:52.078965 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:53.078784 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:53.078741 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:53.079225 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:53.078746 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:53.079225 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:53.078885 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:53.079225 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:53.078970 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:54.079134 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:54.079090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:54.079596 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:54.079216 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:55.079132 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:55.079101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:55.079539 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:55.079108 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:55.079539 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:55.079222 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:55.079539 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:55.079290 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:56.078900 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:56.078862 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:56.079082 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.078978 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:56.818737 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:56.818698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:56.818753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:56.818797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818863 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818912 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818944 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:10:12.818925781 +0000 UTC m=+34.216875055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818944 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818965 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:10:12.818954747 +0000 UTC m=+34.216904025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818972 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.818986 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:56.819208 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:56.819040 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:10:12.819023574 +0000 UTC m=+34.216972858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:09:57.082516 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:57.082429 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:57.082516 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:57.082466 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:57.082713 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:57.082555 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:57.082713 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:57.082697 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:58.079295 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:58.079252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:09:58.079822 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:58.079391 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:09:59.040637 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:59.040593 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ccc839_5232_4795_a8c8_3fa013abedf0.slice/crio-4158f13fbbd0a029ba346478131d7e825fc8f602bf0ead3d4c10ff9769ff9ac9 WatchSource:0}: Error finding container 4158f13fbbd0a029ba346478131d7e825fc8f602bf0ead3d4c10ff9769ff9ac9: Status 404 returned error can't find the container with id 4158f13fbbd0a029ba346478131d7e825fc8f602bf0ead3d4c10ff9769ff9ac9 Sep 08 08:09:59.041464 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:59.041439 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod115a5fcc_cda3_4a64_b7ee_21200ecdc1cc.slice/crio-c0c7e0351bda3bd9e6e7215eb3ce6fa56ad4b5c6a160d1d6d67b02b6096efad2 WatchSource:0}: Error finding container c0c7e0351bda3bd9e6e7215eb3ce6fa56ad4b5c6a160d1d6d67b02b6096efad2: Status 404 returned error can't find the container with id c0c7e0351bda3bd9e6e7215eb3ce6fa56ad4b5c6a160d1d6d67b02b6096efad2 Sep 08 08:09:59.053530 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:09:59.053481 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639100c0bcc92b941a8949df16e60bc8.slice/crio-b64573b2d7b4d1f8c3f17f0e77e1c88ccbe16b40ac10d1bf5d263d2f94f06906 WatchSource:0}: Error finding container b64573b2d7b4d1f8c3f17f0e77e1c88ccbe16b40ac10d1bf5d263d2f94f06906: Status 404 returned error can't find the container with id b64573b2d7b4d1f8c3f17f0e77e1c88ccbe16b40ac10d1bf5d263d2f94f06906 Sep 08 08:09:59.079824 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:59.079507 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:09:59.080305 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:59.079848 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:09:59.080305 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:59.079673 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:09:59.080305 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:09:59.079947 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:09:59.135735 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:59.135699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" event={"ID":"639100c0bcc92b941a8949df16e60bc8","Type":"ContainerStarted","Data":"b64573b2d7b4d1f8c3f17f0e77e1c88ccbe16b40ac10d1bf5d263d2f94f06906"} Sep 08 08:09:59.136772 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:59.136743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerStarted","Data":"4158f13fbbd0a029ba346478131d7e825fc8f602bf0ead3d4c10ff9769ff9ac9"} Sep 08 08:09:59.137718 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:09:59.137697 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tqjlv" event={"ID":"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc","Type":"ContainerStarted","Data":"c0c7e0351bda3bd9e6e7215eb3ce6fa56ad4b5c6a160d1d6d67b02b6096efad2"} Sep 08 08:10:00.079280 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.079029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:00.079465 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:00.079333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:00.142180 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.142140 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qrxvm" event={"ID":"cf898da0-c482-407f-8b09-20d34e9578f9","Type":"ContainerStarted","Data":"a16e3d9e81a0f5d7472a6034528dbb6e6b238346fca454994fe588110a3e6307"} Sep 08 08:10:00.144328 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.144283 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" event={"ID":"1cc6b9f4-8934-4b44-9032-abd9564d1592","Type":"ContainerStarted","Data":"ec89abbfbfc6b8ea254dc37b35239f12bf81c24fd891591499bef345247ed89b"} Sep 08 08:10:00.146438 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.146378 2580 generic.go:356] "Generic (PLEG): container finished" podID="a3eec83538a6b5de42befc4a32d7da43" containerID="2c63369ab2b531ae45e4f0f7e409424aece6f2017bb72ce8e9c754d0fa821d17" exitCode=0 Sep 08 08:10:00.146577 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.146553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" event={"ID":"a3eec83538a6b5de42befc4a32d7da43","Type":"ContainerDied","Data":"2c63369ab2b531ae45e4f0f7e409424aece6f2017bb72ce8e9c754d0fa821d17"} Sep 08 08:10:00.148779 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.148749 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-976wb" event={"ID":"42f31a0e-8ddd-48cf-acb2-5c3a0929c874","Type":"ContainerStarted","Data":"637fe3e66a9bed9ef5686cb9fd5c5d3f51d0ec540f36bd271866e2a398061279"} Sep 08 08:10:00.152977 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.152940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"c1a9759e3e4abbc7cd43425bdcb729dea81600f21aa4f4d56a1949a38ca6b097"} Sep 08 08:10:00.153117 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.153039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"76679c7388b78d4104d27fe487899e24b50f8999d708230c6b9de8b6f6fa14aa"} Sep 08 08:10:00.153117 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.153095 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"592350b7b7ae645f6ce17af9058906bae41068e31bb017fcdd39d0ed9e3cbe98"} Sep 08 08:10:00.153257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.153141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"d1679bd8092849abac4280a2af60bd76230093c8903936420a3e3d3cdaffdbb5"} Sep 08 08:10:00.153257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.153185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"0a395b6ecfd9c23e2e8ec3c46f76fd73a06caf33fe8d3c4b2e457cae2f4aa6ae"} Sep 08 08:10:00.153257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.153232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"b78c66bf5954a41a5345cd87bb095b685d5269c832012b17feba24a212612091"} Sep 08 08:10:00.154970 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.154912 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tqjlv" event={"ID":"115a5fcc-cda3-4a64-b7ee-21200ecdc1cc","Type":"ContainerStarted","Data":"00603f6b2d70927bf6f70168d4c479a00f51769b1f0b5072a46fa06fcd60bf83"} Sep 08 08:10:00.156717 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.156690 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g9pwg" event={"ID":"a550aec1-3389-4e89-b02f-1c8eb07f3980","Type":"ContainerStarted","Data":"c8f5288474733b428b687bbcf5e08322e90857494fb5d82d0ee28e63c9538863"} Sep 08 08:10:00.158588 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.158554 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lthzv" event={"ID":"c8ce4b78-639d-488e-abe0-f64f444873c3","Type":"ContainerStarted","Data":"46f87216a6a72b079eacfb6c9e0787874cef868a50b4e8bcd37511c7e2dfba87"} Sep 08 08:10:00.159999 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.159940 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qrxvm" podStartSLOduration=8.164085764 podStartE2EDuration="21.159919941s" totalImagesPullingTime="12.995834177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:00.15908349 +0000 UTC m=+21.557032784" watchObservedRunningTime="2026-09-08 08:10:00.159919941 +0000 UTC m=+21.557869263" Sep 08 08:10:00.191135 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.191062 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lthzv" podStartSLOduration=3.87476616 podStartE2EDuration="21.191042933s" totalImagesPullingTime="17.316276773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:00.190940417 +0000 UTC m=+21.588889713" watchObservedRunningTime="2026-09-08 08:10:00.191042933 +0000 UTC m=+21.588992228" Sep 08 08:10:00.207666 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.207601 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-976wb" podStartSLOduration=4.066237458 podStartE2EDuration="21.207583306s" totalImagesPullingTime="17.141345848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:00.207014049 +0000 UTC m=+21.604963348" watchObservedRunningTime="2026-09-08 08:10:00.207583306 +0000 UTC m=+21.605532601" Sep 08 08:10:00.223521 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.221465 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tqjlv" podStartSLOduration=21.221446108 podStartE2EDuration="21.221446108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:00.220964954 +0000 UTC m=+21.618914248" watchObservedRunningTime="2026-09-08 08:10:00.221446108 +0000 UTC m=+21.619395403" Sep 08 08:10:00.236629 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:00.236560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g9pwg" podStartSLOduration=4.206024023 podStartE2EDuration="21.236539394s" totalImagesPullingTime="17.030515371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:00.235759342 +0000 UTC m=+21.633708636" watchObservedRunningTime="2026-09-08 08:10:00.236539394 +0000 UTC m=+21.634488687" Sep 08 08:10:01.079497 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:01.079395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:01.079667 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:01.079420 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:01.079667 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:01.079538 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:01.079667 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:01.079628 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:01.163056 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:01.163016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-697tt" event={"ID":"fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54","Type":"ContainerStarted","Data":"0a9b537b8fb5b2ef1f8f6b3d0d7bbe689648a0451a51ac934902abb3fbf1b57e"} Sep 08 08:10:01.181195 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:01.181146 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-697tt" podStartSLOduration=5.065060494 podStartE2EDuration="22.181130064s" totalImagesPullingTime="17.11606957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:01.180817448 +0000 UTC m=+22.578766741" watchObservedRunningTime="2026-09-08 08:10:01.181130064 +0000 UTC m=+22.579079363" Sep 08 08:10:01.775058 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:01.774888 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 08:10:02.048482 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.048376 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T08:10:01.775055863Z","UUID":"96f7f139-6c87-46ad-bc11-f6239a1c90ea","Handler":null,"Name":"","Endpoint":""} Sep 08 08:10:02.050038 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.050012 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 08:10:02.050137 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.050044 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 08:10:02.078762 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.078717 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:02.078917 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:02.078828 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:02.166715 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.166679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" event={"ID":"1cc6b9f4-8934-4b44-9032-abd9564d1592","Type":"ContainerStarted","Data":"70c085a16226c2b659c963cbb414cb46bcfe66daadd1a63d665fe773f6a373f0"} Sep 08 08:10:02.168581 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.168553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" event={"ID":"a3eec83538a6b5de42befc4a32d7da43","Type":"ContainerStarted","Data":"2c77fa00ebeb43b3a27540455c7c55f951584a2a60cd0f381b0eff2dc1a9fea5"} Sep 08 08:10:02.169930 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.169897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" event={"ID":"639100c0bcc92b941a8949df16e60bc8","Type":"ContainerStarted","Data":"1f674cf56302ee8a8a45ed48f3ec513077413bfab24dc710e7e76774b1e273e1"} Sep 08 08:10:02.171361 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.171339 2580 generic.go:356] "Generic (PLEG): container finished" podID="01ccc839-5232-4795-a8c8-3fa013abedf0" containerID="65ccfee47b82d8b1906f76d95a9a75c3dfd35f7fd530831f0922eb040e753f89" exitCode=0 Sep 08 08:10:02.171473 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.171430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerDied","Data":"65ccfee47b82d8b1906f76d95a9a75c3dfd35f7fd530831f0922eb040e753f89"} Sep 08 08:10:02.179522 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.177936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"305466e65aa1633aa162441218085bacc08eeb090dcfced2eccc2f60e479710d"} Sep 08 08:10:02.229834 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.229714 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-42.ec2.internal" podStartSLOduration=21.229696225 podStartE2EDuration="21.229696225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:02.184024148 +0000 UTC m=+23.581973442" watchObservedRunningTime="2026-09-08 08:10:02.229696225 +0000 UTC m=+23.627645518" Sep 08 08:10:02.259670 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:02.259621 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-42.ec2.internal" podStartSLOduration=21.259602494 podStartE2EDuration="21.259602494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:02.25923294 +0000 UTC m=+23.657182235" watchObservedRunningTime="2026-09-08 08:10:02.259602494 +0000 UTC m=+23.657551787" Sep 08 08:10:03.078760 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:03.078721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:03.078984 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:03.078721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:03.078984 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:03.078865 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:03.078984 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:03.078943 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:03.182476 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:03.182316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" event={"ID":"1cc6b9f4-8934-4b44-9032-abd9564d1592","Type":"ContainerStarted","Data":"d2d544f5175d87d2ce9e943de7a393491632b42ae94d06b2e4ba1222aafb932a"} Sep 08 08:10:03.204289 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:03.204223 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctzhc" podStartSLOduration=4.216850179 podStartE2EDuration="24.204200643s" totalImagesPullingTime="19.987350464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:03.203782336 +0000 UTC m=+24.601731630" watchObservedRunningTime="2026-09-08 08:10:03.204200643 +0000 UTC m=+24.602149939" Sep 08 08:10:04.078357 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:04.078328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:04.078525 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:04.078469 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:04.190380 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:04.190061 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" event={"ID":"b0e723d1-06db-4e84-8fd8-50e671409c4d","Type":"ContainerStarted","Data":"3b0bf69e9984ecbe24a384e41467f21d8d84b35826879d82dcb8e8174abfb964"} Sep 08 08:10:04.221467 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:04.221394 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" podStartSLOduration=7.75311937 podStartE2EDuration="25.221373229s" totalImagesPullingTime="17.468253859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:04.219648874 +0000 UTC m=+25.617598168" watchObservedRunningTime="2026-09-08 08:10:04.221373229 +0000 UTC m=+25.619322524" Sep 08 08:10:04.817003 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:04.816962 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:10:04.817617 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:04.817597 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:10:05.079238 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.079153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:05.079429 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.079157 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:05.079429 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:05.079293 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:05.079429 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:05.079369 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:05.192500 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.192468 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 08:10:05.192919 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.192839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:10:05.192919 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.192917 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:10:05.193030 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.192961 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:10:05.193468 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.193449 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qrxvm" Sep 08 08:10:05.208539 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.208511 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:10:05.208713 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.208620 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:10:05.636837 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:05.636806 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:10:06.078828 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.078800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:06.078988 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:06.078907 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:06.249694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.249661 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmj4j"] Sep 08 08:10:06.250417 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.249790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:06.250417 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:06.249931 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:06.253081 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.253047 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dtzg"] Sep 08 08:10:06.253229 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.253187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:06.253340 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:06.253315 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:06.268179 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.268091 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdc7x"] Sep 08 08:10:06.268353 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:06.268212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:06.268353 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:06.268322 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:08.078389 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:08.078348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:08.078922 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:08.078354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:08.078922 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:08.078482 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:08.078922 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:08.078354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:08.078922 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:08.078588 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:08.078922 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:08.078635 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:08.200882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:08.200844 2580 generic.go:356] "Generic (PLEG): container finished" podID="01ccc839-5232-4795-a8c8-3fa013abedf0" containerID="2759e0f1b136ed5594d726c89abf2dfb86c97ee91648cc16600fd109f6d3a87f" exitCode=0 Sep 08 08:10:08.201033 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:08.200934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerDied","Data":"2759e0f1b136ed5594d726c89abf2dfb86c97ee91648cc16600fd109f6d3a87f"} Sep 08 08:10:09.205451 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:09.205239 2580 generic.go:356] "Generic (PLEG): container finished" podID="01ccc839-5232-4795-a8c8-3fa013abedf0" containerID="6ebe7e71d543deb95f91f814b8985338282b106fbdaf98aa69d638094afc2599" exitCode=0 Sep 08 08:10:09.205858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:09.205297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerDied","Data":"6ebe7e71d543deb95f91f814b8985338282b106fbdaf98aa69d638094afc2599"} Sep 08 08:10:10.078641 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:10.078600 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:10.078641 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:10.078646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:10.078879 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:10.078616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:10.078879 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:10.078721 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:10.078879 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:10.078805 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:10.078879 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:10.078855 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:10.210791 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:10.210759 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerStarted","Data":"52db35aa0dc53f7bc987e6c80b4c97246012172e3a8735650cee701364eda8ce"} Sep 08 08:10:11.215909 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:11.215822 2580 generic.go:356] "Generic (PLEG): container finished" podID="01ccc839-5232-4795-a8c8-3fa013abedf0" containerID="52db35aa0dc53f7bc987e6c80b4c97246012172e3a8735650cee701364eda8ce" exitCode=0 Sep 08 08:10:11.215909 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:11.215894 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerDied","Data":"52db35aa0dc53f7bc987e6c80b4c97246012172e3a8735650cee701364eda8ce"} Sep 08 08:10:12.079138 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:12.079103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:12.079331 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:12.079149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:12.079331 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:12.079202 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:12.079331 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.079219 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:12.079331 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.079292 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:12.079542 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.079367 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:12.846480 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:12.846434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:12.846480 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:12.846492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:12.846513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846599 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846610 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846651 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs podName:022f496c-5a6a-4740-82bf-ac92da9ac68b nodeName:}" failed. No retries permitted until 2026-09-08 08:10:44.846632485 +0000 UTC m=+66.244581756 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs") pod "network-metrics-daemon-7dtzg" (UID: "022f496c-5a6a-4740-82bf-ac92da9ac68b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846679 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret podName:8baef419-3fad-4acd-a31a-6c22f04b8b7a nodeName:}" failed. No retries permitted until 2026-09-08 08:10:44.846662314 +0000 UTC m=+66.244611602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret") pod "global-pull-secret-syncer-wdc7x" (UID: "8baef419-3fad-4acd-a31a-6c22f04b8b7a") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846691 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846707 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846717 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j9pgg for pod openshift-network-diagnostics/network-check-target-nmj4j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:10:12.846950 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:12.846755 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg podName:a0928b4e-d49f-473e-9262-4e63dbc666e9 nodeName:}" failed. No retries permitted until 2026-09-08 08:10:44.846744674 +0000 UTC m=+66.244693951 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j9pgg" (UniqueName: "kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg") pod "network-check-target-nmj4j" (UID: "a0928b4e-d49f-473e-9262-4e63dbc666e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:10:14.078835 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:14.078791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:14.078835 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:14.078836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:14.079364 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:14.078900 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:14.079364 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:14.078916 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:14.079364 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:14.079011 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:14.079364 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:14.079085 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:16.079138 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:16.078933 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:16.079607 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:16.078960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:16.079607 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:16.079220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:16.079607 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:16.079311 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:16.079607 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:16.078984 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:16.079607 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:16.079393 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:16.231861 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:16.231766 2580 generic.go:356] "Generic (PLEG): container finished" podID="01ccc839-5232-4795-a8c8-3fa013abedf0" containerID="efb2dfd57f2955e8a1fa3ae0878c54f32eb03eb5b5a4e1b8f6d5c2fbf113f599" exitCode=0 Sep 08 08:10:16.231861 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:16.231828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerDied","Data":"efb2dfd57f2955e8a1fa3ae0878c54f32eb03eb5b5a4e1b8f6d5c2fbf113f599"} Sep 08 08:10:17.237705 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:17.237660 2580 generic.go:356] "Generic (PLEG): container finished" podID="01ccc839-5232-4795-a8c8-3fa013abedf0" containerID="2ce9abb89971e3e2aef463a8274fa3323865cdd4b481650bb3ff8f23b886b3f3" exitCode=0 Sep 08 08:10:17.238198 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:17.237720 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerDied","Data":"2ce9abb89971e3e2aef463a8274fa3323865cdd4b481650bb3ff8f23b886b3f3"} Sep 08 08:10:18.079288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:18.079245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:18.079518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:18.079245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:18.079518 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:18.079355 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:18.079518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:18.079245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:18.079518 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:18.079456 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:18.079518 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:18.079507 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:18.243209 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:18.243177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" event={"ID":"01ccc839-5232-4795-a8c8-3fa013abedf0","Type":"ContainerStarted","Data":"7d84c072ec46ff0bda283bc9bde74a1302b789418fe2e9fe925962a5dc8fe282"} Sep 08 08:10:18.266380 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:18.266325 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zpnjl" podStartSLOduration=25.255309652 podStartE2EDuration="39.266304903s" totalImagesPullingTime="14.010995251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:18.266104621 +0000 UTC m=+39.664053919" watchObservedRunningTime="2026-09-08 08:10:18.266304903 +0000 UTC m=+39.664254197" Sep 08 08:10:20.078420 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:20.078365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:20.078420 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:20.078366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:20.078837 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:20.078489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:20.078837 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:20.078495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:20.078837 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:20.078554 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:20.078837 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:20.078624 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:22.079102 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:22.079063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:22.079564 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:22.079063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:22.079564 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:22.079172 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:22.079564 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:22.079241 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:22.079564 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:22.079063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:22.079564 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:22.079307 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:24.078710 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:24.078670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:24.079105 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:24.078670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:24.079105 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:24.078782 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:24.079105 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:24.078670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:24.079105 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:24.078852 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:24.079105 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:24.078906 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:26.079232 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:26.079195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:26.079678 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:26.079195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:26.079678 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:26.079300 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:26.079678 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:26.079371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:26.079678 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:26.079195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:26.079678 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:26.079454 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:28.079115 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:28.079072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:28.079550 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:28.079090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:28.079550 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:28.079195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:28.079550 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:28.079189 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:28.079550 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:28.079267 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:28.079550 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:28.079326 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:30.079216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:30.079176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:30.079216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:30.079200 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:30.079216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:30.079176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:30.079784 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:30.079316 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:30.079784 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:30.079359 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:30.079784 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:30.079445 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:32.079005 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.078968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:32.079510 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.078970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:32.079510 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.079111 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:32.079510 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:32.079083 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdc7x" podUID="8baef419-3fad-4acd-a31a-6c22f04b8b7a" Sep 08 08:10:32.079510 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:32.079193 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7dtzg" podUID="022f496c-5a6a-4740-82bf-ac92da9ac68b" Sep 08 08:10:32.079510 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:32.079307 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmj4j" podUID="a0928b4e-d49f-473e-9262-4e63dbc666e9" Sep 08 08:10:32.433391 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.433315 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-42.ec2.internal" event="NodeReady" Sep 08 08:10:32.433644 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.433441 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 08:10:32.470694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.470652 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fcfc9b6bb-px2db"] Sep 08 08:10:32.472477 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.472460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.475128 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.475100 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 08:10:32.475128 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.475113 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-22x2q\"" Sep 08 08:10:32.475128 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.475125 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 08:10:32.475358 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.475258 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 08:10:32.479798 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.479775 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 08:10:32.480956 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.480935 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hlmds"] Sep 08 08:10:32.482631 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.482613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.485117 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.485096 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t5svz\"" Sep 08 08:10:32.485427 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.485395 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 08:10:32.485494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.485458 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 08:10:32.485545 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.485509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 08:10:32.486784 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.486766 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6cz5n"] Sep 08 08:10:32.488577 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.488557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.489998 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.489978 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fcfc9b6bb-px2db"] Sep 08 08:10:32.490744 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.490725 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-phzhh\"" Sep 08 08:10:32.491128 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.491107 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 08:10:32.491215 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.491154 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 08:10:32.492751 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.492733 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hlmds"] Sep 08 08:10:32.498745 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.498725 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6cz5n"] Sep 08 08:10:32.579662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-registry-tls\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.579662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-bound-sa-token\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925aa87a-dcad-4d15-9372-c43e1b8c5283-cert\") pod \"ingress-canary-hlmds\" (UID: \"925aa87a-dcad-4d15-9372-c43e1b8c5283\") " pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00993ed9-0142-49c8-9b46-d3936ec0c83f-trusted-ca\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579759 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00993ed9-0142-49c8-9b46-d3936ec0c83f-installation-pull-secrets\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b12048f-9e72-4242-b86e-442560cd0dca-config-volume\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dscl\" (UniqueName: \"kubernetes.io/projected/925aa87a-dcad-4d15-9372-c43e1b8c5283-kube-api-access-2dscl\") pod \"ingress-canary-hlmds\" (UID: \"925aa87a-dcad-4d15-9372-c43e1b8c5283\") " pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b12048f-9e72-4242-b86e-442560cd0dca-metrics-tls\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b12048f-9e72-4242-b86e-442560cd0dca-tmp-dir\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4bkg\" (UniqueName: \"kubernetes.io/projected/3b12048f-9e72-4242-b86e-442560cd0dca-kube-api-access-p4bkg\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.579867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00993ed9-0142-49c8-9b46-d3936ec0c83f-image-registry-private-configuration\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.580185 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579896 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00993ed9-0142-49c8-9b46-d3936ec0c83f-registry-certificates\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.580185 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00993ed9-0142-49c8-9b46-d3936ec0c83f-ca-trust-extracted\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.580185 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.579932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pxf6\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-kube-api-access-9pxf6\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.587146 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.587109 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zwb8g"] Sep 08 08:10:32.591047 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.591021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.594036 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.594012 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 08:10:32.594180 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.594153 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w7frm\"" Sep 08 08:10:32.594180 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.594154 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 08:10:32.594316 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.594301 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 08:10:32.594444 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.594428 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 08:10:32.604718 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.604688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwb8g"] Sep 08 08:10:32.680986 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.680943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00993ed9-0142-49c8-9b46-d3936ec0c83f-trusted-ca\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.680986 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.680983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00993ed9-0142-49c8-9b46-d3936ec0c83f-installation-pull-secrets\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.681243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b12048f-9e72-4242-b86e-442560cd0dca-config-volume\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.681243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dscl\" (UniqueName: \"kubernetes.io/projected/925aa87a-dcad-4d15-9372-c43e1b8c5283-kube-api-access-2dscl\") pod \"ingress-canary-hlmds\" (UID: \"925aa87a-dcad-4d15-9372-c43e1b8c5283\") " pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.681243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b12048f-9e72-4242-b86e-442560cd0dca-metrics-tls\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.681243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681195 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b12048f-9e72-4242-b86e-442560cd0dca-tmp-dir\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.681243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4bkg\" (UniqueName: \"kubernetes.io/projected/3b12048f-9e72-4242-b86e-442560cd0dca-kube-api-access-p4bkg\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00993ed9-0142-49c8-9b46-d3936ec0c83f-image-registry-private-configuration\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a5151e7-c003-4d4c-bc23-1dd737605e57-crio-socket\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj4nr\" (UniqueName: \"kubernetes.io/projected/6a5151e7-c003-4d4c-bc23-1dd737605e57-kube-api-access-nj4nr\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00993ed9-0142-49c8-9b46-d3936ec0c83f-registry-certificates\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a5151e7-c003-4d4c-bc23-1dd737605e57-data-volume\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a5151e7-c003-4d4c-bc23-1dd737605e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.681518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a5151e7-c003-4d4c-bc23-1dd737605e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.681864 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00993ed9-0142-49c8-9b46-d3936ec0c83f-ca-trust-extracted\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.681864 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pxf6\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-kube-api-access-9pxf6\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.681864 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681659 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b12048f-9e72-4242-b86e-442560cd0dca-tmp-dir\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.681864 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681759 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b12048f-9e72-4242-b86e-442560cd0dca-config-volume\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.682051 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00993ed9-0142-49c8-9b46-d3936ec0c83f-ca-trust-extracted\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.682051 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-registry-tls\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.682051 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-bound-sa-token\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.682051 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.681983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925aa87a-dcad-4d15-9372-c43e1b8c5283-cert\") pod \"ingress-canary-hlmds\" (UID: \"925aa87a-dcad-4d15-9372-c43e1b8c5283\") " pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.682268 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.682160 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00993ed9-0142-49c8-9b46-d3936ec0c83f-trusted-ca\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.682268 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.682167 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00993ed9-0142-49c8-9b46-d3936ec0c83f-registry-certificates\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.685639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.685572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b12048f-9e72-4242-b86e-442560cd0dca-metrics-tls\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.685639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.685605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/925aa87a-dcad-4d15-9372-c43e1b8c5283-cert\") pod \"ingress-canary-hlmds\" (UID: \"925aa87a-dcad-4d15-9372-c43e1b8c5283\") " pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.685639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.685575 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00993ed9-0142-49c8-9b46-d3936ec0c83f-image-registry-private-configuration\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.685639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.685621 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00993ed9-0142-49c8-9b46-d3936ec0c83f-installation-pull-secrets\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.685993 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.685677 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-registry-tls\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.689844 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.689810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pxf6\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-kube-api-access-9pxf6\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.689961 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.689866 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4bkg\" (UniqueName: \"kubernetes.io/projected/3b12048f-9e72-4242-b86e-442560cd0dca-kube-api-access-p4bkg\") pod \"dns-default-6cz5n\" (UID: \"3b12048f-9e72-4242-b86e-442560cd0dca\") " pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.692150 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.692125 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00993ed9-0142-49c8-9b46-d3936ec0c83f-bound-sa-token\") pod \"image-registry-5fcfc9b6bb-px2db\" (UID: \"00993ed9-0142-49c8-9b46-d3936ec0c83f\") " pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.692509 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.692489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dscl\" (UniqueName: \"kubernetes.io/projected/925aa87a-dcad-4d15-9372-c43e1b8c5283-kube-api-access-2dscl\") pod \"ingress-canary-hlmds\" (UID: \"925aa87a-dcad-4d15-9372-c43e1b8c5283\") " pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.782037 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.781997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:32.783212 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a5151e7-c003-4d4c-bc23-1dd737605e57-crio-socket\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783332 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj4nr\" (UniqueName: \"kubernetes.io/projected/6a5151e7-c003-4d4c-bc23-1dd737605e57-kube-api-access-nj4nr\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783332 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a5151e7-c003-4d4c-bc23-1dd737605e57-data-volume\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783332 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a5151e7-c003-4d4c-bc23-1dd737605e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783332 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a5151e7-c003-4d4c-bc23-1dd737605e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783545 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a5151e7-c003-4d4c-bc23-1dd737605e57-crio-socket\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783594 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783564 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a5151e7-c003-4d4c-bc23-1dd737605e57-data-volume\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.783896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.783877 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a5151e7-c003-4d4c-bc23-1dd737605e57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.785785 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.785760 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a5151e7-c003-4d4c-bc23-1dd737605e57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.791358 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.791332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hlmds" Sep 08 08:10:32.792215 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.792189 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj4nr\" (UniqueName: \"kubernetes.io/projected/6a5151e7-c003-4d4c-bc23-1dd737605e57-kube-api-access-nj4nr\") pod \"insights-runtime-extractor-zwb8g\" (UID: \"6a5151e7-c003-4d4c-bc23-1dd737605e57\") " pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:32.799127 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.799095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:32.899545 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:32.899512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwb8g" Sep 08 08:10:33.068466 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.068437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hlmds"] Sep 08 08:10:33.071467 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.071441 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fcfc9b6bb-px2db"] Sep 08 08:10:33.072256 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:33.072233 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925aa87a_dcad_4d15_9372_c43e1b8c5283.slice/crio-00ce2d40cb73f5a4ae7406e714a9b397bbee586aedbf041f1b3245a0bdc24cb0 WatchSource:0}: Error finding container 00ce2d40cb73f5a4ae7406e714a9b397bbee586aedbf041f1b3245a0bdc24cb0: Status 404 returned error can't find the container with id 00ce2d40cb73f5a4ae7406e714a9b397bbee586aedbf041f1b3245a0bdc24cb0 Sep 08 08:10:33.075038 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:33.075017 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00993ed9_0142_49c8_9b46_d3936ec0c83f.slice/crio-218d58ff1a625178801c3c61b44297f4c21744cdd84ae024eec8a0387611ef31 WatchSource:0}: Error finding container 218d58ff1a625178801c3c61b44297f4c21744cdd84ae024eec8a0387611ef31: Status 404 returned error can't find the container with id 218d58ff1a625178801c3c61b44297f4c21744cdd84ae024eec8a0387611ef31 Sep 08 08:10:33.093584 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.093556 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6cz5n"] Sep 08 08:10:33.111456 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:33.111422 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b12048f_9e72_4242_b86e_442560cd0dca.slice/crio-fdde74379905bb34c7f26b9f18f8199afb9abc7d4aa00f5aa3d626f8e416164b WatchSource:0}: Error finding container fdde74379905bb34c7f26b9f18f8199afb9abc7d4aa00f5aa3d626f8e416164b: Status 404 returned error can't find the container with id fdde74379905bb34c7f26b9f18f8199afb9abc7d4aa00f5aa3d626f8e416164b Sep 08 08:10:33.180665 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.180632 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwb8g"] Sep 08 08:10:33.184361 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:33.184333 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5151e7_c003_4d4c_bc23_1dd737605e57.slice/crio-aac362cce5a60c88214842279ab069b73bc8f5958af3d9a93263b087596249aa WatchSource:0}: Error finding container aac362cce5a60c88214842279ab069b73bc8f5958af3d9a93263b087596249aa: Status 404 returned error can't find the container with id aac362cce5a60c88214842279ab069b73bc8f5958af3d9a93263b087596249aa Sep 08 08:10:33.279175 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.279136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8g" event={"ID":"6a5151e7-c003-4d4c-bc23-1dd737605e57","Type":"ContainerStarted","Data":"48b7786134932ee56887056319cbb7de7ae44b6fb2329b73741ca0f0bc381545"} Sep 08 08:10:33.279339 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.279209 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8g" event={"ID":"6a5151e7-c003-4d4c-bc23-1dd737605e57","Type":"ContainerStarted","Data":"aac362cce5a60c88214842279ab069b73bc8f5958af3d9a93263b087596249aa"} Sep 08 08:10:33.280309 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.280280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6cz5n" event={"ID":"3b12048f-9e72-4242-b86e-442560cd0dca","Type":"ContainerStarted","Data":"fdde74379905bb34c7f26b9f18f8199afb9abc7d4aa00f5aa3d626f8e416164b"} Sep 08 08:10:33.281431 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.281376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hlmds" event={"ID":"925aa87a-dcad-4d15-9372-c43e1b8c5283","Type":"ContainerStarted","Data":"00ce2d40cb73f5a4ae7406e714a9b397bbee586aedbf041f1b3245a0bdc24cb0"} Sep 08 08:10:33.282920 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.282888 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" event={"ID":"00993ed9-0142-49c8-9b46-d3936ec0c83f","Type":"ContainerStarted","Data":"5f9287a07b21badc821cc5ecb9fb97a1b5226a8f5f3e6e1c2b653a9551d37003"} Sep 08 08:10:33.283003 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.282932 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" event={"ID":"00993ed9-0142-49c8-9b46-d3936ec0c83f","Type":"ContainerStarted","Data":"218d58ff1a625178801c3c61b44297f4c21744cdd84ae024eec8a0387611ef31"} Sep 08 08:10:33.283003 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.282972 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:33.302902 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:33.302855 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" podStartSLOduration=3.302836617 podStartE2EDuration="3.302836617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:33.302001498 +0000 UTC m=+54.699950793" watchObservedRunningTime="2026-09-08 08:10:33.302836617 +0000 UTC m=+54.700785911" Sep 08 08:10:34.078896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.078860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:34.078896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.078888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:34.079147 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.078860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:34.083639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.083483 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 08:10:34.083639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.083506 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 08:10:34.083639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.083483 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 08:10:34.083639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.083539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n4fwr\"" Sep 08 08:10:34.083639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.083489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vr4wt\"" Sep 08 08:10:34.083639 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.083546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 08:10:34.290187 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:34.289366 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8g" event={"ID":"6a5151e7-c003-4d4c-bc23-1dd737605e57","Type":"ContainerStarted","Data":"664b4f0db94bba8d914a9aae53e7733b19f60e1e415ced843805cbb79094232d"} Sep 08 08:10:36.299497 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:36.299456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6cz5n" event={"ID":"3b12048f-9e72-4242-b86e-442560cd0dca","Type":"ContainerStarted","Data":"46d8baabc2bd20d6db5b44de6642cfc1a1d00039fa7b36bb7b84acb72dce9749"} Sep 08 08:10:36.299942 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:36.299525 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6cz5n" event={"ID":"3b12048f-9e72-4242-b86e-442560cd0dca","Type":"ContainerStarted","Data":"e593888653b2d2ab7239c38f8b6d2ee69c583747b93690a62c833435abfcf39c"} Sep 08 08:10:36.299942 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:36.299637 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:36.301423 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:36.301375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hlmds" event={"ID":"925aa87a-dcad-4d15-9372-c43e1b8c5283","Type":"ContainerStarted","Data":"15ac5878a1565b1b886d65234ce37164b8a14fb2b7d3893f5aaf2c20068e3239"} Sep 08 08:10:36.318337 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:36.318278 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6cz5n" podStartSLOduration=1.831287833 podStartE2EDuration="4.318255059s" totalImagesPullingTime="2.486967226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:36.317013158 +0000 UTC m=+57.714962452" watchObservedRunningTime="2026-09-08 08:10:36.318255059 +0000 UTC m=+57.716204350" Sep 08 08:10:36.334169 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:36.334113 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hlmds" podStartSLOduration=1.805046429 podStartE2EDuration="4.334095282s" totalImagesPullingTime="2.529048853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:36.3330451 +0000 UTC m=+57.730994408" watchObservedRunningTime="2026-09-08 08:10:36.334095282 +0000 UTC m=+57.732044576" Sep 08 08:10:37.211387 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:37.211352 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-77fzv" Sep 08 08:10:38.310473 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:38.310439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8g" event={"ID":"6a5151e7-c003-4d4c-bc23-1dd737605e57","Type":"ContainerStarted","Data":"ad657ad614435a82682b2e244e0854eaadf0e87108329275e4d38e4aed665e85"} Sep 08 08:10:38.330294 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:38.330238 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zwb8g" podStartSLOduration=2.3637318880000002 podStartE2EDuration="6.330222678s" totalImagesPullingTime="3.96649079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:10:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:38.329865012 +0000 UTC m=+59.727814306" watchObservedRunningTime="2026-09-08 08:10:38.330222678 +0000 UTC m=+59.728171973" Sep 08 08:10:44.872845 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.872786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:44.872845 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.872843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:44.873325 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.872900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:44.876700 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.876677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 08:10:44.876765 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.876677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 08:10:44.876765 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.876739 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 08:10:44.886304 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.886272 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8baef419-3fad-4acd-a31a-6c22f04b8b7a-original-pull-secret\") pod \"global-pull-secret-syncer-wdc7x\" (UID: \"8baef419-3fad-4acd-a31a-6c22f04b8b7a\") " pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:44.886304 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.886298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/022f496c-5a6a-4740-82bf-ac92da9ac68b-metrics-certs\") pod \"network-metrics-daemon-7dtzg\" (UID: \"022f496c-5a6a-4740-82bf-ac92da9ac68b\") " pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:44.886547 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.886276 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 08:10:44.895044 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.895016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n4fwr\"" Sep 08 08:10:44.896927 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.896904 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pgg\" (UniqueName: \"kubernetes.io/projected/a0928b4e-d49f-473e-9262-4e63dbc666e9-kube-api-access-j9pgg\") pod \"network-check-target-nmj4j\" (UID: \"a0928b4e-d49f-473e-9262-4e63dbc666e9\") " pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:44.903276 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.903245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7dtzg" Sep 08 08:10:44.905730 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.905711 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vr4wt\"" Sep 08 08:10:44.914027 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.913988 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:44.924614 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:44.924579 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdc7x" Sep 08 08:10:45.177515 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:45.177431 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7dtzg"] Sep 08 08:10:45.180721 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:45.180690 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022f496c_5a6a_4740_82bf_ac92da9ac68b.slice/crio-a7cab418baea4392de75d7df5685a630901a7646774ca901b43fca8cee8c0e80 WatchSource:0}: Error finding container a7cab418baea4392de75d7df5685a630901a7646774ca901b43fca8cee8c0e80: Status 404 returned error can't find the container with id a7cab418baea4392de75d7df5685a630901a7646774ca901b43fca8cee8c0e80 Sep 08 08:10:45.195993 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:45.195962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmj4j"] Sep 08 08:10:45.199722 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:45.199692 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0928b4e_d49f_473e_9262_4e63dbc666e9.slice/crio-d4f9635a712370b95dbb3cea0e7e3b4f818fab00e2477924caea1a64163b0c3f WatchSource:0}: Error finding container d4f9635a712370b95dbb3cea0e7e3b4f818fab00e2477924caea1a64163b0c3f: Status 404 returned error can't find the container with id d4f9635a712370b95dbb3cea0e7e3b4f818fab00e2477924caea1a64163b0c3f Sep 08 08:10:45.208994 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:45.208638 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdc7x"] Sep 08 08:10:45.213335 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:45.213308 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baef419_3fad_4acd_a31a_6c22f04b8b7a.slice/crio-cfc3a98134fc93d5980edff30b9bd9a614ec4199e5ec44f3a1374c9aa467f689 WatchSource:0}: Error finding container cfc3a98134fc93d5980edff30b9bd9a614ec4199e5ec44f3a1374c9aa467f689: Status 404 returned error can't find the container with id cfc3a98134fc93d5980edff30b9bd9a614ec4199e5ec44f3a1374c9aa467f689 Sep 08 08:10:45.332378 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:45.332345 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdc7x" event={"ID":"8baef419-3fad-4acd-a31a-6c22f04b8b7a","Type":"ContainerStarted","Data":"cfc3a98134fc93d5980edff30b9bd9a614ec4199e5ec44f3a1374c9aa467f689"} Sep 08 08:10:45.333557 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:45.333528 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmj4j" event={"ID":"a0928b4e-d49f-473e-9262-4e63dbc666e9","Type":"ContainerStarted","Data":"d4f9635a712370b95dbb3cea0e7e3b4f818fab00e2477924caea1a64163b0c3f"} Sep 08 08:10:45.334692 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:45.334668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dtzg" event={"ID":"022f496c-5a6a-4740-82bf-ac92da9ac68b","Type":"ContainerStarted","Data":"a7cab418baea4392de75d7df5685a630901a7646774ca901b43fca8cee8c0e80"} Sep 08 08:10:46.308221 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:46.308172 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6cz5n" Sep 08 08:10:46.343844 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:46.342304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dtzg" event={"ID":"022f496c-5a6a-4740-82bf-ac92da9ac68b","Type":"ContainerStarted","Data":"42199a49e737b51803c9b7c12c84184747b73d0e62016fabe941c2ec297039ce"} Sep 08 08:10:47.349173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:47.349132 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7dtzg" event={"ID":"022f496c-5a6a-4740-82bf-ac92da9ac68b","Type":"ContainerStarted","Data":"2fe4de98c8ccd0a68c718bdbec540dd2305430c9a62bbc3ac1b33137ae86856d"} Sep 08 08:10:47.366528 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:47.366468 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7dtzg" podStartSLOduration=67.434870133 podStartE2EDuration="1m8.36644491s" totalImagesPullingTime="931.574777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:47.365368311 +0000 UTC m=+68.763317606" watchObservedRunningTime="2026-09-08 08:10:47.36644491 +0000 UTC m=+68.764394204" Sep 08 08:10:48.389685 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.389529 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z"] Sep 08 08:10:48.404719 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.404682 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t9qq6"] Sep 08 08:10:48.404962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.404858 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.407808 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.407568 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 08 08:10:48.408274 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.407975 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 08 08:10:48.408274 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.408056 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 08:10:48.408274 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.408090 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 08:10:48.408525 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.408325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lq8vh\"" Sep 08 08:10:48.408525 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.408398 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 08 08:10:48.409512 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.409489 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 08:10:48.422518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.422475 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z"] Sep 08 08:10:48.422709 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.422617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.425369 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.425339 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 08:10:48.425369 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.425366 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 08:10:48.425613 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.425444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ssksm\"" Sep 08 08:10:48.425613 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.425527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 08:10:48.500668 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkv6\" (UniqueName: \"kubernetes.io/projected/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-api-access-rwkv6\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.500856 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.500856 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-sys\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.500856 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljsh8\" (UniqueName: \"kubernetes.io/projected/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-kube-api-access-ljsh8\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.500856 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.500856 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.501115 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.501115 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.501115 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.500981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-root\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.501115 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.501019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-textfile\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.501115 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.501047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-metrics-client-ca\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.501322 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.501114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.501322 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.501160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-wtmp\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.501322 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.501205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.501322 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.501231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-tls\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.601972 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.601929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.601972 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.601985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602017 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-root\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-textfile\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-metrics-client-ca\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:48.602169 2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-wtmp\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602240 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:48.602255 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls podName:0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9 nodeName:}" failed. No retries permitted until 2026-09-08 08:10:49.102231721 +0000 UTC m=+70.500181002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-x7v8z" (UID: "0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9") : secret "kube-state-metrics-tls" not found Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-tls\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkv6\" (UniqueName: \"kubernetes.io/projected/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-api-access-rwkv6\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-wtmp\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602191 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-root\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602450 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-sys\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljsh8\" (UniqueName: \"kubernetes.io/projected/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-kube-api-access-ljsh8\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-sys\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602647 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-textfile\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:48.602730 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 08 08:10:48.602782 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:48.602790 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-tls podName:ca8b6b33-fc2d-431a-8c42-02dc92f046ac nodeName:}" failed. No retries permitted until 2026-09-08 08:10:49.102771255 +0000 UTC m=+70.500720527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-tls") pod "node-exporter-t9qq6" (UID: "ca8b6b33-fc2d-431a-8c42-02dc92f046ac") : secret "node-exporter-tls" not found Sep 08 08:10:48.603494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.603494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.602981 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.603494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.603022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.603494 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.603439 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-metrics-client-ca\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.604813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.604790 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.605254 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.605233 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:48.636661 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.636629 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljsh8\" (UniqueName: \"kubernetes.io/projected/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-kube-api-access-ljsh8\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:48.637671 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:48.637636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkv6\" (UniqueName: \"kubernetes.io/projected/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-api-access-rwkv6\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:49.107597 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:49.107548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:49.107793 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:49.107658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-tls\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:49.107793 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:49.107734 2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 08 08:10:49.107930 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:10:49.107834 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls podName:0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9 nodeName:}" failed. No retries permitted until 2026-09-08 08:10:50.107809879 +0000 UTC m=+71.505759156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-x7v8z" (UID: "0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9") : secret "kube-state-metrics-tls" not found Sep 08 08:10:49.110415 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:49.110384 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8b6b33-fc2d-431a-8c42-02dc92f046ac-node-exporter-tls\") pod \"node-exporter-t9qq6\" (UID: \"ca8b6b33-fc2d-431a-8c42-02dc92f046ac\") " pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:49.335315 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:49.335276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9qq6" Sep 08 08:10:50.115648 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.115614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:50.117984 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.117951 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-x7v8z\" (UID: \"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:50.151773 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:50.151733 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8b6b33_fc2d_431a_8c42_02dc92f046ac.slice/crio-d7212b0659f265cba599ca74e27688db26f944bb31908af83469895b6615fb0f WatchSource:0}: Error finding container d7212b0659f265cba599ca74e27688db26f944bb31908af83469895b6615fb0f: Status 404 returned error can't find the container with id d7212b0659f265cba599ca74e27688db26f944bb31908af83469895b6615fb0f Sep 08 08:10:50.217826 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.217783 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" Sep 08 08:10:50.362323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.362280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9qq6" event={"ID":"ca8b6b33-fc2d-431a-8c42-02dc92f046ac","Type":"ContainerStarted","Data":"d7212b0659f265cba599ca74e27688db26f944bb31908af83469895b6615fb0f"} Sep 08 08:10:50.363956 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.363920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdc7x" event={"ID":"8baef419-3fad-4acd-a31a-6c22f04b8b7a","Type":"ContainerStarted","Data":"51c5c44982841d774327a9b9f6a5c9b5e2275f9538f85ba4223314ca7a8124c3"} Sep 08 08:10:50.365614 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.365586 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmj4j" event={"ID":"a0928b4e-d49f-473e-9262-4e63dbc666e9","Type":"ContainerStarted","Data":"2941c7359786811a7ec949a92ccfc5a003373210cac98bdd9c7c2f55b2e62f19"} Sep 08 08:10:50.365795 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.365647 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:10:50.379327 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.379278 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wdc7x" podStartSLOduration=66.431591674 podStartE2EDuration="1m11.379260123s" totalImagesPullingTime="4.947668449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:50.379226699 +0000 UTC m=+71.777175995" watchObservedRunningTime="2026-09-08 08:10:50.379260123 +0000 UTC m=+71.777209413" Sep 08 08:10:50.394932 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.394864 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nmj4j" podStartSLOduration=66.437833892 podStartE2EDuration="1m11.394847853s" totalImagesPullingTime="4.957013961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:50.394507741 +0000 UTC m=+71.792457038" watchObservedRunningTime="2026-09-08 08:10:50.394847853 +0000 UTC m=+71.792797148" Sep 08 08:10:50.497306 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:50.497270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z"] Sep 08 08:10:50.500621 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:50.500581 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0038bbb9_4cbd_4fec_a3b4_1c0d8312b8c9.slice/crio-10169f394396290c9e64f792376017f42b67b8796169ca8c6e549b2466504353 WatchSource:0}: Error finding container 10169f394396290c9e64f792376017f42b67b8796169ca8c6e549b2466504353: Status 404 returned error can't find the container with id 10169f394396290c9e64f792376017f42b67b8796169ca8c6e549b2466504353 Sep 08 08:10:51.371252 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:51.371209 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" event={"ID":"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9","Type":"ContainerStarted","Data":"10169f394396290c9e64f792376017f42b67b8796169ca8c6e549b2466504353"} Sep 08 08:10:51.373330 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:51.373257 2580 generic.go:356] "Generic (PLEG): container finished" podID="ca8b6b33-fc2d-431a-8c42-02dc92f046ac" containerID="913a48bc509ab7cf367f09f6c7f1f25dc383397ddca9d0e4bf970b53ca1955e7" exitCode=0 Sep 08 08:10:51.373498 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:51.373343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9qq6" event={"ID":"ca8b6b33-fc2d-431a-8c42-02dc92f046ac","Type":"ContainerDied","Data":"913a48bc509ab7cf367f09f6c7f1f25dc383397ddca9d0e4bf970b53ca1955e7"} Sep 08 08:10:52.378850 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.378808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" event={"ID":"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9","Type":"ContainerStarted","Data":"3f21bc277e127944040e6ce7f84d314b7c4257f5528fa3f7a815e4950fdfcaf2"} Sep 08 08:10:52.379365 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.378909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" event={"ID":"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9","Type":"ContainerStarted","Data":"354149966b044f4b748534b95ba20a510edd3257f92464f1a609dc5703462202"} Sep 08 08:10:52.379365 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.378940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" event={"ID":"0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9","Type":"ContainerStarted","Data":"89a7a3b6d364a178db50ebc4bb110848a39111924d32a618fc4097a8f5394283"} Sep 08 08:10:52.381293 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.381260 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9qq6" event={"ID":"ca8b6b33-fc2d-431a-8c42-02dc92f046ac","Type":"ContainerStarted","Data":"83345523888c748267d7aec86c0ffdfa94ef1a4b977cbb87d35cbcd027211d73"} Sep 08 08:10:52.381433 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.381316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9qq6" event={"ID":"ca8b6b33-fc2d-431a-8c42-02dc92f046ac","Type":"ContainerStarted","Data":"3649de37b8bb94ed51d40a1c8f0f466d889f9fa0470eb4b16be9f7d2d0342ca2"} Sep 08 08:10:52.399312 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.399248 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-x7v8z" podStartSLOduration=2.939218138 podStartE2EDuration="4.399225737s" totalImagesPullingTime="1.460007599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:52.399037969 +0000 UTC m=+73.796987262" watchObservedRunningTime="2026-09-08 08:10:52.399225737 +0000 UTC m=+73.797175032" Sep 08 08:10:52.417898 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.417845 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t9qq6" podStartSLOduration=3.381142973 podStartE2EDuration="4.417816616s" totalImagesPullingTime="969.8901ms" totalInitContainerRuntime="66.783543ms" isStatefulPod=true podCreationTimestamp="2026-09-08 08:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:52.416616667 +0000 UTC m=+73.814565962" watchObservedRunningTime="2026-09-08 08:10:52.417816616 +0000 UTC m=+73.815765910" Sep 08 08:10:52.696223 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.696147 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-795d888d4f-ww2bh"] Sep 08 08:10:52.698470 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.698452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.701275 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.701247 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 08:10:52.701443 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.701322 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 08:10:52.701443 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.701366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 08:10:52.702311 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.702295 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 08:10:52.702440 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.702322 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3fffqbabqhtq7\"" Sep 08 08:10:52.702440 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.702393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fmcnn\"" Sep 08 08:10:52.710787 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.710749 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-795d888d4f-ww2bh"] Sep 08 08:10:52.738534 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-client-ca-bundle\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.738720 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-secret-metrics-server-tls\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.738720 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2b3fa0c8-bf76-4041-a785-c0c390e49dae-audit-log\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.738720 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3fa0c8-bf76-4041-a785-c0c390e49dae-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.738720 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-secret-metrics-server-client-certs\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.738720 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2b3fa0c8-bf76-4041-a785-c0c390e49dae-metrics-server-audit-profiles\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.738876 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.738769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69vq\" (UniqueName: \"kubernetes.io/projected/2b3fa0c8-bf76-4041-a785-c0c390e49dae-kube-api-access-l69vq\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840090 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-secret-metrics-server-tls\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840090 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2b3fa0c8-bf76-4041-a785-c0c390e49dae-audit-log\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3fa0c8-bf76-4041-a785-c0c390e49dae-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-secret-metrics-server-client-certs\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2b3fa0c8-bf76-4041-a785-c0c390e49dae-metrics-server-audit-profiles\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69vq\" (UniqueName: \"kubernetes.io/projected/2b3fa0c8-bf76-4041-a785-c0c390e49dae-kube-api-access-l69vq\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-client-ca-bundle\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840724 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2b3fa0c8-bf76-4041-a785-c0c390e49dae-audit-log\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.840954 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.840932 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3fa0c8-bf76-4041-a785-c0c390e49dae-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.841235 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.841216 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2b3fa0c8-bf76-4041-a785-c0c390e49dae-metrics-server-audit-profiles\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.842652 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.842626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-client-ca-bundle\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.843258 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.843226 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-secret-metrics-server-client-certs\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.843346 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.843228 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2b3fa0c8-bf76-4041-a785-c0c390e49dae-secret-metrics-server-tls\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:52.849340 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:52.849315 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69vq\" (UniqueName: \"kubernetes.io/projected/2b3fa0c8-bf76-4041-a785-c0c390e49dae-kube-api-access-l69vq\") pod \"metrics-server-795d888d4f-ww2bh\" (UID: \"2b3fa0c8-bf76-4041-a785-c0c390e49dae\") " pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:53.007755 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.007713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:10:53.280330 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.280240 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-795d888d4f-ww2bh"] Sep 08 08:10:53.284093 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:53.284060 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3fa0c8_bf76_4041_a785_c0c390e49dae.slice/crio-3e40bf9d58f78a260f12f2d55de42e7d0cf45d7c2672ce38d7afc1f62101d1d2 WatchSource:0}: Error finding container 3e40bf9d58f78a260f12f2d55de42e7d0cf45d7c2672ce38d7afc1f62101d1d2: Status 404 returned error can't find the container with id 3e40bf9d58f78a260f12f2d55de42e7d0cf45d7c2672ce38d7afc1f62101d1d2 Sep 08 08:10:53.386965 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.386926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" event={"ID":"2b3fa0c8-bf76-4041-a785-c0c390e49dae","Type":"ContainerStarted","Data":"3e40bf9d58f78a260f12f2d55de42e7d0cf45d7c2672ce38d7afc1f62101d1d2"} Sep 08 08:10:53.606713 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.606628 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6"] Sep 08 08:10:53.609752 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.609728 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.612521 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.612493 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 08 08:10:53.612521 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.612518 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 08 08:10:53.612709 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.612495 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 08 08:10:53.613022 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.613002 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 08 08:10:53.613131 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.613013 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kbj8l\"" Sep 08 08:10:53.613186 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.613141 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 08 08:10:53.622420 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.622330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 08 08:10:53.624763 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.624735 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6"] Sep 08 08:10:53.645917 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.645874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.645917 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.645927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-secret-telemeter-client\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.646190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.645947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-federate-client-tls\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.646190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.645995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.646190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.646029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-serving-certs-ca-bundle\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.646190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.646085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-metrics-client-ca\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.646190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.646131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-telemeter-client-tls\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.646190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.646161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gsfn\" (UniqueName: \"kubernetes.io/projected/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-kube-api-access-5gsfn\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gsfn\" (UniqueName: \"kubernetes.io/projected/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-kube-api-access-5gsfn\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747459 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747459 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-secret-telemeter-client\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747459 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-federate-client-tls\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747459 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747459 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-serving-certs-ca-bundle\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747742 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-metrics-client-ca\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.747742 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.747666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-telemeter-client-tls\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.748241 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.748214 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-serving-certs-ca-bundle\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.748396 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.748363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.748543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.748504 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-metrics-client-ca\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.750093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.750063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-telemeter-client-tls\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.750201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.750098 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-federate-client-tls\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.750201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.750144 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-secret-telemeter-client\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.750274 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.750238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.756502 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.756475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gsfn\" (UniqueName: \"kubernetes.io/projected/d4ff19e3-6cf7-453a-9ccb-9254c5c50879-kube-api-access-5gsfn\") pod \"telemeter-client-5d8f6546c4-mt4p6\" (UID: \"d4ff19e3-6cf7-453a-9ccb-9254c5c50879\") " pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:53.923906 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:53.923809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" Sep 08 08:10:54.211916 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:54.211833 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6"] Sep 08 08:10:54.214970 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:10:54.214937 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ff19e3_6cf7_453a_9ccb_9254c5c50879.slice/crio-0dcb67898adb14ba14a3778b3d054a5e7871ee82e358bd7431bcaea4cdc4e704 WatchSource:0}: Error finding container 0dcb67898adb14ba14a3778b3d054a5e7871ee82e358bd7431bcaea4cdc4e704: Status 404 returned error can't find the container with id 0dcb67898adb14ba14a3778b3d054a5e7871ee82e358bd7431bcaea4cdc4e704 Sep 08 08:10:54.294334 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:54.294309 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fcfc9b6bb-px2db" Sep 08 08:10:54.392082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:54.392043 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" event={"ID":"d4ff19e3-6cf7-453a-9ccb-9254c5c50879","Type":"ContainerStarted","Data":"0dcb67898adb14ba14a3778b3d054a5e7871ee82e358bd7431bcaea4cdc4e704"} Sep 08 08:10:57.404960 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:57.404903 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" event={"ID":"2b3fa0c8-bf76-4041-a785-c0c390e49dae","Type":"ContainerStarted","Data":"502f4cbf5665709c721ac9fda3f454b10b5414e532014cbb11edb5a2109b596d"} Sep 08 08:10:57.406487 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:57.406461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" event={"ID":"d4ff19e3-6cf7-453a-9ccb-9254c5c50879","Type":"ContainerStarted","Data":"deb5fdc99aeaa0a765e888e0ec1ca793a387a806b0178f298fd95c03578c8893"} Sep 08 08:10:57.422633 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:10:57.422577 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" podStartSLOduration=2.33873555 podStartE2EDuration="5.422560686s" totalImagesPullingTime="3.083825136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:10:57.422149285 +0000 UTC m=+78.820098579" watchObservedRunningTime="2026-09-08 08:10:57.422560686 +0000 UTC m=+78.820509980" Sep 08 08:11:00.419428 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:00.419373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" event={"ID":"d4ff19e3-6cf7-453a-9ccb-9254c5c50879","Type":"ContainerStarted","Data":"48e69f00d0a58b3814e39280bb51324c5f099267bd8aac5b4c0c951090ce4f84"} Sep 08 08:11:00.419827 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:00.419448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" event={"ID":"d4ff19e3-6cf7-453a-9ccb-9254c5c50879","Type":"ContainerStarted","Data":"ecc3b6c1fdff73a968103fa17a4f9876c680a1ed9f245189af92d3455787782d"} Sep 08 08:11:00.445135 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:00.445076 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d8f6546c4-mt4p6" podStartSLOduration=2.111929351 podStartE2EDuration="7.445058602s" totalImagesPullingTime="5.333129251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:10:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:11:00.443390558 +0000 UTC m=+81.841339851" watchObservedRunningTime="2026-09-08 08:11:00.445058602 +0000 UTC m=+81.843007895" Sep 08 08:11:13.008805 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:13.008655 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:11:13.008805 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:13.008773 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:11:21.376770 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:21.376739 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nmj4j" Sep 08 08:11:33.013844 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:33.013806 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:11:33.017867 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:11:33.017843 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-795d888d4f-ww2bh" Sep 08 08:14:20.962379 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:20.962346 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l"] Sep 08 08:14:20.964499 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:20.964479 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:20.967030 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:20.967009 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-r757n\"" Sep 08 08:14:20.967183 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:20.967011 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 08:14:20.968113 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:20.968095 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 08:14:20.983757 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:20.983727 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l"] Sep 08 08:14:21.034545 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:21.034504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7fqx\" (UniqueName: \"kubernetes.io/projected/8eec51fd-b4d0-4f6b-befd-8a51548c0522-kube-api-access-t7fqx\") pod \"feast-operator-controller-manager-6749dbb4bb-p2f8l\" (UID: \"8eec51fd-b4d0-4f6b-befd-8a51548c0522\") " pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:21.135034 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:21.134993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7fqx\" (UniqueName: \"kubernetes.io/projected/8eec51fd-b4d0-4f6b-befd-8a51548c0522-kube-api-access-t7fqx\") pod \"feast-operator-controller-manager-6749dbb4bb-p2f8l\" (UID: \"8eec51fd-b4d0-4f6b-befd-8a51548c0522\") " pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:21.144230 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:21.144194 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7fqx\" (UniqueName: \"kubernetes.io/projected/8eec51fd-b4d0-4f6b-befd-8a51548c0522-kube-api-access-t7fqx\") pod \"feast-operator-controller-manager-6749dbb4bb-p2f8l\" (UID: \"8eec51fd-b4d0-4f6b-befd-8a51548c0522\") " pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:21.274627 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:21.274595 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:21.542465 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:21.542366 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l"] Sep 08 08:14:21.545350 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:14:21.545325 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eec51fd_b4d0_4f6b_befd_8a51548c0522.slice/crio-bc8184fe306666d23f4de4b3cfac8d81c12c525eba41f249bed6ec29f624c16e WatchSource:0}: Error finding container bc8184fe306666d23f4de4b3cfac8d81c12c525eba41f249bed6ec29f624c16e: Status 404 returned error can't find the container with id bc8184fe306666d23f4de4b3cfac8d81c12c525eba41f249bed6ec29f624c16e Sep 08 08:14:22.102376 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:22.102337 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" event={"ID":"8eec51fd-b4d0-4f6b-befd-8a51548c0522","Type":"ContainerStarted","Data":"bc8184fe306666d23f4de4b3cfac8d81c12c525eba41f249bed6ec29f624c16e"} Sep 08 08:14:24.110941 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:24.110846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" event={"ID":"8eec51fd-b4d0-4f6b-befd-8a51548c0522","Type":"ContainerStarted","Data":"ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea"} Sep 08 08:14:24.110941 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:24.110920 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:24.128746 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:24.128666 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" podStartSLOduration=1.9348079660000002 podStartE2EDuration="4.128647017s" totalImagesPullingTime="2.193839051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:14:24.127799378 +0000 UTC m=+285.525748675" watchObservedRunningTime="2026-09-08 08:14:24.128647017 +0000 UTC m=+285.526596308" Sep 08 08:14:35.117893 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:35.117861 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:14:38.979958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:38.979929 2580 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 08:14:56.508372 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.508336 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2"] Sep 08 08:14:56.510700 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.510679 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.513450 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 08:14:56.513622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513473 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 08:14:56.513622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513513 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 08 08:14:56.513622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513547 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tmbsg\"" Sep 08 08:14:56.513838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513791 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 08:14:56.513891 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513847 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 08:14:56.513891 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513873 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 08:14:56.514003 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.513931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 08:14:56.524171 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.524142 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2"] Sep 08 08:14:56.590502 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.590464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.590662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.590516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtgv\" (UniqueName: \"kubernetes.io/projected/19502851-71db-4247-911a-8dd058d2bdc3-kube-api-access-2jtgv\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.590662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.590546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.590662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.590564 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.590662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.590599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.590662 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.590620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/19502851-71db-4247-911a-8dd058d2bdc3-feast-data\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.691824 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.691769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtgv\" (UniqueName: \"kubernetes.io/projected/19502851-71db-4247-911a-8dd058d2bdc3-kube-api-access-2jtgv\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.691824 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.691822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.691824 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.691840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.691885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.691905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/19502851-71db-4247-911a-8dd058d2bdc3-feast-data\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.691935 2580 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692013 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls podName:19502851-71db-4247-911a-8dd058d2bdc3 nodeName:}" failed. No retries permitted until 2026-09-08 08:14:57.191997449 +0000 UTC m=+318.589946721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls") pod "feast-simple-feast-setup-6c6699bf87-v5sj2" (UID: "19502851-71db-4247-911a-8dd058d2bdc3") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692017 2580 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692045 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls podName:19502851-71db-4247-911a-8dd058d2bdc3 nodeName:}" failed. No retries permitted until 2026-09-08 08:14:57.192035476 +0000 UTC m=+318.589984748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls") pod "feast-simple-feast-setup-6c6699bf87-v5sj2" (UID: "19502851-71db-4247-911a-8dd058d2bdc3") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.691939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692054 2580 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692096 2580 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 08:14:56.692097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692116 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls podName:19502851-71db-4247-911a-8dd058d2bdc3 nodeName:}" failed. No retries permitted until 2026-09-08 08:14:57.192099948 +0000 UTC m=+318.590049227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls") pod "feast-simple-feast-setup-6c6699bf87-v5sj2" (UID: "19502851-71db-4247-911a-8dd058d2bdc3") : secret "feast-simple-feast-setup-offline-tls" not found Sep 08 08:14:56.692596 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:14:56.692135 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls podName:19502851-71db-4247-911a-8dd058d2bdc3 nodeName:}" failed. No retries permitted until 2026-09-08 08:14:57.192125437 +0000 UTC m=+318.590074714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls") pod "feast-simple-feast-setup-6c6699bf87-v5sj2" (UID: "19502851-71db-4247-911a-8dd058d2bdc3") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 08:14:56.692596 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.692362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/19502851-71db-4247-911a-8dd058d2bdc3-feast-data\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:56.700810 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:56.700778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtgv\" (UniqueName: \"kubernetes.io/projected/19502851-71db-4247-911a-8dd058d2bdc3-kube-api-access-2jtgv\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.196366 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.196329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.196366 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.196373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.196657 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.196442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.196657 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.196480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.199041 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.198993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.199041 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.199017 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.199224 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.199040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.199224 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.199114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-v5sj2\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.427854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.427814 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:14:57.711203 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.711169 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2"] Sep 08 08:14:57.714510 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:14:57.714477 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19502851_71db_4247_911a_8dd058d2bdc3.slice/crio-a89330d89fed80bbeb160a502eb1d5026f1a8c9d48176cd2b2af28436a80407e WatchSource:0}: Error finding container a89330d89fed80bbeb160a502eb1d5026f1a8c9d48176cd2b2af28436a80407e: Status 404 returned error can't find the container with id a89330d89fed80bbeb160a502eb1d5026f1a8c9d48176cd2b2af28436a80407e Sep 08 08:14:57.716606 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:57.716587 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:14:58.228323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:14:58.228288 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"a89330d89fed80bbeb160a502eb1d5026f1a8c9d48176cd2b2af28436a80407e"} Sep 08 08:15:24.325870 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:24.325833 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"ff0c8d165dafae3a0388382e29138df52b2086d438a45c0b4546f0a5cd694cc2"} Sep 08 08:15:29.346688 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:29.346653 2580 generic.go:356] "Generic (PLEG): container finished" podID="19502851-71db-4247-911a-8dd058d2bdc3" containerID="ff0c8d165dafae3a0388382e29138df52b2086d438a45c0b4546f0a5cd694cc2" exitCode=0 Sep 08 08:15:29.347128 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:29.346706 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"ff0c8d165dafae3a0388382e29138df52b2086d438a45c0b4546f0a5cd694cc2"} Sep 08 08:15:30.354642 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:30.354601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"0c66e3b2ab3f5317617604aaaca2f46d9f171a178f0a8b173fb56d1baa972111"} Sep 08 08:15:36.378715 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:36.378685 2580 generic.go:356] "Generic (PLEG): container finished" podID="19502851-71db-4247-911a-8dd058d2bdc3" containerID="0c66e3b2ab3f5317617604aaaca2f46d9f171a178f0a8b173fb56d1baa972111" exitCode=0 Sep 08 08:15:36.379098 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:36.378760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"0c66e3b2ab3f5317617604aaaca2f46d9f171a178f0a8b173fb56d1baa972111"} Sep 08 08:15:37.388129 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.388054 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"60a54ccf15cc861b944df29b89f65e564b2bc759d7145774ed48013d23ca7da8"} Sep 08 08:15:37.388562 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.388160 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"bf5afa7e4b9603839e59c9495510d0c8f75b280831d066fe65bfcb5b8a4ffbe0"} Sep 08 08:15:37.388562 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.388184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"8d9b3dfd67d6238355731ca4a74bc3951042ec89585bdcac2abb801c94a826af"} Sep 08 08:15:37.388562 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.388205 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerStarted","Data":"4b1c6a8de7b926da93526f29232faeeb61a6ae83b985642a1c9483e5aaaa4d52"} Sep 08 08:15:37.414364 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.414291 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podStartSLOduration=15.839614448 podStartE2EDuration="41.414265406s" totalImagesPullingTime="25.574650958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:15:37.413040365 +0000 UTC m=+358.810989660" watchObservedRunningTime="2026-09-08 08:15:37.414265406 +0000 UTC m=+358.812214701" Sep 08 08:15:37.428294 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.428253 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:37.428608 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.428348 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:37.428608 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.428396 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:37.428608 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:37.428432 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:39.428754 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.428615 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:39.428754 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.428682 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:39.428754 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.428702 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:39.428754 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.428719 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:39.430951 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.430912 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.14:8816: connect: connection refused" Sep 08 08:15:39.431104 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.430975 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.14:6567/health\": dial tcp 10.133.0.14:6567: connect: connection refused" Sep 08 08:15:39.431104 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.430899 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.14:8443: connect: connection refused" Sep 08 08:15:39.431104 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:39.430928 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.14:6571: connect: connection refused" Sep 08 08:15:42.428905 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:42.428853 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.14:6571: connect: connection refused" Sep 08 08:15:42.429519 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:42.428854 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.14:8443: connect: connection refused" Sep 08 08:15:42.429635 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:42.428877 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.14:6567/health\": dial tcp 10.133.0.14:6567: connect: connection refused" Sep 08 08:15:42.429635 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:42.428853 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.14:8816: connect: connection refused" Sep 08 08:15:45.429093 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.429061 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:45.429562 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.429200 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:45.429562 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.429521 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:45.430071 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.430053 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:45.430543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.430526 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:45.430614 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.430580 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:45.434632 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:45.434601 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:15:46.435915 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:15:46.435883 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:16:48.729246 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:48.729193 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2"] Sep 08 08:16:48.729882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:48.729471 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="registry" containerID="cri-o://4b1c6a8de7b926da93526f29232faeeb61a6ae83b985642a1c9483e5aaaa4d52" gracePeriod=30 Sep 08 08:16:48.729882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:48.729509 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="offline" containerID="cri-o://bf5afa7e4b9603839e59c9495510d0c8f75b280831d066fe65bfcb5b8a4ffbe0" gracePeriod=30 Sep 08 08:16:48.729882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:48.729547 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" containerID="cri-o://8d9b3dfd67d6238355731ca4a74bc3951042ec89585bdcac2abb801c94a826af" gracePeriod=30 Sep 08 08:16:48.729882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:48.729678 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" containerID="cri-o://60a54ccf15cc861b944df29b89f65e564b2bc759d7145774ed48013d23ca7da8" gracePeriod=30 Sep 08 08:16:49.129690 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.129656 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8"] Sep 08 08:16:49.134037 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.134008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.136581 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.136551 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jnswt\"" Sep 08 08:16:49.149037 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.149002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8"] Sep 08 08:16:49.181161 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.181122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.181161 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.181167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.181435 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.181192 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tkgn\" (UniqueName: \"kubernetes.io/projected/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-kube-api-access-5tkgn\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.181435 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.181238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.181435 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.181280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.181435 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.181310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-feast-data\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.281935 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.281893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.281935 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.281940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-feast-data\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.282188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.281983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.282188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.282014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.282188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.282049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tkgn\" (UniqueName: \"kubernetes.io/projected/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-kube-api-access-5tkgn\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.282188 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:16:49.282061 2580 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 08:16:49.282188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.282079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.282188 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:16:49.282145 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls podName:472e4e1d-5a51-49a8-be00-c33dfbbabd4c nodeName:}" failed. No retries permitted until 2026-09-08 08:16:49.782121483 +0000 UTC m=+431.180070762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls") pod "feast-simple-feast-setup-6c6699bf87-vz6h8" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 08:16:49.282521 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.282450 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-feast-data\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.284761 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.284730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-registry-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.284926 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.284822 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-online-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.284996 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.284959 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-offline-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.292368 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.292333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tkgn\" (UniqueName: \"kubernetes.io/projected/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-kube-api-access-5tkgn\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.659203 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.659166 2580 generic.go:356] "Generic (PLEG): container finished" podID="19502851-71db-4247-911a-8dd058d2bdc3" containerID="60a54ccf15cc861b944df29b89f65e564b2bc759d7145774ed48013d23ca7da8" exitCode=0 Sep 08 08:16:49.659203 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.659198 2580 generic.go:356] "Generic (PLEG): container finished" podID="19502851-71db-4247-911a-8dd058d2bdc3" containerID="8d9b3dfd67d6238355731ca4a74bc3951042ec89585bdcac2abb801c94a826af" exitCode=0 Sep 08 08:16:49.659442 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.659232 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"60a54ccf15cc861b944df29b89f65e564b2bc759d7145774ed48013d23ca7da8"} Sep 08 08:16:49.659442 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.659282 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"8d9b3dfd67d6238355731ca4a74bc3951042ec89585bdcac2abb801c94a826af"} Sep 08 08:16:49.788212 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.788169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:49.790738 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:49.790705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls\") pod \"feast-simple-feast-setup-6c6699bf87-vz6h8\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:50.046669 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:50.046574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:16:50.327539 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:50.327516 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8"] Sep 08 08:16:50.329903 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:16:50.329867 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod472e4e1d_5a51_49a8_be00_c33dfbbabd4c.slice/crio-4dfe23960e8c5f0941740b0015af2c5bd62c4a75a1bbec5cfe1c386a6f2d026e WatchSource:0}: Error finding container 4dfe23960e8c5f0941740b0015af2c5bd62c4a75a1bbec5cfe1c386a6f2d026e: Status 404 returned error can't find the container with id 4dfe23960e8c5f0941740b0015af2c5bd62c4a75a1bbec5cfe1c386a6f2d026e Sep 08 08:16:50.667434 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:50.667325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d"} Sep 08 08:16:50.667434 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:50.667383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"4dfe23960e8c5f0941740b0015af2c5bd62c4a75a1bbec5cfe1c386a6f2d026e"} Sep 08 08:16:55.430056 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:55.430002 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.14:8443: connect: connection refused" Sep 08 08:16:55.688503 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:55.688419 2580 generic.go:356] "Generic (PLEG): container finished" podID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerID="5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d" exitCode=0 Sep 08 08:16:55.688503 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:55.688467 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d"} Sep 08 08:16:56.433449 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:56.433382 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.14:6567/health\": dial tcp 10.133.0.14:6567: connect: connection refused" Sep 08 08:16:56.695046 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:16:56.694960 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394"} Sep 08 08:17:02.724237 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:02.724199 2580 generic.go:356] "Generic (PLEG): container finished" podID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerID="cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394" exitCode=0 Sep 08 08:17:02.724637 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:02.724270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394"} Sep 08 08:17:03.733449 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:03.733390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7"} Sep 08 08:17:03.733945 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:03.733472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d"} Sep 08 08:17:03.733945 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:03.733492 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523"} Sep 08 08:17:03.733945 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:03.733511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerStarted","Data":"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9"} Sep 08 08:17:03.761681 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:03.761612 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podStartSLOduration=14.761590011 podStartE2EDuration="14.761590011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:17:03.761339605 +0000 UTC m=+445.159288900" watchObservedRunningTime="2026-09-08 08:17:03.761590011 +0000 UTC m=+445.159539305" Sep 08 08:17:05.047173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.047032 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:05.047173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.047102 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:05.047173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.047125 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:05.047173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.047143 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:05.049453 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.049389 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.15:8816: connect: connection refused" Sep 08 08:17:05.049591 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.049414 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.15:6567/health\": dial tcp 10.133.0.15:6567: connect: connection refused" Sep 08 08:17:05.049591 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.049433 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.15:6571: connect: connection refused" Sep 08 08:17:05.049775 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.049752 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:17:05.430876 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:05.430752 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.14:8443: connect: connection refused" Sep 08 08:17:06.432937 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:06.432882 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.14:6567/health\": dial tcp 10.133.0.14:6567: connect: connection refused" Sep 08 08:17:08.047487 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:08.047437 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.15:8816: connect: connection refused" Sep 08 08:17:08.048005 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:08.047531 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.15:6571: connect: connection refused" Sep 08 08:17:08.048005 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:08.047453 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.15:6567/health\": dial tcp 10.133.0.15:6567: connect: connection refused" Sep 08 08:17:08.048005 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:08.047445 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:17:10.047382 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:10.047336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:10.047896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:10.047437 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:10.047896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:10.047462 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:10.047896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:10.047485 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:11.046946 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.046902 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:17:11.047748 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.047721 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:11.048082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.047875 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:11.048583 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.048556 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:11.048960 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.048944 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:11.074901 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.074865 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:11.778320 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:11.778279 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:14.047687 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:14.047654 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:14.787184 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:14.787155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:17:15.430694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:15.430646 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.14:8443: connect: connection refused" Sep 08 08:17:15.431201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:15.430791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:17:16.432768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:16.432721 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.14:6567/health\": dial tcp 10.133.0.14:6567: connect: connection refused" Sep 08 08:17:16.433236 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:16.432860 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:17:18.803344 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:18.803305 2580 generic.go:356] "Generic (PLEG): container finished" podID="19502851-71db-4247-911a-8dd058d2bdc3" containerID="bf5afa7e4b9603839e59c9495510d0c8f75b280831d066fe65bfcb5b8a4ffbe0" exitCode=137 Sep 08 08:17:18.803344 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:18.803330 2580 generic.go:356] "Generic (PLEG): container finished" podID="19502851-71db-4247-911a-8dd058d2bdc3" containerID="4b1c6a8de7b926da93526f29232faeeb61a6ae83b985642a1c9483e5aaaa4d52" exitCode=137 Sep 08 08:17:18.803773 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:18.803371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"bf5afa7e4b9603839e59c9495510d0c8f75b280831d066fe65bfcb5b8a4ffbe0"} Sep 08 08:17:18.803773 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:18.803427 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"4b1c6a8de7b926da93526f29232faeeb61a6ae83b985642a1c9483e5aaaa4d52"} Sep 08 08:17:19.387557 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.387522 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:17:19.442649 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.442615 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls\") pod \"19502851-71db-4247-911a-8dd058d2bdc3\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " Sep 08 08:17:19.442649 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.442656 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls\") pod \"19502851-71db-4247-911a-8dd058d2bdc3\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " Sep 08 08:17:19.442928 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.442674 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls\") pod \"19502851-71db-4247-911a-8dd058d2bdc3\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " Sep 08 08:17:19.442928 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.442732 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/19502851-71db-4247-911a-8dd058d2bdc3-feast-data\") pod \"19502851-71db-4247-911a-8dd058d2bdc3\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " Sep 08 08:17:19.442928 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.442763 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls\") pod \"19502851-71db-4247-911a-8dd058d2bdc3\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " Sep 08 08:17:19.442928 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.442802 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jtgv\" (UniqueName: \"kubernetes.io/projected/19502851-71db-4247-911a-8dd058d2bdc3-kube-api-access-2jtgv\") pod \"19502851-71db-4247-911a-8dd058d2bdc3\" (UID: \"19502851-71db-4247-911a-8dd058d2bdc3\") " Sep 08 08:17:19.443431 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.443351 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19502851-71db-4247-911a-8dd058d2bdc3-feast-data" (OuterVolumeSpecName: "feast-data") pod "19502851-71db-4247-911a-8dd058d2bdc3" (UID: "19502851-71db-4247-911a-8dd058d2bdc3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:17:19.445117 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.445084 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "19502851-71db-4247-911a-8dd058d2bdc3" (UID: "19502851-71db-4247-911a-8dd058d2bdc3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:17:19.445220 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.445154 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "19502851-71db-4247-911a-8dd058d2bdc3" (UID: "19502851-71db-4247-911a-8dd058d2bdc3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:17:19.445220 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.445183 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "19502851-71db-4247-911a-8dd058d2bdc3" (UID: "19502851-71db-4247-911a-8dd058d2bdc3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:17:19.445325 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.445260 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls" (OuterVolumeSpecName: "online-tls") pod "19502851-71db-4247-911a-8dd058d2bdc3" (UID: "19502851-71db-4247-911a-8dd058d2bdc3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:17:19.445325 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.445306 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19502851-71db-4247-911a-8dd058d2bdc3-kube-api-access-2jtgv" (OuterVolumeSpecName: "kube-api-access-2jtgv") pod "19502851-71db-4247-911a-8dd058d2bdc3" (UID: "19502851-71db-4247-911a-8dd058d2bdc3"). InnerVolumeSpecName "kube-api-access-2jtgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:17:19.543758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.543655 2580 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-online-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:17:19.543758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.543688 2580 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-ui-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:17:19.543758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.543699 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-registry-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:17:19.543758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.543710 2580 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/19502851-71db-4247-911a-8dd058d2bdc3-feast-data\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:17:19.543758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.543720 2580 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/19502851-71db-4247-911a-8dd058d2bdc3-offline-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:17:19.543758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.543731 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jtgv\" (UniqueName: \"kubernetes.io/projected/19502851-71db-4247-911a-8dd058d2bdc3-kube-api-access-2jtgv\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:17:19.809619 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.809534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" event={"ID":"19502851-71db-4247-911a-8dd058d2bdc3","Type":"ContainerDied","Data":"a89330d89fed80bbeb160a502eb1d5026f1a8c9d48176cd2b2af28436a80407e"} Sep 08 08:17:19.809619 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.809604 2580 scope.go:117] "RemoveContainer" containerID="60a54ccf15cc861b944df29b89f65e564b2bc759d7145774ed48013d23ca7da8" Sep 08 08:17:19.810190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.809554 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2" Sep 08 08:17:19.818222 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.818200 2580 scope.go:117] "RemoveContainer" containerID="bf5afa7e4b9603839e59c9495510d0c8f75b280831d066fe65bfcb5b8a4ffbe0" Sep 08 08:17:19.827005 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.826985 2580 scope.go:117] "RemoveContainer" containerID="8d9b3dfd67d6238355731ca4a74bc3951042ec89585bdcac2abb801c94a826af" Sep 08 08:17:19.832048 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.832022 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2"] Sep 08 08:17:19.836368 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.836333 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-v5sj2"] Sep 08 08:17:19.836974 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.836954 2580 scope.go:117] "RemoveContainer" containerID="4b1c6a8de7b926da93526f29232faeeb61a6ae83b985642a1c9483e5aaaa4d52" Sep 08 08:17:19.844738 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.844713 2580 scope.go:117] "RemoveContainer" containerID="0c66e3b2ab3f5317617604aaaca2f46d9f171a178f0a8b173fb56d1baa972111" Sep 08 08:17:19.852509 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:19.852483 2580 scope.go:117] "RemoveContainer" containerID="ff0c8d165dafae3a0388382e29138df52b2086d438a45c0b4546f0a5cd694cc2" Sep 08 08:17:21.083836 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:17:21.083805 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19502851-71db-4247-911a-8dd058d2bdc3" path="/var/lib/kubelet/pods/19502851-71db-4247-911a-8dd058d2bdc3/volumes" Sep 08 08:18:18.203813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.203775 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn"] Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204046 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="offline" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204056 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="offline" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204069 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="registry" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204074 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="registry" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204082 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="feast-init" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204087 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="feast-init" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204097 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="feast-apply" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204101 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="feast-apply" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204111 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204115 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204122 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204127 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204166 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="registry" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204173 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="offline" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204180 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="online" Sep 08 08:18:18.204233 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.204186 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="19502851-71db-4247-911a-8dd058d2bdc3" containerName="ui" Sep 08 08:18:18.207455 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.207437 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.214648 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.214629 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 08:18:18.214743 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.214696 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 08:18:18.214796 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.214701 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 08 08:18:18.215552 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.215539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 08:18:18.215710 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.215694 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 08:18:18.215875 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.215860 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-r28n4\"" Sep 08 08:18:18.215933 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.215893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 08:18:18.215933 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.215923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 08:18:18.235424 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.235369 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn"] Sep 08 08:18:18.283001 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.282964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ad6414-284c-4c2d-8c54-62ce0e62752f-feast-data\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.283001 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.283007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-ui-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.283228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.283041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.283228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.283069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63ad6414-284c-4c2d-8c54-62ce0e62752f-registry-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.283228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.283110 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xksx2\" (UniqueName: \"kubernetes.io/projected/63ad6414-284c-4c2d-8c54-62ce0e62752f-kube-api-access-xksx2\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.283228 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.283128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-online-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.383892 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.383845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-ui-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.383905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.383932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63ad6414-284c-4c2d-8c54-62ce0e62752f-registry-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.383984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xksx2\" (UniqueName: \"kubernetes.io/projected/63ad6414-284c-4c2d-8c54-62ce0e62752f-kube-api-access-xksx2\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.384014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-online-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.384061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ad6414-284c-4c2d-8c54-62ce0e62752f-feast-data\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384345 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:18:18.384092 2580 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 08:18:18.384345 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:18:18.384187 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls podName:63ad6414-284c-4c2d-8c54-62ce0e62752f nodeName:}" failed. No retries permitted until 2026-09-08 08:18:18.884165513 +0000 UTC m=+520.282114784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls") pod "feast-simple-feast-remote-setup-5fb899f5fc-psvkn" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 08:18:18.384535 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.384517 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ad6414-284c-4c2d-8c54-62ce0e62752f-feast-data\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.384869 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.384847 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63ad6414-284c-4c2d-8c54-62ce0e62752f-registry-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.386576 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.386558 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-ui-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.386630 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.386602 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-online-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.394369 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.394336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xksx2\" (UniqueName: \"kubernetes.io/projected/63ad6414-284c-4c2d-8c54-62ce0e62752f-kube-api-access-xksx2\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.888591 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:18.888553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:18.888761 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:18:18.888698 2580 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 08:18:18.888804 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:18:18.888775 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls podName:63ad6414-284c-4c2d-8c54-62ce0e62752f nodeName:}" failed. No retries permitted until 2026-09-08 08:18:19.888759726 +0000 UTC m=+521.286709002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls") pod "feast-simple-feast-remote-setup-5fb899f5fc-psvkn" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 08:18:19.895916 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:19.895876 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:19.898392 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:19.898365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") pod \"feast-simple-feast-remote-setup-5fb899f5fc-psvkn\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:20.017028 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:20.016988 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:20.300173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:20.300135 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn"] Sep 08 08:18:20.301706 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:18:20.301678 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63ad6414_284c_4c2d_8c54_62ce0e62752f.slice/crio-74b67b0a17cee0a3a4d79fdeee09d4401be99c628964e8bbf9643f8e348c019e WatchSource:0}: Error finding container 74b67b0a17cee0a3a4d79fdeee09d4401be99c628964e8bbf9643f8e348c019e: Status 404 returned error can't find the container with id 74b67b0a17cee0a3a4d79fdeee09d4401be99c628964e8bbf9643f8e348c019e Sep 08 08:18:21.027275 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:21.027237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerStarted","Data":"68c144d61d18633538227d6251c1727a348d2e3d1925a0c02741f2623fabdb4e"} Sep 08 08:18:21.027275 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:21.027281 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerStarted","Data":"74b67b0a17cee0a3a4d79fdeee09d4401be99c628964e8bbf9643f8e348c019e"} Sep 08 08:18:26.046063 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:26.046026 2580 generic.go:356] "Generic (PLEG): container finished" podID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerID="68c144d61d18633538227d6251c1727a348d2e3d1925a0c02741f2623fabdb4e" exitCode=0 Sep 08 08:18:26.046473 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:26.046099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerDied","Data":"68c144d61d18633538227d6251c1727a348d2e3d1925a0c02741f2623fabdb4e"} Sep 08 08:18:27.052120 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:27.052084 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerStarted","Data":"8936ecdb6c2c67675f95dc67645ea967b14467bff546645367620c7847f09e46"} Sep 08 08:18:51.147794 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:51.147757 2580 generic.go:356] "Generic (PLEG): container finished" podID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerID="8936ecdb6c2c67675f95dc67645ea967b14467bff546645367620c7847f09e46" exitCode=0 Sep 08 08:18:51.148331 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:51.147834 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerDied","Data":"8936ecdb6c2c67675f95dc67645ea967b14467bff546645367620c7847f09e46"} Sep 08 08:18:51.152733 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:51.152708 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 08 08:18:52.155159 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:52.155114 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerStarted","Data":"e00e07a69755fb718b12040b53f663c1055360d304ea5df629eb1ea40569a2a4"} Sep 08 08:18:52.155687 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:52.155182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerStarted","Data":"ce46a28bce7f1b46f98baca532ac63ea913048470830b86bcff038ecc32cff20"} Sep 08 08:18:52.155687 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:52.155219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerStarted","Data":"0619acf0fe6ba1c80d3cb0c5e73b2419cdaef16c090dee3f400753e5c40d4ced"} Sep 08 08:18:52.180808 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:52.180749 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podStartSLOduration=34.180729606 podStartE2EDuration="34.180729606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:18:52.179130306 +0000 UTC m=+553.577079613" watchObservedRunningTime="2026-09-08 08:18:52.180729606 +0000 UTC m=+553.578678901" Sep 08 08:18:53.017582 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:53.017528 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:53.017582 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:53.017584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:53.017824 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:53.017601 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:18:53.019650 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:53.019611 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.16:6567/health\": dial tcp 10.133.0.16:6567: connect: connection refused" Sep 08 08:18:53.019804 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:53.019632 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.16:8816: connect: connection refused" Sep 08 08:18:53.019804 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:53.019599 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.16:8443: connect: connection refused" Sep 08 08:18:56.018126 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:56.018070 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.16:8443: connect: connection refused" Sep 08 08:18:56.018126 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:56.018098 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.16:6567/health\": dial tcp 10.133.0.16:6567: connect: connection refused" Sep 08 08:18:56.018807 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:56.018070 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.16:8816: connect: connection refused" Sep 08 08:18:59.017922 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:59.017872 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.16:8816: connect: connection refused" Sep 08 08:18:59.017922 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:59.017907 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.16:6567/health\": dial tcp 10.133.0.16:6567: connect: connection refused" Sep 08 08:18:59.018351 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:18:59.017872 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.16:8443: connect: connection refused" Sep 08 08:19:00.017886 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:00.017847 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:00.018084 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:00.017930 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:00.018084 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:00.017959 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:02.018435 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:02.018377 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:02.018879 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:02.018680 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:02.019143 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:02.019126 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:02.019296 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:02.019280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:02.039900 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:02.039871 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:19:02.216946 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:19:02.216914 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:20:04.450323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.450230 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn"] Sep 08 08:20:04.453076 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.450543 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" containerID="cri-o://0619acf0fe6ba1c80d3cb0c5e73b2419cdaef16c090dee3f400753e5c40d4ced" gracePeriod=30 Sep 08 08:20:04.453076 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.450609 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" containerID="cri-o://e00e07a69755fb718b12040b53f663c1055360d304ea5df629eb1ea40569a2a4" gracePeriod=30 Sep 08 08:20:04.453076 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.450667 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" containerID="cri-o://ce46a28bce7f1b46f98baca532ac63ea913048470830b86bcff038ecc32cff20" gracePeriod=30 Sep 08 08:20:04.564850 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.564812 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8"] Sep 08 08:20:04.565186 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.565160 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="registry" containerID="cri-o://e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9" gracePeriod=30 Sep 08 08:20:04.565288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.565262 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" containerID="cri-o://43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7" gracePeriod=30 Sep 08 08:20:04.565352 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.565297 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" containerID="cri-o://15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523" gracePeriod=30 Sep 08 08:20:04.565481 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.565435 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="offline" containerID="cri-o://0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d" gracePeriod=30 Sep 08 08:20:04.787159 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:04.787095 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:20:05.437882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:05.437846 2580 generic.go:356] "Generic (PLEG): container finished" podID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerID="e00e07a69755fb718b12040b53f663c1055360d304ea5df629eb1ea40569a2a4" exitCode=0 Sep 08 08:20:05.437882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:05.437878 2580 generic.go:356] "Generic (PLEG): container finished" podID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerID="0619acf0fe6ba1c80d3cb0c5e73b2419cdaef16c090dee3f400753e5c40d4ced" exitCode=0 Sep 08 08:20:05.438082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:05.437914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerDied","Data":"e00e07a69755fb718b12040b53f663c1055360d304ea5df629eb1ea40569a2a4"} Sep 08 08:20:05.438082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:05.437963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerDied","Data":"0619acf0fe6ba1c80d3cb0c5e73b2419cdaef16c090dee3f400753e5c40d4ced"} Sep 08 08:20:05.441056 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:05.441033 2580 generic.go:356] "Generic (PLEG): container finished" podID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerID="43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7" exitCode=0 Sep 08 08:20:05.441155 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:05.441101 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7"} Sep 08 08:20:06.448428 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:06.448368 2580 generic.go:356] "Generic (PLEG): container finished" podID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerID="15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523" exitCode=0 Sep 08 08:20:06.448818 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:06.448440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523"} Sep 08 08:20:11.775643 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:11.775594 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.15:6567/health\": dial tcp 10.133.0.15:6567: connect: connection refused" Sep 08 08:20:12.019719 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:12.019674 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.16:8443: connect: connection refused" Sep 08 08:20:12.198718 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:12.198628 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.16:6567/health\": dial tcp 10.133.0.16:6567: connect: connection refused" Sep 08 08:20:14.786591 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:14.786539 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:20:21.775724 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:21.775658 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.15:6567/health\": dial tcp 10.133.0.15:6567: connect: connection refused" Sep 08 08:20:22.019781 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:22.019730 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.16:8443: connect: connection refused" Sep 08 08:20:22.198854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:22.198758 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.16:6567/health\": dial tcp 10.133.0.16:6567: connect: connection refused" Sep 08 08:20:24.786779 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:24.786735 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:20:24.787210 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:24.786853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:20:31.775416 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:31.775352 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.15:6567/health\": dial tcp 10.133.0.15:6567: connect: connection refused" Sep 08 08:20:31.775958 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:31.775516 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:20:32.019804 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:32.019761 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.16:8443: connect: connection refused" Sep 08 08:20:32.020007 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:32.019903 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:20:32.198452 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:32.198318 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.16:6567/health\": dial tcp 10.133.0.16:6567: connect: connection refused" Sep 08 08:20:32.198609 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:32.198520 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:20:34.552811 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.552777 2580 generic.go:356] "Generic (PLEG): container finished" podID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerID="ce46a28bce7f1b46f98baca532ac63ea913048470830b86bcff038ecc32cff20" exitCode=137 Sep 08 08:20:34.553185 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.552828 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerDied","Data":"ce46a28bce7f1b46f98baca532ac63ea913048470830b86bcff038ecc32cff20"} Sep 08 08:20:34.669522 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.669491 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:20:34.783351 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783319 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-online-tls\") pod \"63ad6414-284c-4c2d-8c54-62ce0e62752f\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " Sep 08 08:20:34.783595 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783362 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xksx2\" (UniqueName: \"kubernetes.io/projected/63ad6414-284c-4c2d-8c54-62ce0e62752f-kube-api-access-xksx2\") pod \"63ad6414-284c-4c2d-8c54-62ce0e62752f\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " Sep 08 08:20:34.783595 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783396 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63ad6414-284c-4c2d-8c54-62ce0e62752f-registry-tls\") pod \"63ad6414-284c-4c2d-8c54-62ce0e62752f\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " Sep 08 08:20:34.783595 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783538 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-ui-tls\") pod \"63ad6414-284c-4c2d-8c54-62ce0e62752f\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " Sep 08 08:20:34.783782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783600 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") pod \"63ad6414-284c-4c2d-8c54-62ce0e62752f\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " Sep 08 08:20:34.783782 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783647 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ad6414-284c-4c2d-8c54-62ce0e62752f-feast-data\") pod \"63ad6414-284c-4c2d-8c54-62ce0e62752f\" (UID: \"63ad6414-284c-4c2d-8c54-62ce0e62752f\") " Sep 08 08:20:34.783877 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783814 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ad6414-284c-4c2d-8c54-62ce0e62752f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "63ad6414-284c-4c2d-8c54-62ce0e62752f" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:20:34.783954 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.783935 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/63ad6414-284c-4c2d-8c54-62ce0e62752f-registry-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:34.784325 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.784297 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ad6414-284c-4c2d-8c54-62ce0e62752f-feast-data" (OuterVolumeSpecName: "feast-data") pod "63ad6414-284c-4c2d-8c54-62ce0e62752f" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:20:34.785844 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.785815 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ad6414-284c-4c2d-8c54-62ce0e62752f-kube-api-access-xksx2" (OuterVolumeSpecName: "kube-api-access-xksx2") pod "63ad6414-284c-4c2d-8c54-62ce0e62752f" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f"). InnerVolumeSpecName "kube-api-access-xksx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:20:34.785956 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.785856 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-online-tls" (OuterVolumeSpecName: "online-tls") pod "63ad6414-284c-4c2d-8c54-62ce0e62752f" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:34.785956 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.785879 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "63ad6414-284c-4c2d-8c54-62ce0e62752f" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:34.785956 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.785904 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "63ad6414-284c-4c2d-8c54-62ce0e62752f" (UID: "63ad6414-284c-4c2d-8c54-62ce0e62752f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:34.787175 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.787143 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.15:8443: connect: connection refused" Sep 08 08:20:34.884976 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.884936 2580 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ad6414-284c-4c2d-8c54-62ce0e62752f-feast-data\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:34.884976 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.884968 2580 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-online-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:34.884976 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.884976 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xksx2\" (UniqueName: \"kubernetes.io/projected/63ad6414-284c-4c2d-8c54-62ce0e62752f-kube-api-access-xksx2\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:34.884976 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.884986 2580 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-ui-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:34.885242 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:34.884994 2580 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ad6414-284c-4c2d-8c54-62ce0e62752f-offline-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.224173 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.224147 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:20:35.288004 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.287967 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-offline-tls\") pod \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " Sep 08 08:20:35.288174 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.288016 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls\") pod \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " Sep 08 08:20:35.288174 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.288036 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-feast-data\") pod \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " Sep 08 08:20:35.288174 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.288075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tkgn\" (UniqueName: \"kubernetes.io/projected/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-kube-api-access-5tkgn\") pod \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " Sep 08 08:20:35.288174 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.288100 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-registry-tls\") pod \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " Sep 08 08:20:35.288174 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.288122 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-online-tls\") pod \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\" (UID: \"472e4e1d-5a51-49a8-be00-c33dfbbabd4c\") " Sep 08 08:20:35.288644 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.288612 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-feast-data" (OuterVolumeSpecName: "feast-data") pod "472e4e1d-5a51-49a8-be00-c33dfbbabd4c" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:20:35.290319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.290285 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "472e4e1d-5a51-49a8-be00-c33dfbbabd4c" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:35.290319 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.290308 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "472e4e1d-5a51-49a8-be00-c33dfbbabd4c" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:35.290526 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.290322 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-online-tls" (OuterVolumeSpecName: "online-tls") pod "472e4e1d-5a51-49a8-be00-c33dfbbabd4c" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:35.290600 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.290582 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "472e4e1d-5a51-49a8-be00-c33dfbbabd4c" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:20:35.290652 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.290597 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-kube-api-access-5tkgn" (OuterVolumeSpecName: "kube-api-access-5tkgn") pod "472e4e1d-5a51-49a8-be00-c33dfbbabd4c" (UID: "472e4e1d-5a51-49a8-be00-c33dfbbabd4c"). InnerVolumeSpecName "kube-api-access-5tkgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:20:35.388858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.388760 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tkgn\" (UniqueName: \"kubernetes.io/projected/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-kube-api-access-5tkgn\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.388858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.388793 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-registry-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.388858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.388805 2580 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-online-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.388858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.388816 2580 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-offline-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.388858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.388826 2580 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-ui-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.388858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.388836 2580 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/472e4e1d-5a51-49a8-be00-c33dfbbabd4c-feast-data\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:20:35.559529 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.559487 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" event={"ID":"63ad6414-284c-4c2d-8c54-62ce0e62752f","Type":"ContainerDied","Data":"74b67b0a17cee0a3a4d79fdeee09d4401be99c628964e8bbf9643f8e348c019e"} Sep 08 08:20:35.559975 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.559554 2580 scope.go:117] "RemoveContainer" containerID="e00e07a69755fb718b12040b53f663c1055360d304ea5df629eb1ea40569a2a4" Sep 08 08:20:35.559975 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.559506 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn" Sep 08 08:20:35.562699 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.562672 2580 generic.go:356] "Generic (PLEG): container finished" podID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerID="0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d" exitCode=137 Sep 08 08:20:35.562699 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.562695 2580 generic.go:356] "Generic (PLEG): container finished" podID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerID="e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9" exitCode=137 Sep 08 08:20:35.562865 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.562756 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" Sep 08 08:20:35.562865 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.562754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d"} Sep 08 08:20:35.562960 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.562887 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9"} Sep 08 08:20:35.562960 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.562915 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8" event={"ID":"472e4e1d-5a51-49a8-be00-c33dfbbabd4c","Type":"ContainerDied","Data":"4dfe23960e8c5f0941740b0015af2c5bd62c4a75a1bbec5cfe1c386a6f2d026e"} Sep 08 08:20:35.568532 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.568508 2580 scope.go:117] "RemoveContainer" containerID="ce46a28bce7f1b46f98baca532ac63ea913048470830b86bcff038ecc32cff20" Sep 08 08:20:35.577046 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.577021 2580 scope.go:117] "RemoveContainer" containerID="0619acf0fe6ba1c80d3cb0c5e73b2419cdaef16c090dee3f400753e5c40d4ced" Sep 08 08:20:35.577651 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.577629 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn"] Sep 08 08:20:35.581046 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.581022 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5fb899f5fc-psvkn"] Sep 08 08:20:35.585768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.585749 2580 scope.go:117] "RemoveContainer" containerID="8936ecdb6c2c67675f95dc67645ea967b14467bff546645367620c7847f09e46" Sep 08 08:20:35.593353 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.593333 2580 scope.go:117] "RemoveContainer" containerID="68c144d61d18633538227d6251c1727a348d2e3d1925a0c02741f2623fabdb4e" Sep 08 08:20:35.598476 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.598432 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8"] Sep 08 08:20:35.601090 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.601064 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6c6699bf87-vz6h8"] Sep 08 08:20:35.603473 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.603430 2580 scope.go:117] "RemoveContainer" containerID="43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7" Sep 08 08:20:35.611230 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.611211 2580 scope.go:117] "RemoveContainer" containerID="0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d" Sep 08 08:20:35.619415 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.619382 2580 scope.go:117] "RemoveContainer" containerID="15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523" Sep 08 08:20:35.627358 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.627338 2580 scope.go:117] "RemoveContainer" containerID="e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9" Sep 08 08:20:35.635451 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.635428 2580 scope.go:117] "RemoveContainer" containerID="cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394" Sep 08 08:20:35.643322 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.643300 2580 scope.go:117] "RemoveContainer" containerID="5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d" Sep 08 08:20:35.650973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.650953 2580 scope.go:117] "RemoveContainer" containerID="43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7" Sep 08 08:20:35.651329 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:20:35.651305 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7\": container with ID starting with 43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7 not found: ID does not exist" containerID="43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7" Sep 08 08:20:35.651430 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.651339 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7"} err="failed to get container status \"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7\": rpc error: code = NotFound desc = could not find container \"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7\": container with ID starting with 43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7 not found: ID does not exist" Sep 08 08:20:35.651430 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.651376 2580 scope.go:117] "RemoveContainer" containerID="0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d" Sep 08 08:20:35.651670 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:20:35.651653 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d\": container with ID starting with 0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d not found: ID does not exist" containerID="0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d" Sep 08 08:20:35.651726 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.651677 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d"} err="failed to get container status \"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d\": rpc error: code = NotFound desc = could not find container \"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d\": container with ID starting with 0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d not found: ID does not exist" Sep 08 08:20:35.651726 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.651693 2580 scope.go:117] "RemoveContainer" containerID="15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523" Sep 08 08:20:35.651930 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:20:35.651914 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523\": container with ID starting with 15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523 not found: ID does not exist" containerID="15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523" Sep 08 08:20:35.651973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.651935 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523"} err="failed to get container status \"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523\": rpc error: code = NotFound desc = could not find container \"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523\": container with ID starting with 15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523 not found: ID does not exist" Sep 08 08:20:35.651973 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.651952 2580 scope.go:117] "RemoveContainer" containerID="e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9" Sep 08 08:20:35.652219 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:20:35.652201 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9\": container with ID starting with e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9 not found: ID does not exist" containerID="e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9" Sep 08 08:20:35.652262 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652224 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9"} err="failed to get container status \"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9\": rpc error: code = NotFound desc = could not find container \"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9\": container with ID starting with e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9 not found: ID does not exist" Sep 08 08:20:35.652262 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652239 2580 scope.go:117] "RemoveContainer" containerID="cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394" Sep 08 08:20:35.652527 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:20:35.652511 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394\": container with ID starting with cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394 not found: ID does not exist" containerID="cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394" Sep 08 08:20:35.652575 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652532 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394"} err="failed to get container status \"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394\": rpc error: code = NotFound desc = could not find container \"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394\": container with ID starting with cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394 not found: ID does not exist" Sep 08 08:20:35.652575 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652551 2580 scope.go:117] "RemoveContainer" containerID="5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d" Sep 08 08:20:35.652790 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:20:35.652776 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d\": container with ID starting with 5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d not found: ID does not exist" containerID="5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d" Sep 08 08:20:35.652847 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652793 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d"} err="failed to get container status \"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d\": rpc error: code = NotFound desc = could not find container \"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d\": container with ID starting with 5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d not found: ID does not exist" Sep 08 08:20:35.652847 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652804 2580 scope.go:117] "RemoveContainer" containerID="43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7" Sep 08 08:20:35.653010 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.652994 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7"} err="failed to get container status \"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7\": rpc error: code = NotFound desc = could not find container \"43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7\": container with ID starting with 43659440f55a5ef6acfdebce1e4b8071cf8d89beb33be5ec78596b6fa1b12dc7 not found: ID does not exist" Sep 08 08:20:35.653054 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653009 2580 scope.go:117] "RemoveContainer" containerID="0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d" Sep 08 08:20:35.653237 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653218 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d"} err="failed to get container status \"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d\": rpc error: code = NotFound desc = could not find container \"0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d\": container with ID starting with 0034c684af998a7b8a32c31d8b8bd026047e004844cef67d0ee0d05a666b2b4d not found: ID does not exist" Sep 08 08:20:35.653302 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653240 2580 scope.go:117] "RemoveContainer" containerID="15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523" Sep 08 08:20:35.653529 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653509 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523"} err="failed to get container status \"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523\": rpc error: code = NotFound desc = could not find container \"15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523\": container with ID starting with 15b48edba14885a28d17913934e6ec859fac4cc0c6b8f0c32687d09dcabd6523 not found: ID does not exist" Sep 08 08:20:35.653580 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653530 2580 scope.go:117] "RemoveContainer" containerID="e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9" Sep 08 08:20:35.653759 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653740 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9"} err="failed to get container status \"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9\": rpc error: code = NotFound desc = could not find container \"e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9\": container with ID starting with e0aea8ccba32e510ca9972f2de44ae96556a436d199a79b265d1f1df0c1af2a9 not found: ID does not exist" Sep 08 08:20:35.653826 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653761 2580 scope.go:117] "RemoveContainer" containerID="cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394" Sep 08 08:20:35.653968 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653952 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394"} err="failed to get container status \"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394\": rpc error: code = NotFound desc = could not find container \"cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394\": container with ID starting with cd453243bc0d8de31f8393ae88ac1b5faedecc841a364415cb1911aa3b011394 not found: ID does not exist" Sep 08 08:20:35.654009 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.653969 2580 scope.go:117] "RemoveContainer" containerID="5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d" Sep 08 08:20:35.654203 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:35.654184 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d"} err="failed to get container status \"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d\": rpc error: code = NotFound desc = could not find container \"5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d\": container with ID starting with 5bbdf19bd34c28fe78f607f651dc61129fd2ae8015387f1338db94199c51291d not found: ID does not exist" Sep 08 08:20:36.572182 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572148 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-8wtrg"] Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572441 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="feast-apply" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572453 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="feast-apply" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572461 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="feast-init" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572467 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="feast-init" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572476 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572482 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572490 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572495 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572503 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572508 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572514 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572518 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572523 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572528 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572534 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="feast-init" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572539 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="feast-init" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572544 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="registry" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572549 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="registry" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572555 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="offline" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572561 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="offline" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572567 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="feast-apply" Sep 08 08:20:36.572589 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572571 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="feast-apply" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572611 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="online" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572618 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="offline" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572625 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="offline" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572630 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" containerName="ui" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572634 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="ui" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572639 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="registry" Sep 08 08:20:36.573288 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.572644 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" containerName="online" Sep 08 08:20:36.577375 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.577350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.580243 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.580209 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 08 08:20:36.580371 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.580341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 08:20:36.580470 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.580341 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-ldqlx\"" Sep 08 08:20:36.581443 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.581420 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 08:20:36.584501 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.584470 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8wtrg"] Sep 08 08:20:36.600028 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.599992 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-cnfkk"] Sep 08 08:20:36.603272 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.603244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:20:36.613076 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.613049 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-cnfkk"] Sep 08 08:20:36.700345 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.700306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-postgresdata\") pod \"postgres-864846d4f5-8wtrg\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.700345 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.700348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tztq\" (UniqueName: \"kubernetes.io/projected/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-kube-api-access-6tztq\") pod \"postgres-864846d4f5-8wtrg\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.700612 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.700376 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjvf8\" (UniqueName: \"kubernetes.io/projected/a84d6659-cefd-4cae-8a76-a551f3583565-kube-api-access-gjvf8\") pod \"redis-69bbd798b6-cnfkk\" (UID: \"a84d6659-cefd-4cae-8a76-a551f3583565\") " pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:20:36.800993 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.800955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjvf8\" (UniqueName: \"kubernetes.io/projected/a84d6659-cefd-4cae-8a76-a551f3583565-kube-api-access-gjvf8\") pod \"redis-69bbd798b6-cnfkk\" (UID: \"a84d6659-cefd-4cae-8a76-a551f3583565\") " pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:20:36.801167 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.801044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-postgresdata\") pod \"postgres-864846d4f5-8wtrg\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.801167 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.801072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tztq\" (UniqueName: \"kubernetes.io/projected/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-kube-api-access-6tztq\") pod \"postgres-864846d4f5-8wtrg\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.801419 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.801383 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-postgresdata\") pod \"postgres-864846d4f5-8wtrg\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.808961 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.808921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tztq\" (UniqueName: \"kubernetes.io/projected/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-kube-api-access-6tztq\") pod \"postgres-864846d4f5-8wtrg\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.809094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.808992 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjvf8\" (UniqueName: \"kubernetes.io/projected/a84d6659-cefd-4cae-8a76-a551f3583565-kube-api-access-gjvf8\") pod \"redis-69bbd798b6-cnfkk\" (UID: \"a84d6659-cefd-4cae-8a76-a551f3583565\") " pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:20:36.893000 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.892913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:20:36.913866 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:36.913824 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:20:37.084022 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.083984 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="472e4e1d-5a51-49a8-be00-c33dfbbabd4c" path="/var/lib/kubelet/pods/472e4e1d-5a51-49a8-be00-c33dfbbabd4c/volumes" Sep 08 08:20:37.084682 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.084662 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ad6414-284c-4c2d-8c54-62ce0e62752f" path="/var/lib/kubelet/pods/63ad6414-284c-4c2d-8c54-62ce0e62752f/volumes" Sep 08 08:20:37.164048 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.163968 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8wtrg"] Sep 08 08:20:37.167007 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:20:37.166974 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd29690c6_d92a_4f0a_aa79_9edc954c4ba6.slice/crio-26075516d9085c18c3c9a0d48f16e6c3101ecb20599ccce62ee4ff71f1ee88cb WatchSource:0}: Error finding container 26075516d9085c18c3c9a0d48f16e6c3101ecb20599ccce62ee4ff71f1ee88cb: Status 404 returned error can't find the container with id 26075516d9085c18c3c9a0d48f16e6c3101ecb20599ccce62ee4ff71f1ee88cb Sep 08 08:20:37.168896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.168879 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:20:37.189851 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.189818 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-cnfkk"] Sep 08 08:20:37.192823 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:20:37.192790 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda84d6659_cefd_4cae_8a76_a551f3583565.slice/crio-febff620ddfdab6c98fed0b4f711bbb9798085453e14c06b1827cb8efb98c515 WatchSource:0}: Error finding container febff620ddfdab6c98fed0b4f711bbb9798085453e14c06b1827cb8efb98c515: Status 404 returned error can't find the container with id febff620ddfdab6c98fed0b4f711bbb9798085453e14c06b1827cb8efb98c515 Sep 08 08:20:37.573322 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.573280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8wtrg" event={"ID":"d29690c6-d92a-4f0a-aa79-9edc954c4ba6","Type":"ContainerStarted","Data":"26075516d9085c18c3c9a0d48f16e6c3101ecb20599ccce62ee4ff71f1ee88cb"} Sep 08 08:20:37.574350 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:37.574331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-cnfkk" event={"ID":"a84d6659-cefd-4cae-8a76-a551f3583565","Type":"ContainerStarted","Data":"febff620ddfdab6c98fed0b4f711bbb9798085453e14c06b1827cb8efb98c515"} Sep 08 08:20:39.585175 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:39.585138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-cnfkk" event={"ID":"a84d6659-cefd-4cae-8a76-a551f3583565","Type":"ContainerStarted","Data":"31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f"} Sep 08 08:20:39.602778 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:39.602724 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-cnfkk" podStartSLOduration=1.711530179 podStartE2EDuration="3.602703683s" totalImagesPullingTime="1.891173504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:20:39.601658365 +0000 UTC m=+660.999607672" watchObservedRunningTime="2026-09-08 08:20:39.602703683 +0000 UTC m=+661.000652970" Sep 08 08:20:42.431630 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:42.431597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 08 08:20:42.599123 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:42.599092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8wtrg" event={"ID":"d29690c6-d92a-4f0a-aa79-9edc954c4ba6","Type":"ContainerStarted","Data":"0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6"} Sep 08 08:20:42.614563 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:42.614502 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-8wtrg" podStartSLOduration=1.354753014 podStartE2EDuration="6.614485258s" totalImagesPullingTime="5.259732244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:20:42.614025118 +0000 UTC m=+664.011974414" watchObservedRunningTime="2026-09-08 08:20:42.614485258 +0000 UTC m=+664.012434553" Sep 08 08:20:45.381185 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.381148 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-78b984c68-pxkrw"] Sep 08 08:20:45.384706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.384674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.387203 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.387176 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 08 08:20:45.387323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.387203 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-qr94k\"" Sep 08 08:20:45.387323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.387181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 08 08:20:45.387323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.387268 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 08 08:20:45.387532 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.387345 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 08 08:20:45.395619 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.395594 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-78b984c68-pxkrw"] Sep 08 08:20:45.470758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.470721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-offline-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.470758 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.470754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07173e7e-9950-4e32-b2bd-bdb074ebe92e-feast-data\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.470998 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.470784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-registry-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.470998 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.470807 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-online-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.470998 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.470915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwm5m\" (UniqueName: \"kubernetes.io/projected/07173e7e-9950-4e32-b2bd-bdb074ebe92e-kube-api-access-nwm5m\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.572054 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.572012 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-offline-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.572054 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.572054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07173e7e-9950-4e32-b2bd-bdb074ebe92e-feast-data\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.572300 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.572072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-registry-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.572300 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.572088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-online-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.572300 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.572128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwm5m\" (UniqueName: \"kubernetes.io/projected/07173e7e-9950-4e32-b2bd-bdb074ebe92e-kube-api-access-nwm5m\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.572556 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.572533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07173e7e-9950-4e32-b2bd-bdb074ebe92e-feast-data\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.574706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.574680 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-online-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.574838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.574769 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-registry-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.574838 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.574823 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-offline-tls\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.580907 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.580878 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwm5m\" (UniqueName: \"kubernetes.io/projected/07173e7e-9950-4e32-b2bd-bdb074ebe92e-kube-api-access-nwm5m\") pod \"feast-credit-scoring-78b984c68-pxkrw\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.694344 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.694257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:45.976931 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:45.976843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-78b984c68-pxkrw"] Sep 08 08:20:45.979732 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:20:45.979702 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07173e7e_9950_4e32_b2bd_bdb074ebe92e.slice/crio-42a47f7be988077c98f9eb1dafcf30d36fe69a9f2a7d0e74eedcde3eae80dd7f WatchSource:0}: Error finding container 42a47f7be988077c98f9eb1dafcf30d36fe69a9f2a7d0e74eedcde3eae80dd7f: Status 404 returned error can't find the container with id 42a47f7be988077c98f9eb1dafcf30d36fe69a9f2a7d0e74eedcde3eae80dd7f Sep 08 08:20:46.615108 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:46.615075 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerStarted","Data":"83f8bae9d8939c2ff33a99145d28323c24b1b857c3e5498b62d4bc7ddf9892a5"} Sep 08 08:20:46.615492 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:46.615133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerStarted","Data":"42a47f7be988077c98f9eb1dafcf30d36fe69a9f2a7d0e74eedcde3eae80dd7f"} Sep 08 08:20:47.620308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:47.620276 2580 generic.go:356] "Generic (PLEG): container finished" podID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerID="83f8bae9d8939c2ff33a99145d28323c24b1b857c3e5498b62d4bc7ddf9892a5" exitCode=0 Sep 08 08:20:47.620779 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:47.620363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerDied","Data":"83f8bae9d8939c2ff33a99145d28323c24b1b857c3e5498b62d4bc7ddf9892a5"} Sep 08 08:20:48.625740 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:48.625693 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerStarted","Data":"7f8f78193c2e7887a9a06b2575e7db0b1cfc3cd386cdd9f9ec67d76e52465f6b"} Sep 08 08:20:55.654831 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:55.654798 2580 generic.go:356] "Generic (PLEG): container finished" podID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerID="7f8f78193c2e7887a9a06b2575e7db0b1cfc3cd386cdd9f9ec67d76e52465f6b" exitCode=0 Sep 08 08:20:55.655266 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:55.654876 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerDied","Data":"7f8f78193c2e7887a9a06b2575e7db0b1cfc3cd386cdd9f9ec67d76e52465f6b"} Sep 08 08:20:56.672225 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:56.672182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerStarted","Data":"b13abfc540a98087aedd6b9abb505c1a2a3f501db7c704849383b2ed617c7da5"} Sep 08 08:20:56.672641 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:56.672303 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerStarted","Data":"8bb811738428a59cf298bdb16ccf9d4595e83cd46db8a7b702194d463a6961f8"} Sep 08 08:20:56.672641 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:56.672331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerStarted","Data":"6b279958e3e3a642ae6188eb79d5319eaefa8f8e13505e7be32d839314f80429"} Sep 08 08:20:56.697276 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:56.697210 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podStartSLOduration=11.697190867 podStartE2EDuration="11.697190867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:20:56.697107197 +0000 UTC m=+678.095056507" watchObservedRunningTime="2026-09-08 08:20:56.697190867 +0000 UTC m=+678.095140162" Sep 08 08:20:57.695454 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:57.695393 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:57.696038 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:57.696013 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:57.696163 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:57.696054 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:20:57.697308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:57.697272 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Sep 08 08:20:57.697308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:57.697283 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Sep 08 08:20:57.697527 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:20:57.697310 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 08 08:21:00.695428 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:00.695357 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Sep 08 08:21:00.695428 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:00.695357 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Sep 08 08:21:00.695992 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:00.695363 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 08 08:21:03.695388 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:03.695336 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Sep 08 08:21:03.695924 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:03.695341 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Sep 08 08:21:03.695924 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:03.695362 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 08 08:21:05.694860 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:05.694814 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:05.695261 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:05.694902 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:05.695261 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:05.694926 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:06.695036 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:06.694991 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Sep 08 08:21:06.696009 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:06.695988 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:06.696886 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:06.696866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:06.701526 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:06.701502 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:06.723023 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:06.722994 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:09.695416 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:09.695343 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused" Sep 08 08:21:12.695068 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:12.695034 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:21:12.695954 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:21:12.695935 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:22:20.912703 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.912665 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-78b984c68-pxkrw"] Sep 08 08:22:20.913257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.912909 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" containerID="cri-o://6b279958e3e3a642ae6188eb79d5319eaefa8f8e13505e7be32d839314f80429" gracePeriod=30 Sep 08 08:22:20.913257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.912997 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" containerID="cri-o://b13abfc540a98087aedd6b9abb505c1a2a3f501db7c704849383b2ed617c7da5" gracePeriod=30 Sep 08 08:22:20.913257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.912992 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" containerID="cri-o://8bb811738428a59cf298bdb16ccf9d4595e83cd46db8a7b702194d463a6961f8" gracePeriod=30 Sep 08 08:22:20.928870 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.928836 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8wtrg"] Sep 08 08:22:20.929046 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.929012 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-8wtrg" podUID="d29690c6-d92a-4f0a-aa79-9edc954c4ba6" containerName="postgres" containerID="cri-o://0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6" gracePeriod=30 Sep 08 08:22:20.933321 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.933294 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-cnfkk"] Sep 08 08:22:20.934318 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:20.933492 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-cnfkk" podUID="a84d6659-cefd-4cae-8a76-a551f3583565" containerName="redis" containerID="cri-o://31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f" gracePeriod=30 Sep 08 08:22:21.201816 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.201786 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:22:21.203850 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.203832 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:22:21.270230 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.270196 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-postgresdata\") pod \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " Sep 08 08:22:21.270441 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.270297 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tztq\" (UniqueName: \"kubernetes.io/projected/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-kube-api-access-6tztq\") pod \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\" (UID: \"d29690c6-d92a-4f0a-aa79-9edc954c4ba6\") " Sep 08 08:22:21.270441 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.270326 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjvf8\" (UniqueName: \"kubernetes.io/projected/a84d6659-cefd-4cae-8a76-a551f3583565-kube-api-access-gjvf8\") pod \"a84d6659-cefd-4cae-8a76-a551f3583565\" (UID: \"a84d6659-cefd-4cae-8a76-a551f3583565\") " Sep 08 08:22:21.272555 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.272515 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-kube-api-access-6tztq" (OuterVolumeSpecName: "kube-api-access-6tztq") pod "d29690c6-d92a-4f0a-aa79-9edc954c4ba6" (UID: "d29690c6-d92a-4f0a-aa79-9edc954c4ba6"). InnerVolumeSpecName "kube-api-access-6tztq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:22:21.272851 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.272820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84d6659-cefd-4cae-8a76-a551f3583565-kube-api-access-gjvf8" (OuterVolumeSpecName: "kube-api-access-gjvf8") pod "a84d6659-cefd-4cae-8a76-a551f3583565" (UID: "a84d6659-cefd-4cae-8a76-a551f3583565"). InnerVolumeSpecName "kube-api-access-gjvf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:22:21.305090 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.305040 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "d29690c6-d92a-4f0a-aa79-9edc954c4ba6" (UID: "d29690c6-d92a-4f0a-aa79-9edc954c4ba6"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:22:21.371190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.371132 2580 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-postgresdata\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:21.371190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.371180 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tztq\" (UniqueName: \"kubernetes.io/projected/d29690c6-d92a-4f0a-aa79-9edc954c4ba6-kube-api-access-6tztq\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:21.371190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:21.371191 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjvf8\" (UniqueName: \"kubernetes.io/projected/a84d6659-cefd-4cae-8a76-a551f3583565-kube-api-access-gjvf8\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:22.018176 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.018144 2580 generic.go:356] "Generic (PLEG): container finished" podID="d29690c6-d92a-4f0a-aa79-9edc954c4ba6" containerID="0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6" exitCode=0 Sep 08 08:22:22.018622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.018184 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8wtrg" Sep 08 08:22:22.018622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.018227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8wtrg" event={"ID":"d29690c6-d92a-4f0a-aa79-9edc954c4ba6","Type":"ContainerDied","Data":"0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6"} Sep 08 08:22:22.018622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.018268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8wtrg" event={"ID":"d29690c6-d92a-4f0a-aa79-9edc954c4ba6","Type":"ContainerDied","Data":"26075516d9085c18c3c9a0d48f16e6c3101ecb20599ccce62ee4ff71f1ee88cb"} Sep 08 08:22:22.018622 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.018290 2580 scope.go:117] "RemoveContainer" containerID="0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6" Sep 08 08:22:22.021261 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.021234 2580 generic.go:356] "Generic (PLEG): container finished" podID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerID="8bb811738428a59cf298bdb16ccf9d4595e83cd46db8a7b702194d463a6961f8" exitCode=0 Sep 08 08:22:22.021376 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.021308 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerDied","Data":"8bb811738428a59cf298bdb16ccf9d4595e83cd46db8a7b702194d463a6961f8"} Sep 08 08:22:22.022667 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.022644 2580 generic.go:356] "Generic (PLEG): container finished" podID="a84d6659-cefd-4cae-8a76-a551f3583565" containerID="31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f" exitCode=0 Sep 08 08:22:22.022793 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.022683 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-cnfkk" Sep 08 08:22:22.022793 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.022701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-cnfkk" event={"ID":"a84d6659-cefd-4cae-8a76-a551f3583565","Type":"ContainerDied","Data":"31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f"} Sep 08 08:22:22.022793 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.022728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-cnfkk" event={"ID":"a84d6659-cefd-4cae-8a76-a551f3583565","Type":"ContainerDied","Data":"febff620ddfdab6c98fed0b4f711bbb9798085453e14c06b1827cb8efb98c515"} Sep 08 08:22:22.027210 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.027083 2580 scope.go:117] "RemoveContainer" containerID="0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6" Sep 08 08:22:22.027445 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:22:22.027418 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6\": container with ID starting with 0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6 not found: ID does not exist" containerID="0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6" Sep 08 08:22:22.027544 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.027453 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6"} err="failed to get container status \"0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6\": rpc error: code = NotFound desc = could not find container \"0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6\": container with ID starting with 0daa8a477923326b38aebc565bdbb3784748d94e5df5d629f2ac41dfce7234a6 not found: ID does not exist" Sep 08 08:22:22.027544 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.027477 2580 scope.go:117] "RemoveContainer" containerID="31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f" Sep 08 08:22:22.035033 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.035014 2580 scope.go:117] "RemoveContainer" containerID="31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f" Sep 08 08:22:22.035414 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:22:22.035379 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f\": container with ID starting with 31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f not found: ID does not exist" containerID="31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f" Sep 08 08:22:22.035467 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.035446 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f"} err="failed to get container status \"31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f\": rpc error: code = NotFound desc = could not find container \"31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f\": container with ID starting with 31fab09de6e5fdc1c3875d29726aa9ef2230687c39a380e42ce0a5ac86eb9e3f not found: ID does not exist" Sep 08 08:22:22.039630 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.039601 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8wtrg"] Sep 08 08:22:22.042970 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.042945 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8wtrg"] Sep 08 08:22:22.052834 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.052802 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-cnfkk"] Sep 08 08:22:22.058196 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:22.058169 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-cnfkk"] Sep 08 08:22:23.083357 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:23.083323 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a84d6659-cefd-4cae-8a76-a551f3583565" path="/var/lib/kubelet/pods/a84d6659-cefd-4cae-8a76-a551f3583565/volumes" Sep 08 08:22:23.083796 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:23.083711 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d29690c6-d92a-4f0a-aa79-9edc954c4ba6" path="/var/lib/kubelet/pods/d29690c6-d92a-4f0a-aa79-9edc954c4ba6/volumes" Sep 08 08:22:26.719487 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:26.719431 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 08 08:22:36.719650 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:36.719610 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 08 08:22:46.719196 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:46.719155 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 08 08:22:46.719624 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:46.719290 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:22:51.124574 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.124543 2580 generic.go:356] "Generic (PLEG): container finished" podID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerID="b13abfc540a98087aedd6b9abb505c1a2a3f501db7c704849383b2ed617c7da5" exitCode=137 Sep 08 08:22:51.124574 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.124569 2580 generic.go:356] "Generic (PLEG): container finished" podID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerID="6b279958e3e3a642ae6188eb79d5319eaefa8f8e13505e7be32d839314f80429" exitCode=137 Sep 08 08:22:51.125021 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.124622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerDied","Data":"b13abfc540a98087aedd6b9abb505c1a2a3f501db7c704849383b2ed617c7da5"} Sep 08 08:22:51.125021 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.124689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerDied","Data":"6b279958e3e3a642ae6188eb79d5319eaefa8f8e13505e7be32d839314f80429"} Sep 08 08:22:51.563170 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.563142 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:22:51.708738 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.708634 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwm5m\" (UniqueName: \"kubernetes.io/projected/07173e7e-9950-4e32-b2bd-bdb074ebe92e-kube-api-access-nwm5m\") pod \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " Sep 08 08:22:51.708738 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.708702 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07173e7e-9950-4e32-b2bd-bdb074ebe92e-feast-data\") pod \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " Sep 08 08:22:51.708981 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.708816 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-online-tls\") pod \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " Sep 08 08:22:51.708981 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.708883 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-offline-tls\") pod \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " Sep 08 08:22:51.709096 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.708990 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-registry-tls\") pod \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\" (UID: \"07173e7e-9950-4e32-b2bd-bdb074ebe92e\") " Sep 08 08:22:51.710858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.710830 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07173e7e-9950-4e32-b2bd-bdb074ebe92e-kube-api-access-nwm5m" (OuterVolumeSpecName: "kube-api-access-nwm5m") pod "07173e7e-9950-4e32-b2bd-bdb074ebe92e" (UID: "07173e7e-9950-4e32-b2bd-bdb074ebe92e"). InnerVolumeSpecName "kube-api-access-nwm5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:22:51.711012 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.710971 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "07173e7e-9950-4e32-b2bd-bdb074ebe92e" (UID: "07173e7e-9950-4e32-b2bd-bdb074ebe92e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:22:51.711012 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.710997 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-online-tls" (OuterVolumeSpecName: "online-tls") pod "07173e7e-9950-4e32-b2bd-bdb074ebe92e" (UID: "07173e7e-9950-4e32-b2bd-bdb074ebe92e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:22:51.711246 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.711228 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07173e7e-9950-4e32-b2bd-bdb074ebe92e" (UID: "07173e7e-9950-4e32-b2bd-bdb074ebe92e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:22:51.717105 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.717078 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07173e7e-9950-4e32-b2bd-bdb074ebe92e-feast-data" (OuterVolumeSpecName: "feast-data") pod "07173e7e-9950-4e32-b2bd-bdb074ebe92e" (UID: "07173e7e-9950-4e32-b2bd-bdb074ebe92e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:22:51.809918 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.809882 2580 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07173e7e-9950-4e32-b2bd-bdb074ebe92e-feast-data\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:51.809918 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.809912 2580 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-online-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:51.809918 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.809920 2580 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-offline-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:51.809918 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.809929 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07173e7e-9950-4e32-b2bd-bdb074ebe92e-registry-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:51.810150 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:51.809937 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwm5m\" (UniqueName: \"kubernetes.io/projected/07173e7e-9950-4e32-b2bd-bdb074ebe92e-kube-api-access-nwm5m\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:22:52.131843 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.131811 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" event={"ID":"07173e7e-9950-4e32-b2bd-bdb074ebe92e","Type":"ContainerDied","Data":"42a47f7be988077c98f9eb1dafcf30d36fe69a9f2a7d0e74eedcde3eae80dd7f"} Sep 08 08:22:52.132380 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.131850 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-78b984c68-pxkrw" Sep 08 08:22:52.132380 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.131884 2580 scope.go:117] "RemoveContainer" containerID="b13abfc540a98087aedd6b9abb505c1a2a3f501db7c704849383b2ed617c7da5" Sep 08 08:22:52.141605 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.141580 2580 scope.go:117] "RemoveContainer" containerID="8bb811738428a59cf298bdb16ccf9d4595e83cd46db8a7b702194d463a6961f8" Sep 08 08:22:52.148959 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.148940 2580 scope.go:117] "RemoveContainer" containerID="6b279958e3e3a642ae6188eb79d5319eaefa8f8e13505e7be32d839314f80429" Sep 08 08:22:52.155859 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.155834 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-78b984c68-pxkrw"] Sep 08 08:22:52.156796 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.156773 2580 scope.go:117] "RemoveContainer" containerID="7f8f78193c2e7887a9a06b2575e7db0b1cfc3cd386cdd9f9ec67d76e52465f6b" Sep 08 08:22:52.158767 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.158748 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-78b984c68-pxkrw"] Sep 08 08:22:52.163776 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:52.163760 2580 scope.go:117] "RemoveContainer" containerID="83f8bae9d8939c2ff33a99145d28323c24b1b857c3e5498b62d4bc7ddf9892a5" Sep 08 08:22:53.083611 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:22:53.083579 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" path="/var/lib/kubelet/pods/07173e7e-9950-4e32-b2bd-bdb074ebe92e/volumes" Sep 08 08:24:52.259075 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259033 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5lb7m"] Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259425 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84d6659-cefd-4cae-8a76-a551f3583565" containerName="redis" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259444 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84d6659-cefd-4cae-8a76-a551f3583565" containerName="redis" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259461 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="feast-apply" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259471 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="feast-apply" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259479 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259487 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259498 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d29690c6-d92a-4f0a-aa79-9edc954c4ba6" containerName="postgres" Sep 08 08:24:52.259520 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259506 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d29690c6-d92a-4f0a-aa79-9edc954c4ba6" containerName="postgres" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259527 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="feast-init" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259536 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="feast-init" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259546 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259554 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259574 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259583 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259648 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="offline" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259658 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="online" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259669 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d29690c6-d92a-4f0a-aa79-9edc954c4ba6" containerName="postgres" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259679 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84d6659-cefd-4cae-8a76-a551f3583565" containerName="redis" Sep 08 08:24:52.259768 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.259689 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="07173e7e-9950-4e32-b2bd-bdb074ebe92e" containerName="registry" Sep 08 08:24:52.262728 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.262700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:24:52.265302 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.265279 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 08 08:24:52.266380 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.266362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 08 08:24:52.266518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.266469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-978ng\"" Sep 08 08:24:52.278852 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.278815 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5lb7m"] Sep 08 08:24:52.299948 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.299905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tsgl\" (UniqueName: \"kubernetes.io/projected/6571adcf-ee72-454b-84fa-5430be0b93e5-kube-api-access-4tsgl\") pod \"redis-69bbd798b6-5lb7m\" (UID: \"6571adcf-ee72-454b-84fa-5430be0b93e5\") " pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:24:52.401323 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.401285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tsgl\" (UniqueName: \"kubernetes.io/projected/6571adcf-ee72-454b-84fa-5430be0b93e5-kube-api-access-4tsgl\") pod \"redis-69bbd798b6-5lb7m\" (UID: \"6571adcf-ee72-454b-84fa-5430be0b93e5\") " pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:24:52.410345 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.410301 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tsgl\" (UniqueName: \"kubernetes.io/projected/6571adcf-ee72-454b-84fa-5430be0b93e5-kube-api-access-4tsgl\") pod \"redis-69bbd798b6-5lb7m\" (UID: \"6571adcf-ee72-454b-84fa-5430be0b93e5\") " pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:24:52.586007 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.585911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:24:52.859518 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:52.859432 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5lb7m"] Sep 08 08:24:52.863397 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:24:52.863361 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6571adcf_ee72_454b_84fa_5430be0b93e5.slice/crio-53e04c1b970617365424af724c90068592bfcf5895f0740df1db7a7ee4713060 WatchSource:0}: Error finding container 53e04c1b970617365424af724c90068592bfcf5895f0740df1db7a7ee4713060: Status 404 returned error can't find the container with id 53e04c1b970617365424af724c90068592bfcf5895f0740df1db7a7ee4713060 Sep 08 08:24:53.546197 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:53.546161 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" event={"ID":"6571adcf-ee72-454b-84fa-5430be0b93e5","Type":"ContainerStarted","Data":"9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8"} Sep 08 08:24:53.546604 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:53.546204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" event={"ID":"6571adcf-ee72-454b-84fa-5430be0b93e5","Type":"ContainerStarted","Data":"53e04c1b970617365424af724c90068592bfcf5895f0740df1db7a7ee4713060"} Sep 08 08:24:53.561655 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:53.561591 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" podStartSLOduration=1.561567797 podStartE2EDuration="1.561567797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:24:53.560975696 +0000 UTC m=+914.958925007" watchObservedRunningTime="2026-09-08 08:24:53.561567797 +0000 UTC m=+914.959517092" Sep 08 08:24:57.699105 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.699068 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fkbw8"] Sep 08 08:24:57.702301 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.702276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:57.704947 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.704909 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 08 08:24:57.710527 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.710500 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fkbw8"] Sep 08 08:24:57.848450 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.848390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d16efa39-9079-48d9-be01-96e04e35ea8a-postgresdata\") pod \"postgres-864846d4f5-fkbw8\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:57.848450 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.848457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94vrm\" (UniqueName: \"kubernetes.io/projected/d16efa39-9079-48d9-be01-96e04e35ea8a-kube-api-access-94vrm\") pod \"postgres-864846d4f5-fkbw8\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:57.949647 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.949561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d16efa39-9079-48d9-be01-96e04e35ea8a-postgresdata\") pod \"postgres-864846d4f5-fkbw8\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:57.949647 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.949609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94vrm\" (UniqueName: \"kubernetes.io/projected/d16efa39-9079-48d9-be01-96e04e35ea8a-kube-api-access-94vrm\") pod \"postgres-864846d4f5-fkbw8\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:57.949970 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.949949 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d16efa39-9079-48d9-be01-96e04e35ea8a-postgresdata\") pod \"postgres-864846d4f5-fkbw8\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:57.959123 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:57.959099 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94vrm\" (UniqueName: \"kubernetes.io/projected/d16efa39-9079-48d9-be01-96e04e35ea8a-kube-api-access-94vrm\") pod \"postgres-864846d4f5-fkbw8\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:58.012882 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:58.012842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:24:58.282028 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:58.281941 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fkbw8"] Sep 08 08:24:58.284617 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:24:58.284585 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd16efa39_9079_48d9_be01_96e04e35ea8a.slice/crio-2a52f8dfc71db464921183b8088c525bba98f6cf8b2d4d41297b8ff536f52b14 WatchSource:0}: Error finding container 2a52f8dfc71db464921183b8088c525bba98f6cf8b2d4d41297b8ff536f52b14: Status 404 returned error can't find the container with id 2a52f8dfc71db464921183b8088c525bba98f6cf8b2d4d41297b8ff536f52b14 Sep 08 08:24:58.569219 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:58.569127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" event={"ID":"d16efa39-9079-48d9-be01-96e04e35ea8a","Type":"ContainerStarted","Data":"9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149"} Sep 08 08:24:58.569219 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:58.569183 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" event={"ID":"d16efa39-9079-48d9-be01-96e04e35ea8a","Type":"ContainerStarted","Data":"2a52f8dfc71db464921183b8088c525bba98f6cf8b2d4d41297b8ff536f52b14"} Sep 08 08:24:58.584631 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:24:58.584560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" podStartSLOduration=1.584537406 podStartE2EDuration="1.584537406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:24:58.583904663 +0000 UTC m=+919.981853956" watchObservedRunningTime="2026-09-08 08:24:58.584537406 +0000 UTC m=+919.982486701" Sep 08 08:25:03.288636 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.288599 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t"] Sep 08 08:25:03.292094 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.292072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.294871 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.294823 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 08 08:25:03.294871 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.294850 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 08 08:25:03.295102 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.294858 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 08 08:25:03.295166 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.295148 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-fwp25\"" Sep 08 08:25:03.301924 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.301886 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t"] Sep 08 08:25:03.391899 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.391864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada31a89-dccf-41b3-b102-11c3f784e57f-feast-data\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.391899 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.391902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-registry-tls\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.392134 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.391919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzk2x\" (UniqueName: \"kubernetes.io/projected/ada31a89-dccf-41b3-b102-11c3f784e57f-kube-api-access-tzk2x\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.392134 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.391941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-online-tls\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.492982 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.492939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-online-tls\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.493188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.493046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada31a89-dccf-41b3-b102-11c3f784e57f-feast-data\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.493188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.493071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-registry-tls\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.493188 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.493093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzk2x\" (UniqueName: \"kubernetes.io/projected/ada31a89-dccf-41b3-b102-11c3f784e57f-kube-api-access-tzk2x\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.493543 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.493522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada31a89-dccf-41b3-b102-11c3f784e57f-feast-data\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.495643 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.495624 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-registry-tls\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.495706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.495668 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-online-tls\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.502127 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.502090 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzk2x\" (UniqueName: \"kubernetes.io/projected/ada31a89-dccf-41b3-b102-11c3f784e57f-kube-api-access-tzk2x\") pod \"feast-credit-scoring-69fcb577bf-rb92t\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.602570 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.602484 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:03.881248 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:03.881149 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t"] Sep 08 08:25:03.885066 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:25:03.885035 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada31a89_dccf_41b3_b102_11c3f784e57f.slice/crio-86c9adfa13764580fbd5c4e4220205e25e128b63f0e00ae7fa310796cbb5c96f WatchSource:0}: Error finding container 86c9adfa13764580fbd5c4e4220205e25e128b63f0e00ae7fa310796cbb5c96f: Status 404 returned error can't find the container with id 86c9adfa13764580fbd5c4e4220205e25e128b63f0e00ae7fa310796cbb5c96f Sep 08 08:25:04.594197 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:04.594162 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerStarted","Data":"98a392d2c3d7f247450e6015ed9c6de6c66a4ea176beda2b6479f529143b0c53"} Sep 08 08:25:04.596580 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:04.594218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerStarted","Data":"86c9adfa13764580fbd5c4e4220205e25e128b63f0e00ae7fa310796cbb5c96f"} Sep 08 08:25:05.599716 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:05.599683 2580 generic.go:356] "Generic (PLEG): container finished" podID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerID="98a392d2c3d7f247450e6015ed9c6de6c66a4ea176beda2b6479f529143b0c53" exitCode=0 Sep 08 08:25:05.600193 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:05.599731 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerDied","Data":"98a392d2c3d7f247450e6015ed9c6de6c66a4ea176beda2b6479f529143b0c53"} Sep 08 08:25:06.607135 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:06.607099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerStarted","Data":"7edd65f5cdd33b0edaca4df74507e0a1734b53c3c079c8251025e4bd7d13d3bf"} Sep 08 08:25:13.635026 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:13.634928 2580 generic.go:356] "Generic (PLEG): container finished" podID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerID="7edd65f5cdd33b0edaca4df74507e0a1734b53c3c079c8251025e4bd7d13d3bf" exitCode=0 Sep 08 08:25:13.635026 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:13.635009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerDied","Data":"7edd65f5cdd33b0edaca4df74507e0a1734b53c3c079c8251025e4bd7d13d3bf"} Sep 08 08:25:14.641479 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:14.641437 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerStarted","Data":"bebf1db98855cbf3c4c8cb11e811711acb8ac8ec0dd574f8037def5e48941e40"} Sep 08 08:25:14.641990 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:14.641558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerStarted","Data":"d37dd1bc3fee23cd5a148d89aeb034f797de922b2a8c7f8eed0ac59129616957"} Sep 08 08:25:14.665244 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:14.665154 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podStartSLOduration=11.665132069 podStartE2EDuration="11.665132069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:25:14.663957631 +0000 UTC m=+936.061906925" watchObservedRunningTime="2026-09-08 08:25:14.665132069 +0000 UTC m=+936.063081364" Sep 08 08:25:15.603357 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:15.603314 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:15.603592 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:15.603388 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:15.604694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:15.604649 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 08 08:25:15.604796 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:15.604686 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 08 08:25:18.603886 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:18.603843 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 08 08:25:18.604504 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:18.603835 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 08 08:25:21.603426 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:21.603361 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 08 08:25:21.611763 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:21.611734 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:21.612294 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:21.612264 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:21.616667 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:21.616640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:23.602908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:23.602866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:24.603727 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:24.603683 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 08 08:25:27.604229 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:27.604196 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:27.604913 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:27.604892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:25:29.106046 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.106010 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc"] Sep 08 08:25:29.108970 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.108945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.109570 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.109550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-registry-tls\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.109863 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.109835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/4ae1e783-d529-42c4-8e96-0c7cedd98b37-kube-api-access-2rzl6\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.109948 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.109908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae1e783-d529-42c4-8e96-0c7cedd98b37-feast-data\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.110011 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.109973 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-online-tls\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.111615 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.111594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 08 08:25:29.111702 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.111598 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 08 08:25:29.111702 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.111601 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 08 08:25:29.111941 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.111920 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-7phnx\"" Sep 08 08:25:29.124580 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.124548 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc"] Sep 08 08:25:29.210271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.210230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/4ae1e783-d529-42c4-8e96-0c7cedd98b37-kube-api-access-2rzl6\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.210271 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.210273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae1e783-d529-42c4-8e96-0c7cedd98b37-feast-data\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.210597 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.210296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-online-tls\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.210597 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.210332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-registry-tls\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.210767 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.210747 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae1e783-d529-42c4-8e96-0c7cedd98b37-feast-data\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.212908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.212879 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-online-tls\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.213028 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.212890 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-registry-tls\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.218742 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.218719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/4ae1e783-d529-42c4-8e96-0c7cedd98b37-kube-api-access-2rzl6\") pod \"feast-driver-ranking-68cd49876b-2nclc\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.417853 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.417748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:29.693152 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.692979 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc"] Sep 08 08:25:29.696868 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:25:29.696838 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae1e783_d529_42c4_8e96_0c7cedd98b37.slice/crio-e752ce1aace419ece7c1c9085645587aebba111295d4603813927a24154c6324 WatchSource:0}: Error finding container e752ce1aace419ece7c1c9085645587aebba111295d4603813927a24154c6324: Status 404 returned error can't find the container with id e752ce1aace419ece7c1c9085645587aebba111295d4603813927a24154c6324 Sep 08 08:25:29.715118 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:29.715085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerStarted","Data":"e752ce1aace419ece7c1c9085645587aebba111295d4603813927a24154c6324"} Sep 08 08:25:30.719765 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:30.719734 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerStarted","Data":"1d9ea45bc34ec0efef5fe1d6021bb90c435907c20f05a408a438bad854226bbc"} Sep 08 08:25:35.739257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:35.739221 2580 generic.go:356] "Generic (PLEG): container finished" podID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerID="1d9ea45bc34ec0efef5fe1d6021bb90c435907c20f05a408a438bad854226bbc" exitCode=0 Sep 08 08:25:35.739655 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:35.739294 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerDied","Data":"1d9ea45bc34ec0efef5fe1d6021bb90c435907c20f05a408a438bad854226bbc"} Sep 08 08:25:36.746059 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:36.746023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerStarted","Data":"b34de32eedab475e5f38599c7bdb42e1f302e119118e21dd49cc587fad4ce169"} Sep 08 08:25:43.773907 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:43.773862 2580 generic.go:356] "Generic (PLEG): container finished" podID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerID="b34de32eedab475e5f38599c7bdb42e1f302e119118e21dd49cc587fad4ce169" exitCode=0 Sep 08 08:25:43.774376 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:43.773935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerDied","Data":"b34de32eedab475e5f38599c7bdb42e1f302e119118e21dd49cc587fad4ce169"} Sep 08 08:25:43.777551 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:43.777523 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 08 08:25:44.781221 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:44.781184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerStarted","Data":"84ff7adc592ef7c4a08df112eaf75d9a76a599c47116c361522e30cc9404b866"} Sep 08 08:25:44.781740 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:44.781287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerStarted","Data":"3383f0eb31f46ccc5f8e3d6e256d6fc60c26708b606527ba65a0d08bee5c1779"} Sep 08 08:25:44.803939 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:44.803868 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podStartSLOduration=15.803841475 podStartE2EDuration="15.803841475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:25:44.80108946 +0000 UTC m=+966.199038754" watchObservedRunningTime="2026-09-08 08:25:44.803841475 +0000 UTC m=+966.201790770" Sep 08 08:25:47.418851 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:47.418808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:47.419332 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:47.418893 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:47.420656 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:47.420623 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused" Sep 08 08:25:47.420656 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:47.420642 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 08 08:25:49.418863 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:49.418824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:49.419265 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:49.418896 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:50.418672 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:50.418613 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused" Sep 08 08:25:50.418866 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:50.418699 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 08 08:25:53.418813 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:53.418759 2580 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused" Sep 08 08:25:53.427427 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:53.427382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:53.432263 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:53.432225 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:56.419328 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:56.419297 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:25:56.420044 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:25:56.420025 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:27:19.787516 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:19.787478 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l"] Sep 08 08:27:19.788108 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:19.787698 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" podUID="8eec51fd-b4d0-4f6b-befd-8a51548c0522" containerName="manager" containerID="cri-o://ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea" gracePeriod=10 Sep 08 08:27:20.069586 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.069554 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:27:20.081221 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.081183 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t"] Sep 08 08:27:20.081489 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.081462 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" containerID="cri-o://d37dd1bc3fee23cd5a148d89aeb034f797de922b2a8c7f8eed0ac59129616957" gracePeriod=30 Sep 08 08:27:20.081579 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.081490 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" containerID="cri-o://bebf1db98855cbf3c4c8cb11e811711acb8ac8ec0dd574f8037def5e48941e40" gracePeriod=30 Sep 08 08:27:20.085752 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.085716 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc"] Sep 08 08:27:20.086012 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.085985 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" containerID="cri-o://3383f0eb31f46ccc5f8e3d6e256d6fc60c26708b606527ba65a0d08bee5c1779" gracePeriod=30 Sep 08 08:27:20.086103 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.086013 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" containerID="cri-o://84ff7adc592ef7c4a08df112eaf75d9a76a599c47116c361522e30cc9404b866" gracePeriod=30 Sep 08 08:27:20.143706 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.143675 2580 generic.go:356] "Generic (PLEG): container finished" podID="8eec51fd-b4d0-4f6b-befd-8a51548c0522" containerID="ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea" exitCode=0 Sep 08 08:27:20.143897 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.143714 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" Sep 08 08:27:20.143897 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.143739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" event={"ID":"8eec51fd-b4d0-4f6b-befd-8a51548c0522","Type":"ContainerDied","Data":"ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea"} Sep 08 08:27:20.143897 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.143781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l" event={"ID":"8eec51fd-b4d0-4f6b-befd-8a51548c0522","Type":"ContainerDied","Data":"bc8184fe306666d23f4de4b3cfac8d81c12c525eba41f249bed6ec29f624c16e"} Sep 08 08:27:20.143897 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.143803 2580 scope.go:117] "RemoveContainer" containerID="ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea" Sep 08 08:27:20.151886 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.151865 2580 scope.go:117] "RemoveContainer" containerID="ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea" Sep 08 08:27:20.152251 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:27:20.152223 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea\": container with ID starting with ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea not found: ID does not exist" containerID="ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea" Sep 08 08:27:20.152309 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.152265 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea"} err="failed to get container status \"ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea\": rpc error: code = NotFound desc = could not find container \"ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea\": container with ID starting with ec5fc82eacc6a561cbd5ca09680dcc0c8d39610ae0b3aa67d23662b05ed30aea not found: ID does not exist" Sep 08 08:27:20.220658 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.220619 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7fqx\" (UniqueName: \"kubernetes.io/projected/8eec51fd-b4d0-4f6b-befd-8a51548c0522-kube-api-access-t7fqx\") pod \"8eec51fd-b4d0-4f6b-befd-8a51548c0522\" (UID: \"8eec51fd-b4d0-4f6b-befd-8a51548c0522\") " Sep 08 08:27:20.222901 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.222860 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eec51fd-b4d0-4f6b-befd-8a51548c0522-kube-api-access-t7fqx" (OuterVolumeSpecName: "kube-api-access-t7fqx") pod "8eec51fd-b4d0-4f6b-befd-8a51548c0522" (UID: "8eec51fd-b4d0-4f6b-befd-8a51548c0522"). InnerVolumeSpecName "kube-api-access-t7fqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:27:20.321994 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.321894 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7fqx\" (UniqueName: \"kubernetes.io/projected/8eec51fd-b4d0-4f6b-befd-8a51548c0522-kube-api-access-t7fqx\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:20.465368 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.465329 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l"] Sep 08 08:27:20.468633 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:20.468598 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6749dbb4bb-p2f8l"] Sep 08 08:27:21.083752 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:21.083721 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eec51fd-b4d0-4f6b-befd-8a51548c0522" path="/var/lib/kubelet/pods/8eec51fd-b4d0-4f6b-befd-8a51548c0522/volumes" Sep 08 08:27:21.149656 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:21.149626 2580 generic.go:356] "Generic (PLEG): container finished" podID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerID="84ff7adc592ef7c4a08df112eaf75d9a76a599c47116c361522e30cc9404b866" exitCode=0 Sep 08 08:27:21.149849 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:21.149695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerDied","Data":"84ff7adc592ef7c4a08df112eaf75d9a76a599c47116c361522e30cc9404b866"} Sep 08 08:27:21.152354 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:21.152324 2580 generic.go:356] "Generic (PLEG): container finished" podID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerID="bebf1db98855cbf3c4c8cb11e811711acb8ac8ec0dd574f8037def5e48941e40" exitCode=0 Sep 08 08:27:21.152522 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:21.152397 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerDied","Data":"bebf1db98855cbf3c4c8cb11e811711acb8ac8ec0dd574f8037def5e48941e40"} Sep 08 08:27:21.613102 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:21.613057 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 08 08:27:22.140481 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.140444 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fkbw8"] Sep 08 08:27:22.140974 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.140625 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" podUID="d16efa39-9079-48d9-be01-96e04e35ea8a" containerName="postgres" containerID="cri-o://9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149" gracePeriod=30 Sep 08 08:27:22.145443 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.145394 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5lb7m"] Sep 08 08:27:22.145658 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.145629 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" podUID="6571adcf-ee72-454b-84fa-5430be0b93e5" containerName="redis" containerID="cri-o://9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8" gracePeriod=30 Sep 08 08:27:22.416872 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.416838 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:27:22.425257 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.425226 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:27:22.539531 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.539493 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d16efa39-9079-48d9-be01-96e04e35ea8a-postgresdata\") pod \"d16efa39-9079-48d9-be01-96e04e35ea8a\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " Sep 08 08:27:22.539740 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.539587 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tsgl\" (UniqueName: \"kubernetes.io/projected/6571adcf-ee72-454b-84fa-5430be0b93e5-kube-api-access-4tsgl\") pod \"6571adcf-ee72-454b-84fa-5430be0b93e5\" (UID: \"6571adcf-ee72-454b-84fa-5430be0b93e5\") " Sep 08 08:27:22.539740 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.539612 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94vrm\" (UniqueName: \"kubernetes.io/projected/d16efa39-9079-48d9-be01-96e04e35ea8a-kube-api-access-94vrm\") pod \"d16efa39-9079-48d9-be01-96e04e35ea8a\" (UID: \"d16efa39-9079-48d9-be01-96e04e35ea8a\") " Sep 08 08:27:22.541937 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.541902 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16efa39-9079-48d9-be01-96e04e35ea8a-kube-api-access-94vrm" (OuterVolumeSpecName: "kube-api-access-94vrm") pod "d16efa39-9079-48d9-be01-96e04e35ea8a" (UID: "d16efa39-9079-48d9-be01-96e04e35ea8a"). InnerVolumeSpecName "kube-api-access-94vrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:27:22.542048 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.541900 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6571adcf-ee72-454b-84fa-5430be0b93e5-kube-api-access-4tsgl" (OuterVolumeSpecName: "kube-api-access-4tsgl") pod "6571adcf-ee72-454b-84fa-5430be0b93e5" (UID: "6571adcf-ee72-454b-84fa-5430be0b93e5"). InnerVolumeSpecName "kube-api-access-4tsgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:27:22.569536 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.569487 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d16efa39-9079-48d9-be01-96e04e35ea8a-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "d16efa39-9079-48d9-be01-96e04e35ea8a" (UID: "d16efa39-9079-48d9-be01-96e04e35ea8a"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:27:22.640193 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.640150 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tsgl\" (UniqueName: \"kubernetes.io/projected/6571adcf-ee72-454b-84fa-5430be0b93e5-kube-api-access-4tsgl\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:22.640193 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.640182 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94vrm\" (UniqueName: \"kubernetes.io/projected/d16efa39-9079-48d9-be01-96e04e35ea8a-kube-api-access-94vrm\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:22.640193 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:22.640193 2580 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/d16efa39-9079-48d9-be01-96e04e35ea8a-postgresdata\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:23.164155 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.164121 2580 generic.go:356] "Generic (PLEG): container finished" podID="6571adcf-ee72-454b-84fa-5430be0b93e5" containerID="9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8" exitCode=0 Sep 08 08:27:23.164626 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.164181 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" Sep 08 08:27:23.164626 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.164215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" event={"ID":"6571adcf-ee72-454b-84fa-5430be0b93e5","Type":"ContainerDied","Data":"9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8"} Sep 08 08:27:23.164626 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.164255 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5lb7m" event={"ID":"6571adcf-ee72-454b-84fa-5430be0b93e5","Type":"ContainerDied","Data":"53e04c1b970617365424af724c90068592bfcf5895f0740df1db7a7ee4713060"} Sep 08 08:27:23.164626 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.164272 2580 scope.go:117] "RemoveContainer" containerID="9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8" Sep 08 08:27:23.165732 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.165697 2580 generic.go:356] "Generic (PLEG): container finished" podID="d16efa39-9079-48d9-be01-96e04e35ea8a" containerID="9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149" exitCode=0 Sep 08 08:27:23.165859 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.165735 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" Sep 08 08:27:23.165859 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.165736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" event={"ID":"d16efa39-9079-48d9-be01-96e04e35ea8a","Type":"ContainerDied","Data":"9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149"} Sep 08 08:27:23.165859 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.165771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fkbw8" event={"ID":"d16efa39-9079-48d9-be01-96e04e35ea8a","Type":"ContainerDied","Data":"2a52f8dfc71db464921183b8088c525bba98f6cf8b2d4d41297b8ff536f52b14"} Sep 08 08:27:23.177123 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.177097 2580 scope.go:117] "RemoveContainer" containerID="9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8" Sep 08 08:27:23.177488 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:27:23.177466 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8\": container with ID starting with 9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8 not found: ID does not exist" containerID="9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8" Sep 08 08:27:23.177535 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.177497 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8"} err="failed to get container status \"9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8\": rpc error: code = NotFound desc = could not find container \"9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8\": container with ID starting with 9651eeccef7d2efd4f6e0d492c38ceed247d1336625f5007f5ce09991da898f8 not found: ID does not exist" Sep 08 08:27:23.177535 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.177516 2580 scope.go:117] "RemoveContainer" containerID="9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149" Sep 08 08:27:23.185566 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.185282 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5lb7m"] Sep 08 08:27:23.185566 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.185527 2580 scope.go:117] "RemoveContainer" containerID="9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149" Sep 08 08:27:23.186014 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:27:23.185991 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149\": container with ID starting with 9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149 not found: ID does not exist" containerID="9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149" Sep 08 08:27:23.186113 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.186023 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149"} err="failed to get container status \"9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149\": rpc error: code = NotFound desc = could not find container \"9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149\": container with ID starting with 9485be882942be43400d6e43746737c15b0465a38aad6b516ac39834882fe149 not found: ID does not exist" Sep 08 08:27:23.186830 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.186812 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5lb7m"] Sep 08 08:27:23.196952 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.196912 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fkbw8"] Sep 08 08:27:23.198694 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.198668 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fkbw8"] Sep 08 08:27:23.428107 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:23.427999 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 08 08:27:25.084302 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:25.084258 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6571adcf-ee72-454b-84fa-5430be0b93e5" path="/var/lib/kubelet/pods/6571adcf-ee72-454b-84fa-5430be0b93e5/volumes" Sep 08 08:27:25.084822 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:25.084775 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16efa39-9079-48d9-be01-96e04e35ea8a" path="/var/lib/kubelet/pods/d16efa39-9079-48d9-be01-96e04e35ea8a/volumes" Sep 08 08:27:31.613164 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:31.613060 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 08 08:27:33.429027 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:33.428986 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 08 08:27:41.612844 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:41.612799 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 08 08:27:41.613253 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:41.612931 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:27:43.428890 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:43.428847 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 08 08:27:43.429342 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:43.428978 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:27:50.272601 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.272568 2580 generic.go:356] "Generic (PLEG): container finished" podID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerID="3383f0eb31f46ccc5f8e3d6e256d6fc60c26708b606527ba65a0d08bee5c1779" exitCode=137 Sep 08 08:27:50.273030 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.272642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerDied","Data":"3383f0eb31f46ccc5f8e3d6e256d6fc60c26708b606527ba65a0d08bee5c1779"} Sep 08 08:27:50.275053 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.275023 2580 generic.go:356] "Generic (PLEG): container finished" podID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerID="d37dd1bc3fee23cd5a148d89aeb034f797de922b2a8c7f8eed0ac59129616957" exitCode=137 Sep 08 08:27:50.275169 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.275060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerDied","Data":"d37dd1bc3fee23cd5a148d89aeb034f797de922b2a8c7f8eed0ac59129616957"} Sep 08 08:27:50.756664 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.756629 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:27:50.759348 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.759326 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:27:50.847907 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847814 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-registry-tls\") pod \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " Sep 08 08:27:50.847907 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847867 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-registry-tls\") pod \"ada31a89-dccf-41b3-b102-11c3f784e57f\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " Sep 08 08:27:50.847907 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847887 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/4ae1e783-d529-42c4-8e96-0c7cedd98b37-kube-api-access-2rzl6\") pod \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " Sep 08 08:27:50.847907 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847905 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada31a89-dccf-41b3-b102-11c3f784e57f-feast-data\") pod \"ada31a89-dccf-41b3-b102-11c3f784e57f\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " Sep 08 08:27:50.848241 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847923 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-online-tls\") pod \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " Sep 08 08:27:50.848241 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847949 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-online-tls\") pod \"ada31a89-dccf-41b3-b102-11c3f784e57f\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " Sep 08 08:27:50.848241 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.847972 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzk2x\" (UniqueName: \"kubernetes.io/projected/ada31a89-dccf-41b3-b102-11c3f784e57f-kube-api-access-tzk2x\") pod \"ada31a89-dccf-41b3-b102-11c3f784e57f\" (UID: \"ada31a89-dccf-41b3-b102-11c3f784e57f\") " Sep 08 08:27:50.848241 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.848023 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae1e783-d529-42c4-8e96-0c7cedd98b37-feast-data\") pod \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\" (UID: \"4ae1e783-d529-42c4-8e96-0c7cedd98b37\") " Sep 08 08:27:50.848713 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.848686 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae1e783-d529-42c4-8e96-0c7cedd98b37-feast-data" (OuterVolumeSpecName: "feast-data") pod "4ae1e783-d529-42c4-8e96-0c7cedd98b37" (UID: "4ae1e783-d529-42c4-8e96-0c7cedd98b37"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:27:50.850451 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.850421 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-online-tls" (OuterVolumeSpecName: "online-tls") pod "ada31a89-dccf-41b3-b102-11c3f784e57f" (UID: "ada31a89-dccf-41b3-b102-11c3f784e57f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:27:50.850647 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.850619 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-online-tls" (OuterVolumeSpecName: "online-tls") pod "4ae1e783-d529-42c4-8e96-0c7cedd98b37" (UID: "4ae1e783-d529-42c4-8e96-0c7cedd98b37"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:27:50.850736 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.850644 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4ae1e783-d529-42c4-8e96-0c7cedd98b37" (UID: "4ae1e783-d529-42c4-8e96-0c7cedd98b37"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:27:50.850736 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.850659 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ada31a89-dccf-41b3-b102-11c3f784e57f" (UID: "ada31a89-dccf-41b3-b102-11c3f784e57f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:27:50.850736 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.850701 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae1e783-d529-42c4-8e96-0c7cedd98b37-kube-api-access-2rzl6" (OuterVolumeSpecName: "kube-api-access-2rzl6") pod "4ae1e783-d529-42c4-8e96-0c7cedd98b37" (UID: "4ae1e783-d529-42c4-8e96-0c7cedd98b37"). InnerVolumeSpecName "kube-api-access-2rzl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:27:50.850896 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.850877 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada31a89-dccf-41b3-b102-11c3f784e57f-kube-api-access-tzk2x" (OuterVolumeSpecName: "kube-api-access-tzk2x") pod "ada31a89-dccf-41b3-b102-11c3f784e57f" (UID: "ada31a89-dccf-41b3-b102-11c3f784e57f"). InnerVolumeSpecName "kube-api-access-tzk2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:27:50.857582 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.857542 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada31a89-dccf-41b3-b102-11c3f784e57f-feast-data" (OuterVolumeSpecName: "feast-data") pod "ada31a89-dccf-41b3-b102-11c3f784e57f" (UID: "ada31a89-dccf-41b3-b102-11c3f784e57f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:27:50.948719 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948674 2580 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-online-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948719 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948715 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzk2x\" (UniqueName: \"kubernetes.io/projected/ada31a89-dccf-41b3-b102-11c3f784e57f-kube-api-access-tzk2x\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948719 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948726 2580 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4ae1e783-d529-42c4-8e96-0c7cedd98b37-feast-data\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948719 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948734 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-registry-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948741 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ada31a89-dccf-41b3-b102-11c3f784e57f-registry-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948749 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rzl6\" (UniqueName: \"kubernetes.io/projected/4ae1e783-d529-42c4-8e96-0c7cedd98b37-kube-api-access-2rzl6\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948757 2580 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ada31a89-dccf-41b3-b102-11c3f784e57f-feast-data\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:50.948962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:50.948764 2580 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4ae1e783-d529-42c4-8e96-0c7cedd98b37-online-tls\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:27:51.280531 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.280506 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" Sep 08 08:27:51.280962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.280539 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t" event={"ID":"ada31a89-dccf-41b3-b102-11c3f784e57f","Type":"ContainerDied","Data":"86c9adfa13764580fbd5c4e4220205e25e128b63f0e00ae7fa310796cbb5c96f"} Sep 08 08:27:51.280962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.280607 2580 scope.go:117] "RemoveContainer" containerID="bebf1db98855cbf3c4c8cb11e811711acb8ac8ec0dd574f8037def5e48941e40" Sep 08 08:27:51.283107 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.283080 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" event={"ID":"4ae1e783-d529-42c4-8e96-0c7cedd98b37","Type":"ContainerDied","Data":"e752ce1aace419ece7c1c9085645587aebba111295d4603813927a24154c6324"} Sep 08 08:27:51.283211 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.283134 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc" Sep 08 08:27:51.289136 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.289095 2580 scope.go:117] "RemoveContainer" containerID="d37dd1bc3fee23cd5a148d89aeb034f797de922b2a8c7f8eed0ac59129616957" Sep 08 08:27:51.296765 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.296740 2580 scope.go:117] "RemoveContainer" containerID="7edd65f5cdd33b0edaca4df74507e0a1734b53c3c079c8251025e4bd7d13d3bf" Sep 08 08:27:51.299588 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.299559 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t"] Sep 08 08:27:51.302854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.302831 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-69fcb577bf-rb92t"] Sep 08 08:27:51.307052 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.307024 2580 scope.go:117] "RemoveContainer" containerID="98a392d2c3d7f247450e6015ed9c6de6c66a4ea176beda2b6479f529143b0c53" Sep 08 08:27:51.315308 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.315285 2580 scope.go:117] "RemoveContainer" containerID="84ff7adc592ef7c4a08df112eaf75d9a76a599c47116c361522e30cc9404b866" Sep 08 08:27:51.315898 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.315874 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc"] Sep 08 08:27:51.319353 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.319329 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-68cd49876b-2nclc"] Sep 08 08:27:51.323676 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.323655 2580 scope.go:117] "RemoveContainer" containerID="3383f0eb31f46ccc5f8e3d6e256d6fc60c26708b606527ba65a0d08bee5c1779" Sep 08 08:27:51.331533 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.331512 2580 scope.go:117] "RemoveContainer" containerID="b34de32eedab475e5f38599c7bdb42e1f302e119118e21dd49cc587fad4ce169" Sep 08 08:27:51.338880 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:51.338861 2580 scope.go:117] "RemoveContainer" containerID="1d9ea45bc34ec0efef5fe1d6021bb90c435907c20f05a408a438bad854226bbc" Sep 08 08:27:53.083343 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:53.083303 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" path="/var/lib/kubelet/pods/4ae1e783-d529-42c4-8e96-0c7cedd98b37/volumes" Sep 08 08:27:53.083842 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:27:53.083823 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" path="/var/lib/kubelet/pods/ada31a89-dccf-41b3-b102-11c3f784e57f/volumes" Sep 08 08:33:31.484795 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484709 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt"] Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484951 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16efa39-9079-48d9-be01-96e04e35ea8a" containerName="postgres" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484962 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16efa39-9079-48d9-be01-96e04e35ea8a" containerName="postgres" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484969 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="feast-init" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484974 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="feast-init" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484981 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484986 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484992 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="feast-apply" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.484998 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="feast-apply" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485010 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485015 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485023 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="feast-init" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485028 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="feast-init" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485038 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6571adcf-ee72-454b-84fa-5430be0b93e5" containerName="redis" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485042 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6571adcf-ee72-454b-84fa-5430be0b93e5" containerName="redis" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485048 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485053 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485060 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eec51fd-b4d0-4f6b-befd-8a51548c0522" containerName="manager" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485065 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eec51fd-b4d0-4f6b-befd-8a51548c0522" containerName="manager" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485071 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485075 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485081 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="feast-apply" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485087 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="feast-apply" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485120 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="online" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485127 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="online" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485134 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6571adcf-ee72-454b-84fa-5430be0b93e5" containerName="redis" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485141 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eec51fd-b4d0-4f6b-befd-8a51548c0522" containerName="manager" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485146 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16efa39-9079-48d9-be01-96e04e35ea8a" containerName="postgres" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485150 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada31a89-dccf-41b3-b102-11c3f784e57f" containerName="registry" Sep 08 08:33:31.485216 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.485156 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae1e783-d529-42c4-8e96-0c7cedd98b37" containerName="registry" Sep 08 08:33:31.491513 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.491476 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:33:31.497680 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.497649 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 08:33:31.498201 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.497678 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-dgk5s\"" Sep 08 08:33:31.498559 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.498542 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 08:33:31.514030 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.513994 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt"] Sep 08 08:33:31.615534 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.615496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcj85\" (UniqueName: \"kubernetes.io/projected/d1ccc50f-ed43-47f0-a7a1-fec834d4ed60-kube-api-access-wcj85\") pod \"feast-operator-controller-manager-689b877b4b-l96lt\" (UID: \"d1ccc50f-ed43-47f0-a7a1-fec834d4ed60\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:33:31.716774 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.716738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcj85\" (UniqueName: \"kubernetes.io/projected/d1ccc50f-ed43-47f0-a7a1-fec834d4ed60-kube-api-access-wcj85\") pod \"feast-operator-controller-manager-689b877b4b-l96lt\" (UID: \"d1ccc50f-ed43-47f0-a7a1-fec834d4ed60\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:33:31.732916 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.732886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcj85\" (UniqueName: \"kubernetes.io/projected/d1ccc50f-ed43-47f0-a7a1-fec834d4ed60-kube-api-access-wcj85\") pod \"feast-operator-controller-manager-689b877b4b-l96lt\" (UID: \"d1ccc50f-ed43-47f0-a7a1-fec834d4ed60\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:33:31.801608 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:31.801498 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:33:32.089446 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:32.089353 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt"] Sep 08 08:33:32.092743 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:33:32.092703 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ccc50f_ed43_47f0_a7a1_fec834d4ed60.slice/crio-33bae41468175124126ddae331d1e35fee60c448986e6dae143e244e3d7eb15d WatchSource:0}: Error finding container 33bae41468175124126ddae331d1e35fee60c448986e6dae143e244e3d7eb15d: Status 404 returned error can't find the container with id 33bae41468175124126ddae331d1e35fee60c448986e6dae143e244e3d7eb15d Sep 08 08:33:32.094683 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:32.094665 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:33:32.408565 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:32.408482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" event={"ID":"d1ccc50f-ed43-47f0-a7a1-fec834d4ed60","Type":"ContainerStarted","Data":"33bae41468175124126ddae331d1e35fee60c448986e6dae143e244e3d7eb15d"} Sep 08 08:33:37.427633 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:37.427593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" event={"ID":"d1ccc50f-ed43-47f0-a7a1-fec834d4ed60","Type":"ContainerStarted","Data":"06d3f2ee220f48b2d7ad1f9196967a352d03d010ba1fbe4dfca33feddb718fdf"} Sep 08 08:33:37.428116 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:37.427720 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:33:37.450354 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:37.450296 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" podStartSLOduration=2.163458851 podStartE2EDuration="6.450278213s" totalImagesPullingTime="4.286819362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:33:37.44897071 +0000 UTC m=+1438.846920016" watchObservedRunningTime="2026-09-08 08:33:37.450278213 +0000 UTC m=+1438.848227507" Sep 08 08:33:48.433523 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:33:48.433491 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l96lt" Sep 08 08:39:17.386980 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.386935 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pswn9/must-gather-lqq78"] Sep 08 08:39:17.390156 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.390132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.392943 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.392910 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pswn9\"/\"default-dockercfg-9bbnt\"" Sep 08 08:39:17.393105 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.393025 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pswn9\"/\"kube-root-ca.crt\"" Sep 08 08:39:17.393890 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.393871 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pswn9\"/\"openshift-service-ca.crt\"" Sep 08 08:39:17.398396 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.398367 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pswn9/must-gather-lqq78"] Sep 08 08:39:17.501814 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.501773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55c7\" (UniqueName: \"kubernetes.io/projected/21f3510e-c29e-4795-9173-68beb4568c52-kube-api-access-d55c7\") pod \"must-gather-lqq78\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.501814 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.501820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3510e-c29e-4795-9173-68beb4568c52-must-gather-output\") pod \"must-gather-lqq78\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.602202 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.602166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55c7\" (UniqueName: \"kubernetes.io/projected/21f3510e-c29e-4795-9173-68beb4568c52-kube-api-access-d55c7\") pod \"must-gather-lqq78\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.602202 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.602210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3510e-c29e-4795-9173-68beb4568c52-must-gather-output\") pod \"must-gather-lqq78\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.602685 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.602667 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3510e-c29e-4795-9173-68beb4568c52-must-gather-output\") pod \"must-gather-lqq78\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.611096 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.611058 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55c7\" (UniqueName: \"kubernetes.io/projected/21f3510e-c29e-4795-9173-68beb4568c52-kube-api-access-d55c7\") pod \"must-gather-lqq78\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.717131 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.717038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:17.987759 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.987723 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pswn9/must-gather-lqq78"] Sep 08 08:39:17.991110 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:39:17.991080 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21f3510e_c29e_4795_9173_68beb4568c52.slice/crio-932b3840eec82bb2c464fd6abfceac57e40b7c5b55debf7b7aa4fa624430cdd8 WatchSource:0}: Error finding container 932b3840eec82bb2c464fd6abfceac57e40b7c5b55debf7b7aa4fa624430cdd8: Status 404 returned error can't find the container with id 932b3840eec82bb2c464fd6abfceac57e40b7c5b55debf7b7aa4fa624430cdd8 Sep 08 08:39:17.992975 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:17.992955 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:39:18.592956 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:18.592922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pswn9/must-gather-lqq78" event={"ID":"21f3510e-c29e-4795-9173-68beb4568c52","Type":"ContainerStarted","Data":"932b3840eec82bb2c464fd6abfceac57e40b7c5b55debf7b7aa4fa624430cdd8"} Sep 08 08:39:25.623809 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:25.623743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pswn9/must-gather-lqq78" event={"ID":"21f3510e-c29e-4795-9173-68beb4568c52","Type":"ContainerStarted","Data":"bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1"} Sep 08 08:39:26.629615 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:26.629573 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pswn9/must-gather-lqq78" event={"ID":"21f3510e-c29e-4795-9173-68beb4568c52","Type":"ContainerStarted","Data":"ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710"} Sep 08 08:39:26.649615 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:26.649554 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pswn9/must-gather-lqq78" podStartSLOduration=2.210614333 podStartE2EDuration="9.649534242s" totalImagesPullingTime="7.438919909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:39:26.647306507 +0000 UTC m=+1788.045255802" watchObservedRunningTime="2026-09-08 08:39:26.649534242 +0000 UTC m=+1788.047483537" Sep 08 08:39:35.662851 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:35.662819 2580 generic.go:356] "Generic (PLEG): container finished" podID="21f3510e-c29e-4795-9173-68beb4568c52" containerID="bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1" exitCode=0 Sep 08 08:39:35.663273 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:35.662902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pswn9/must-gather-lqq78" event={"ID":"21f3510e-c29e-4795-9173-68beb4568c52","Type":"ContainerDied","Data":"bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1"} Sep 08 08:39:35.663273 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:35.663230 2580 scope.go:117] "RemoveContainer" containerID="bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1" Sep 08 08:39:36.476979 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:36.476946 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pswn9_must-gather-lqq78_21f3510e-c29e-4795-9173-68beb4568c52/gather/0.log" Sep 08 08:39:39.814045 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:39.814010 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wdc7x_8baef419-3fad-4acd-a31a-6c22f04b8b7a/global-pull-secret-syncer/0.log" Sep 08 08:39:39.916235 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:39.916206 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qrxvm_cf898da0-c482-407f-8b09-20d34e9578f9/konnectivity-agent/0.log" Sep 08 08:39:39.938724 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:39.938697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-42.ec2.internal_639100c0bcc92b941a8949df16e60bc8/haproxy/0.log" Sep 08 08:39:41.785196 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:41.785158 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-pswn9/must-gather-lqq78"] Sep 08 08:39:41.785642 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:41.785353 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-pswn9/must-gather-lqq78" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="copy" containerID="cri-o://ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710" gracePeriod=2 Sep 08 08:39:41.790893 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:41.790857 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-pswn9/must-gather-lqq78"] Sep 08 08:39:41.792219 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:39:41.792177 2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"21f3510e-c29e-4795-9173-68beb4568c52\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-pswn9\"/\"must-gather-lqq78\": pods \"must-gather-lqq78\" not found" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:42.009315 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.009290 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pswn9_must-gather-lqq78_21f3510e-c29e-4795-9173-68beb4568c52/copy/0.log" Sep 08 08:39:42.010787 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.010763 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:42.013035 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:39:42.013005 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqq78\" is forbidden: User \"system:node:ip-10-0-130-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pswn9\": no relationship found between node 'ip-10-0-130-42.ec2.internal' and this object" podUID="21f3510e-c29e-4795-9173-68beb4568c52" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:42.106602 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.106502 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3510e-c29e-4795-9173-68beb4568c52-must-gather-output\") pod \"21f3510e-c29e-4795-9173-68beb4568c52\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " Sep 08 08:39:42.106602 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.106548 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d55c7\" (UniqueName: \"kubernetes.io/projected/21f3510e-c29e-4795-9173-68beb4568c52-kube-api-access-d55c7\") pod \"21f3510e-c29e-4795-9173-68beb4568c52\" (UID: \"21f3510e-c29e-4795-9173-68beb4568c52\") " Sep 08 08:39:42.106944 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.106917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f3510e-c29e-4795-9173-68beb4568c52-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "21f3510e-c29e-4795-9173-68beb4568c52" (UID: "21f3510e-c29e-4795-9173-68beb4568c52"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:39:42.108854 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.108820 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f3510e-c29e-4795-9173-68beb4568c52-kube-api-access-d55c7" (OuterVolumeSpecName: "kube-api-access-d55c7") pod "21f3510e-c29e-4795-9173-68beb4568c52" (UID: "21f3510e-c29e-4795-9173-68beb4568c52"). InnerVolumeSpecName "kube-api-access-d55c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:39:42.207422 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.207358 2580 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21f3510e-c29e-4795-9173-68beb4568c52-must-gather-output\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:39:42.207422 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.207434 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d55c7\" (UniqueName: \"kubernetes.io/projected/21f3510e-c29e-4795-9173-68beb4568c52-kube-api-access-d55c7\") on node \"ip-10-0-130-42.ec2.internal\" DevicePath \"\"" Sep 08 08:39:42.687131 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.687098 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-pswn9_must-gather-lqq78_21f3510e-c29e-4795-9173-68beb4568c52/copy/0.log" Sep 08 08:39:42.687516 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.687491 2580 generic.go:356] "Generic (PLEG): container finished" podID="21f3510e-c29e-4795-9173-68beb4568c52" containerID="ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710" exitCode=143 Sep 08 08:39:42.687647 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.687553 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:42.687647 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.687592 2580 scope.go:117] "RemoveContainer" containerID="ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710" Sep 08 08:39:42.690097 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:39:42.690064 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqq78\" is forbidden: User \"system:node:ip-10-0-130-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pswn9\": no relationship found between node 'ip-10-0-130-42.ec2.internal' and this object" podUID="21f3510e-c29e-4795-9173-68beb4568c52" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:42.697136 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.697036 2580 scope.go:117] "RemoveContainer" containerID="bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1" Sep 08 08:39:42.700537 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:39:42.700503 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-lqq78\" is forbidden: User \"system:node:ip-10-0-130-42.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-pswn9\": no relationship found between node 'ip-10-0-130-42.ec2.internal' and this object" podUID="21f3510e-c29e-4795-9173-68beb4568c52" pod="openshift-must-gather-pswn9/must-gather-lqq78" Sep 08 08:39:42.710645 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.710619 2580 scope.go:117] "RemoveContainer" containerID="ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710" Sep 08 08:39:42.711024 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:39:42.711000 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710\": container with ID starting with ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710 not found: ID does not exist" containerID="ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710" Sep 08 08:39:42.711067 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.711035 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710"} err="failed to get container status \"ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710\": rpc error: code = NotFound desc = could not find container \"ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710\": container with ID starting with ee517a8ee527902a89f7c0cb5d687707497728f3914abc57b0565b3aac5ee710 not found: ID does not exist" Sep 08 08:39:42.711067 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.711054 2580 scope.go:117] "RemoveContainer" containerID="bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1" Sep 08 08:39:42.711348 ip-10-0-130-42 kubenswrapper[2580]: E0908 08:39:42.711330 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1\": container with ID starting with bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1 not found: ID does not exist" containerID="bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1" Sep 08 08:39:42.711462 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:42.711350 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1"} err="failed to get container status \"bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1\": rpc error: code = NotFound desc = could not find container \"bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1\": container with ID starting with bc9979329aea17110ca59ffda8c3b81d4d9830b0237d36dccad146dd8b025ce1 not found: ID does not exist" Sep 08 08:39:43.083863 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:43.083824 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f3510e-c29e-4795-9173-68beb4568c52" path="/var/lib/kubelet/pods/21f3510e-c29e-4795-9173-68beb4568c52/volumes" Sep 08 08:39:43.918191 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:43.918158 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-x7v8z_0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9/kube-state-metrics/0.log" Sep 08 08:39:43.948695 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:43.948668 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-x7v8z_0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9/kube-rbac-proxy-main/0.log" Sep 08 08:39:43.972721 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:43.972696 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-x7v8z_0038bbb9-4cbd-4fec-a3b4-1c0d8312b8c9/kube-rbac-proxy-self/0.log" Sep 08 08:39:44.005258 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.005230 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-795d888d4f-ww2bh_2b3fa0c8-bf76-4041-a785-c0c390e49dae/metrics-server/0.log" Sep 08 08:39:44.228382 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.228305 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9qq6_ca8b6b33-fc2d-431a-8c42-02dc92f046ac/node-exporter/0.log" Sep 08 08:39:44.253101 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.253069 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9qq6_ca8b6b33-fc2d-431a-8c42-02dc92f046ac/kube-rbac-proxy/0.log" Sep 08 08:39:44.274628 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.274604 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9qq6_ca8b6b33-fc2d-431a-8c42-02dc92f046ac/init-textfile/0.log" Sep 08 08:39:44.644124 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.644099 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d8f6546c4-mt4p6_d4ff19e3-6cf7-453a-9ccb-9254c5c50879/telemeter-client/0.log" Sep 08 08:39:44.672431 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.672392 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d8f6546c4-mt4p6_d4ff19e3-6cf7-453a-9ccb-9254c5c50879/reload/0.log" Sep 08 08:39:44.702686 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:44.702663 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d8f6546c4-mt4p6_d4ff19e3-6cf7-453a-9ccb-9254c5c50879/kube-rbac-proxy/0.log" Sep 08 08:39:47.344347 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344309 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm"] Sep 08 08:39:47.344801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344590 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="gather" Sep 08 08:39:47.344801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344602 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="gather" Sep 08 08:39:47.344801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344613 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="copy" Sep 08 08:39:47.344801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344619 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="copy" Sep 08 08:39:47.344801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344667 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="copy" Sep 08 08:39:47.344801 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.344676 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f3510e-c29e-4795-9173-68beb4568c52" containerName="gather" Sep 08 08:39:47.347892 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.347867 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.350553 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.350530 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nqvlb\"/\"kube-root-ca.crt\"" Sep 08 08:39:47.351267 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.351248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nqvlb\"/\"openshift-service-ca.crt\"" Sep 08 08:39:47.351267 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.351258 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nqvlb\"/\"default-dockercfg-gzzvd\"" Sep 08 08:39:47.357698 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.357671 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm"] Sep 08 08:39:47.446082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.446044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-lib-modules\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.446082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.446088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-sys\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.446306 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.446111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-proc\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.446306 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.446168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-podres\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.446306 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.446222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c76l\" (UniqueName: \"kubernetes.io/projected/d20224d2-2302-4958-bb1e-90d04e345600-kube-api-access-8c76l\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547596 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-lib-modules\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547596 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-sys\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547806 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-proc\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547806 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-lib-modules\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547806 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547777 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-podres\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547813 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-sys\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547831 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-proc\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c76l\" (UniqueName: \"kubernetes.io/projected/d20224d2-2302-4958-bb1e-90d04e345600-kube-api-access-8c76l\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.547908 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.547862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d20224d2-2302-4958-bb1e-90d04e345600-podres\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.555937 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.555904 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c76l\" (UniqueName: \"kubernetes.io/projected/d20224d2-2302-4958-bb1e-90d04e345600-kube-api-access-8c76l\") pod \"perf-node-gather-daemonset-9c6cm\" (UID: \"d20224d2-2302-4958-bb1e-90d04e345600\") " pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.657858 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.657766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:47.931106 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:47.931020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm"] Sep 08 08:39:47.934425 ip-10-0-130-42 kubenswrapper[2580]: W0908 08:39:47.934387 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd20224d2_2302_4958_bb1e_90d04e345600.slice/crio-2dec3cb50c3628588bf84105b3293c08ad06786b03cf53877079a0086f6e01bc WatchSource:0}: Error finding container 2dec3cb50c3628588bf84105b3293c08ad06786b03cf53877079a0086f6e01bc: Status 404 returned error can't find the container with id 2dec3cb50c3628588bf84105b3293c08ad06786b03cf53877079a0086f6e01bc Sep 08 08:39:48.388131 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.388103 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6cz5n_3b12048f-9e72-4242-b86e-442560cd0dca/dns/0.log" Sep 08 08:39:48.410839 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.410814 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6cz5n_3b12048f-9e72-4242-b86e-442560cd0dca/kube-rbac-proxy/0.log" Sep 08 08:39:48.500941 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.500908 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tqjlv_115a5fcc-cda3-4a64-b7ee-21200ecdc1cc/dns-node-resolver/0.log" Sep 08 08:39:48.712863 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.712768 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" event={"ID":"d20224d2-2302-4958-bb1e-90d04e345600","Type":"ContainerStarted","Data":"66243918e001e95d80b05f2f4fa568eb48b71d554b1d03019b6aed2625544a26"} Sep 08 08:39:48.712863 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.712849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" event={"ID":"d20224d2-2302-4958-bb1e-90d04e345600","Type":"ContainerStarted","Data":"2dec3cb50c3628588bf84105b3293c08ad06786b03cf53877079a0086f6e01bc"} Sep 08 08:39:48.713087 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.712943 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:48.730239 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.730184 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" podStartSLOduration=1.7301653369999999 podStartE2EDuration="1.730165337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:39:48.728555761 +0000 UTC m=+1810.126505056" watchObservedRunningTime="2026-09-08 08:39:48.730165337 +0000 UTC m=+1810.128114676" Sep 08 08:39:48.926349 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.926312 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fcfc9b6bb-px2db_00993ed9-0142-49c8-9b46-d3936ec0c83f/registry/0.log" Sep 08 08:39:48.978753 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:48.978679 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g9pwg_a550aec1-3389-4e89-b02f-1c8eb07f3980/node-ca/0.log" Sep 08 08:39:50.012799 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:50.012768 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hlmds_925aa87a-dcad-4d15-9372-c43e1b8c5283/serve-healthcheck-canary/0.log" Sep 08 08:39:50.546888 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:50.546857 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwb8g_6a5151e7-c003-4d4c-bc23-1dd737605e57/kube-rbac-proxy/0.log" Sep 08 08:39:50.567244 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:50.567220 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwb8g_6a5151e7-c003-4d4c-bc23-1dd737605e57/exporter/0.log" Sep 08 08:39:50.588836 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:50.588806 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwb8g_6a5151e7-c003-4d4c-bc23-1dd737605e57/extractor/0.log" Sep 08 08:39:54.726913 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:54.726885 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nqvlb/perf-node-gather-daemonset-9c6cm" Sep 08 08:39:56.174767 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.174736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/kube-multus-additional-cni-plugins/0.log" Sep 08 08:39:56.198593 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.198566 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/egress-router-binary-copy/0.log" Sep 08 08:39:56.220029 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.220001 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/cni-plugins/0.log" Sep 08 08:39:56.242287 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.242260 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/bond-cni-plugin/0.log" Sep 08 08:39:56.267737 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.267711 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/routeoverride-cni/0.log" Sep 08 08:39:56.289229 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.289203 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/whereabouts-cni-bincopy/0.log" Sep 08 08:39:56.314367 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.314337 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zpnjl_01ccc839-5232-4795-a8c8-3fa013abedf0/whereabouts-cni/0.log" Sep 08 08:39:56.530916 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.530887 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lthzv_c8ce4b78-639d-488e-abe0-f64f444873c3/kube-multus/0.log" Sep 08 08:39:56.558623 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.558578 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7dtzg_022f496c-5a6a-4740-82bf-ac92da9ac68b/network-metrics-daemon/0.log" Sep 08 08:39:56.585944 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:56.585920 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7dtzg_022f496c-5a6a-4740-82bf-ac92da9ac68b/kube-rbac-proxy/0.log" Sep 08 08:39:57.623329 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.623282 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/ovn-controller/0.log" Sep 08 08:39:57.644784 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.644759 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/ovn-acl-logging/0.log" Sep 08 08:39:57.668165 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.668126 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/kube-rbac-proxy-node/0.log" Sep 08 08:39:57.696435 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.696395 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 08:39:57.720988 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.720963 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/northd/0.log" Sep 08 08:39:57.744888 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.744861 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/nbdb/0.log" Sep 08 08:39:57.766155 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.766079 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/sbdb/0.log" Sep 08 08:39:57.801082 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:57.801054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-77fzv_b0e723d1-06db-4e84-8fd8-50e671409c4d/ovnkube-controller/0.log" Sep 08 08:39:58.991341 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:58.991306 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nmj4j_a0928b4e-d49f-473e-9262-4e63dbc666e9/network-check-target-container/0.log" Sep 08 08:39:59.870962 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:39:59.870936 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-697tt_fdfe6cd4-fcd2-4e2b-9ea3-e295e07b3e54/iptables-alerter/0.log" Sep 08 08:40:00.494190 ip-10-0-130-42 kubenswrapper[2580]: I0908 08:40:00.494163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-976wb_42f31a0e-8ddd-48cf-acb2-5c3a0929c874/tuned/0.log"