Jul 28 12:04:12.022223 ip-10-0-134-240 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 12:04:12.022232 ip-10-0-134-240 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 12:04:12.022241 ip-10-0-134-240 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 12:04:12.022469 ip-10-0-134-240 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 12:04:22.258195 ip-10-0-134-240 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 12:04:22.258214 ip-10-0-134-240 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 512319ca9bd94125afeeccfdb02e2498 -- Jul 28 12:06:16.661981 ip-10-0-134-240 systemd[1]: Starting Kubernetes Kubelet... Jul 28 12:06:17.069762 ip-10-0-134-240 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:06:17.069762 ip-10-0-134-240 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 12:06:17.069762 ip-10-0-134-240 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:06:17.069762 ip-10-0-134-240 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 12:06:17.069762 ip-10-0-134-240 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 12:06:17.070493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.069833 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 12:06:17.074349 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074330 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:06:17.074349 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074347 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:06:17.074349 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074351 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074354 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074357 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074360 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074363 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074365 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074368 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074371 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074373 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074376 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074379 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074382 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074385 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074387 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074393 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074397 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074402 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074405 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074408 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:06:17.074455 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074411 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074414 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074417 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074420 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074422 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074425 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074427 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074430 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074433 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074435 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074439 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074442 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074445 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074447 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074450 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074453 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074456 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074459 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074462 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074464 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:06:17.074969 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074467 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074470 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074473 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074475 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074478 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074480 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074482 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074485 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074489 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074491 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074494 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074497 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074499 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074502 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074504 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074507 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074509 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074511 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074514 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074517 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:06:17.075452 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074519 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074522 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074525 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074529 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074532 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074536 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074538 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074541 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074543 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074546 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074549 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074551 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074554 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074556 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074559 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074561 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074564 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074566 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074570 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:06:17.075955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074572 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074576 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074579 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074582 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074585 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074588 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074590 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074593 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074596 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074598 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074602 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074605 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074607 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074611 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074614 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074617 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074619 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074622 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:06:17.076431 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.074625 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:06:17.077076 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077063 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:06:17.077076 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077075 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077081 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077085 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077088 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077092 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077095 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077099 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077102 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077105 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077108 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077111 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077114 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077117 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077120 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077123 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077126 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077128 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077131 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077133 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:06:17.077136 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077136 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077139 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077141 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077144 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077147 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077149 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077152 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077154 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077157 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077160 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077162 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077165 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077168 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077170 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077172 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077175 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077177 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077180 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077182 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077184 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:06:17.077609 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077187 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077189 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077191 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077194 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077197 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077199 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077202 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077204 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077207 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077209 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077213 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077215 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077217 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077220 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077223 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077226 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077229 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077231 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077234 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077236 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:06:17.078129 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077239 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077242 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077245 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077247 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077251 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077253 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077256 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077258 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077260 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077263 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077265 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077268 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077270 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077273 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077275 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077277 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077280 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077282 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077285 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077287 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:06:17.078614 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077289 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077292 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077294 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077297 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077300 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077303 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077307 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077311 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077313 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077315 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077318 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077321 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077323 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077326 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077330 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077333 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077336 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077339 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077342 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:06:17.079138 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077810 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077816 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077820 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077823 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077826 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077830 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077834 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077837 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077840 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077842 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077845 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077847 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077850 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077852 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077855 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077857 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077860 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077863 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077865 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:06:17.079608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077869 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077871 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077874 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077878 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077880 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077883 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077885 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077887 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077890 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077892 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077894 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077897 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077900 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077902 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077905 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077909 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077912 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077914 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077916 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077919 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:06:17.080103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077921 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077924 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077927 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077929 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077932 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077935 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077938 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077940 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077942 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077945 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077947 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077950 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077953 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077956 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077960 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077962 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077965 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077967 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077969 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077972 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:06:17.080635 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077974 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077977 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077979 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077981 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077984 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077986 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077989 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077991 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077993 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077996 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.077998 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078000 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078003 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078005 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078007 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078010 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078012 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078015 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078018 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078020 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:06:17.081139 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078022 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078025 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078027 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078030 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078032 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078034 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078037 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078039 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078042 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078044 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078047 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078049 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078051 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078054 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078056 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078059 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078061 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078065 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078068 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078071 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:06:17.081628 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078158 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078172 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078179 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078183 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078187 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078190 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078194 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078199 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078203 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078206 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078209 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078212 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078216 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078218 2565 flags.go:64] FLAG: --cgroup-root="" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078222 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078225 2565 flags.go:64] FLAG: --client-ca-file="" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078228 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078231 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078236 2565 flags.go:64] FLAG: --cluster-domain="" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078239 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078242 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078245 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078248 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078252 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 12:06:17.082155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078255 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078258 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078262 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078265 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078267 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078270 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078274 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078277 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078281 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078284 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078287 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078290 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078293 2565 flags.go:64] FLAG: --enable-server="true" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078296 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078302 2565 flags.go:64] FLAG: --event-burst="100" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078305 2565 flags.go:64] FLAG: --event-qps="50" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078308 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078311 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078314 2565 flags.go:64] FLAG: --eviction-hard="" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078318 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078321 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078324 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078327 2565 flags.go:64] FLAG: --eviction-soft="" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078331 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078333 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 12:06:17.082753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078336 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078339 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078343 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078345 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078348 2565 flags.go:64] FLAG: --feature-gates="" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078352 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078355 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078358 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078361 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078363 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078366 2565 flags.go:64] FLAG: --help="false" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078369 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078372 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078375 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078378 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078382 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078385 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078388 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078391 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078394 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078396 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078403 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078406 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078411 2565 flags.go:64] FLAG: --kube-reserved="" Jul 28 12:06:17.083378 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078414 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078416 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078419 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078422 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078425 2565 flags.go:64] FLAG: --lock-file="" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078428 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078431 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078434 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078439 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078442 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078445 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078447 2565 flags.go:64] FLAG: --logging-format="text" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078450 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078453 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078456 2565 flags.go:64] FLAG: --manifest-url="" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078459 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078463 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078466 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078470 2565 flags.go:64] FLAG: --max-pods="110" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078473 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078476 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078478 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078481 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078485 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078488 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 12:06:17.083976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078491 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078497 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078500 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078503 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078509 2565 flags.go:64] FLAG: --pod-cidr="" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078512 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078516 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078521 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078525 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078528 2565 flags.go:64] FLAG: --port="10250" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078531 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078534 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c24a859a8547a2c0" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078537 2565 flags.go:64] FLAG: --qos-reserved="" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078540 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078543 2565 flags.go:64] FLAG: --register-node="true" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078546 2565 flags.go:64] FLAG: --register-with-taints="" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078550 2565 flags.go:64] FLAG: --registry-burst="10" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078553 2565 flags.go:64] FLAG: --registry-qps="5" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078556 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078558 2565 flags.go:64] FLAG: --reserved-memory="" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078562 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078565 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078568 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078571 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078574 2565 flags.go:64] FLAG: --runonce="false" Jul 28 12:06:17.084577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078577 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078580 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078582 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078585 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078588 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078591 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078595 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078598 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078600 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078603 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078606 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078609 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078612 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078615 2565 flags.go:64] FLAG: --system-cgroups="" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078619 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078626 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078628 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078631 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078636 2565 flags.go:64] FLAG: --tls-min-version="" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078639 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078642 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078645 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078648 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078664 2565 flags.go:64] FLAG: --v="2" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078669 2565 flags.go:64] FLAG: --version="false" Jul 28 12:06:17.085238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078673 2565 flags.go:64] FLAG: --vmodule="" Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078677 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.078680 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078800 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078805 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078808 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078811 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078814 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078818 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078821 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078825 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078829 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078832 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078834 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078838 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078841 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078843 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078846 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078850 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:06:17.085889 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078852 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078854 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078858 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078861 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078864 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078866 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078869 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078871 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078874 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078876 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078879 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078881 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078884 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078886 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078889 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078891 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078894 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078896 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078898 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078901 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:06:17.086345 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078903 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078905 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078908 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078911 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078913 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078915 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078918 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078920 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078923 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078926 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078928 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078931 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078934 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078936 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078940 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078943 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078946 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078948 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078950 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078953 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:06:17.086870 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078955 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078958 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078960 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078963 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078965 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078968 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078971 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078973 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078976 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078978 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078980 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078983 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078985 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078987 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078990 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078992 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078995 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.078997 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079000 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:06:17.087458 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079002 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079005 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079011 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079014 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079017 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079020 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079022 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079026 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079028 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079031 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079033 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079036 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079038 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079041 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079043 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079046 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079048 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079051 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079053 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:06:17.087955 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079056 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:06:17.088434 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079060 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:06:17.088434 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079063 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:06:17.088434 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079067 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:06:17.088434 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.079070 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:06:17.088434 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.079687 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:06:17.096922 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.096896 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 12:06:17.096922 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.096919 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 12:06:17.098030 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.098020 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 12:06:17.098063 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.098036 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 12:06:17.098112 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098103 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:06:17.098112 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098111 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098115 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098119 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098122 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098125 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098128 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098131 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098133 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098136 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098139 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098141 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098144 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098147 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098150 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098152 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098155 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098158 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098160 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098163 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098165 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:06:17.098171 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098168 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098172 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098176 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098179 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098181 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098184 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098187 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098190 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098193 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098195 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098198 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098200 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098202 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098205 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098207 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098210 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098212 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098214 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098217 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:06:17.098673 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098220 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098223 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098225 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098227 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098230 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098232 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098235 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098238 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098241 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098243 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098246 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098248 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098250 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098253 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098255 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098259 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098262 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098264 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098267 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:06:17.099133 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098270 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098272 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098275 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098278 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098281 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098284 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098286 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098289 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098291 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098294 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098297 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098299 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098301 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098304 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098306 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098309 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098313 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098317 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098320 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098323 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:06:17.099593 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098327 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098330 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098333 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098335 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098338 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098341 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098345 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098348 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098352 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098355 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098357 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098360 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098363 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098365 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098368 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098371 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098373 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098376 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098378 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:06:17.100245 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098380 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.098386 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098507 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098513 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098516 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098519 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098522 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098524 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098527 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098529 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098532 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098534 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098537 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098539 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098544 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 12:06:17.100728 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098546 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098549 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098551 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098554 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098556 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098559 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098561 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098565 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098568 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098570 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098573 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098575 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098578 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098580 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098583 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098585 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098588 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098590 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098593 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098596 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 12:06:17.101103 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098598 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098601 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098603 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098606 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098608 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098611 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098613 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098617 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098619 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098622 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098624 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098626 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098632 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098635 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098638 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098641 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098643 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098646 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098648 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 12:06:17.101607 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098667 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098671 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098674 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098677 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098679 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098682 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098685 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098688 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098691 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098693 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098696 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098698 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098701 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098703 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098705 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098708 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098711 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098713 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098716 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 12:06:17.102077 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098720 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098723 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098726 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098729 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098732 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098734 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098737 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098740 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098743 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098745 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098747 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098750 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098752 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098755 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098758 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098760 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098763 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098765 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098768 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098771 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 12:06:17.102536 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098773 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098776 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098778 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098782 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098785 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098787 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098790 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:17.098792 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.098797 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.098934 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 12:06:17.103051 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.102062 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 12:06:17.103541 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.103529 2565 server.go:1019] "Starting client certificate rotation" Jul 28 12:06:17.103664 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.103635 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 12:06:17.103703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.103693 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 12:06:17.106147 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.106134 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 12:06:17.107372 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.107359 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 12:06:17.113015 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.113000 2565 log.go:25] "Validated CRI v1 runtime API" Jul 28 12:06:17.115170 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.115153 2565 log.go:25] "Validated CRI v1 image API" Jul 28 12:06:17.116388 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.116364 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 12:06:17.121506 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.121485 2565 fs.go:135] Filesystem UUIDs: map[1154ce29-4caf-4ab0-846e-eaa09c4f2c55:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8540b074-b4f8-4950-bde4-0af98b2dae39:/dev/nvme0n1p3] Jul 28 12:06:17.121575 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.121505 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 12:06:17.128566 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.128438 2565 manager.go:216] Machine: {Timestamp:2026-07-28 12:06:17.127245892 +0000 UTC m=+0.342959422 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123618 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4603b78082595e82e9d604cfcf23 SystemUUID:ec2a4603-b780-8259-5e82-e9d604cfcf23 BootID:512319ca-9bd9-4125-afee-ccfdb02e2498 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dc:56:41:1a:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dc:56:41:1a:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:cc:d3:59:d1:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 12:06:17.128566 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.128554 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 12:06:17.128737 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.128708 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 12:06:17.130289 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.130258 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 12:06:17.130489 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.130292 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 12:06:17.131840 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.131827 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 12:06:17.131904 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.131846 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 12:06:17.131904 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.131857 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 12:06:17.132498 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.132486 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 12:06:17.133519 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.133501 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 12:06:17.134245 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.134233 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 12:06:17.137941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.137926 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 28 12:06:17.138093 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138082 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 12:06:17.138150 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138124 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 28 12:06:17.138150 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138139 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 12:06:17.138237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138161 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 12:06:17.138237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138177 2565 kubelet.go:398] "Adding apiserver pod source" Jul 28 12:06:17.138237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138190 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 12:06:17.138610 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138596 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 12:06:17.138701 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.138619 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 12:06:17.141815 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.141798 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 12:06:17.143754 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.143738 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 12:06:17.143822 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.143770 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 12:06:17.144324 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144314 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 12:06:17.144357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144329 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 12:06:17.144357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144335 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 12:06:17.144357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144341 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 12:06:17.144357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144350 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 12:06:17.144357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144355 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 12:06:17.144505 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144497 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 12:06:17.144557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144506 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 12:06:17.144557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144513 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 12:06:17.144557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144519 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 12:06:17.144557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144527 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 12:06:17.144557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.144535 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 12:06:17.145171 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.145162 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 12:06:17.145200 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.145171 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 12:06:17.148517 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.148495 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 12:06:17.148717 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.148706 2565 server.go:1268] "Started kubelet" Jul 28 12:06:17.148835 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.148794 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 12:06:17.149087 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.149049 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 12:06:17.149154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.149114 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 12:06:17.149225 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.149201 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 12:06:17.149279 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.149201 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 12:06:17.151081 ip-10-0-134-240 systemd[1]: Started Kubernetes Kubelet. Jul 28 12:06:17.151830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.151261 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 12:06:17.152171 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.152157 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 28 12:06:17.153247 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.153226 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 12:06:17.156753 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.155829 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-240.ec2.internal.18c672aa16a1a478 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-240.ec2.internal,UID:ip-10-0-134-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-240.ec2.internal,},FirstTimestamp:2026-07-28 12:06:17.148679288 +0000 UTC m=+0.364392819,LastTimestamp:2026-07-28 12:06:17.148679288 +0000 UTC m=+0.364392819,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-240.ec2.internal,}" Jul 28 12:06:17.159441 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.159418 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 12:06:17.159523 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.159442 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 12:06:17.159523 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.159515 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t5kkb" Jul 28 12:06:17.159615 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.159552 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.161335 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.160193 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 12:06:17.161335 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161318 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 12:06:17.161485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161348 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 12:06:17.161537 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161527 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 28 12:06:17.161594 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161539 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 28 12:06:17.161633 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161599 2565 factory.go:55] Registering systemd factory Jul 28 12:06:17.161633 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161616 2565 factory.go:223] Registration of the systemd container factory successfully Jul 28 12:06:17.161913 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161887 2565 factory.go:153] Registering CRI-O factory Jul 28 12:06:17.161913 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161908 2565 factory.go:223] Registration of the crio container factory successfully Jul 28 12:06:17.162021 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161958 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 12:06:17.162021 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161980 2565 factory.go:103] Registering Raw factory Jul 28 12:06:17.162021 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.161994 2565 manager.go:1196] Started watching for new ooms in manager Jul 28 12:06:17.162177 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.162151 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 12:06:17.162535 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.162343 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 12:06:17.162535 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.162482 2565 manager.go:349] Starting recovery of all containers Jul 28 12:06:17.168490 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.168463 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t5kkb" Jul 28 12:06:17.174880 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.174862 2565 manager.go:354] Recovery completed Jul 28 12:06:17.176279 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.176262 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 28 12:06:17.179339 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.179327 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.184083 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184066 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.184158 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184099 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.184158 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184112 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.184736 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184720 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 12:06:17.184736 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184730 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.184736 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184735 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 12:06:17.184872 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.184753 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 28 12:06:17.185411 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.185398 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.185467 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.185425 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.185467 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.185435 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.185805 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.185792 2565 policy_none.go:49] "None policy: Start" Jul 28 12:06:17.185839 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.185812 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 12:06:17.185839 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.185826 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 12:06:17.186904 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.186893 2565 policy_none.go:47] "Start" Jul 28 12:06:17.225433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225265 2565 manager.go:337] "Starting Device Plugin manager" Jul 28 12:06:17.225579 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.225460 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 12:06:17.225579 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225473 2565 server.go:87] "Starting device plugin registration server" Jul 28 12:06:17.225749 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225737 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 12:06:17.225793 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225751 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 12:06:17.225850 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225836 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 12:06:17.225930 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225910 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 12:06:17.225930 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.225922 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 12:06:17.226470 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.226447 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 12:06:17.226539 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.226514 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.243736 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.243714 2565 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2598 into the system container \"/system.slice\": " Jul 28 12:06:17.326265 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.326190 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.327217 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.327198 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.327303 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.327230 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.327303 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.327240 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.327303 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.327267 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.336356 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.336327 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.336450 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.336362 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-240.ec2.internal\": node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.336882 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.336851 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 12:06:17.338264 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.338244 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 12:06:17.338356 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.338282 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 12:06:17.338356 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.338304 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 12:06:17.338356 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.338333 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 12:06:17.340648 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.340628 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:06:17.386128 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.386101 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.439260 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.439212 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal"] Jul 28 12:06:17.439370 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.439306 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.441152 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.441136 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.441208 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.441168 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.441208 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.441179 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.442354 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.442342 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.442460 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.442447 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.442495 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.442483 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.443066 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.443050 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.443146 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.443076 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.443146 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.443088 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.443242 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.443157 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.443242 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.443189 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.443242 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.443203 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.444468 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.444449 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.444567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.444480 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 12:06:17.445136 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.445120 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientMemory" Jul 28 12:06:17.445218 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.445146 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 12:06:17.445218 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.445160 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeHasSufficientPID" Jul 28 12:06:17.462934 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.462906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/400b660e2598cf37b7081c7128e52a11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"400b660e2598cf37b7081c7128e52a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.463032 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.462955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/400b660e2598cf37b7081c7128e52a11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"400b660e2598cf37b7081c7128e52a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.463032 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.462973 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b70634fadc0c17920af7cef2bc204f24-config\") pod \"kube-apiserver-proxy-ip-10-0-134-240.ec2.internal\" (UID: \"b70634fadc0c17920af7cef2bc204f24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.470413 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.470395 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-240.ec2.internal\" not found" node="ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.475071 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.475051 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-240.ec2.internal\" not found" node="ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.486362 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.486345 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.563224 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.563189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/400b660e2598cf37b7081c7128e52a11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"400b660e2598cf37b7081c7128e52a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.563224 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.563221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/400b660e2598cf37b7081c7128e52a11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"400b660e2598cf37b7081c7128e52a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.563419 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.563238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b70634fadc0c17920af7cef2bc204f24-config\") pod \"kube-apiserver-proxy-ip-10-0-134-240.ec2.internal\" (UID: \"b70634fadc0c17920af7cef2bc204f24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.563419 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.563284 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/400b660e2598cf37b7081c7128e52a11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"400b660e2598cf37b7081c7128e52a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.563419 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.563337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/400b660e2598cf37b7081c7128e52a11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal\" (UID: \"400b660e2598cf37b7081c7128e52a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.563419 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.563365 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b70634fadc0c17920af7cef2bc204f24-config\") pod \"kube-apiserver-proxy-ip-10-0-134-240.ec2.internal\" (UID: \"b70634fadc0c17920af7cef2bc204f24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.587380 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.587313 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.688278 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.688230 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.773860 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.773811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.779154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:17.779135 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" Jul 28 12:06:17.789320 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.789298 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.889947 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.889847 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:17.990544 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:17.990509 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.091165 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:18.091117 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.103304 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.103271 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 12:06:18.103448 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.103430 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 12:06:18.174076 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.173979 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 12:01:17 +0000 UTC" deadline="2028-03-14 21:56:37.542326808 +0000 UTC" Jul 28 12:06:18.174076 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.174014 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14289h50m19.368316012s" Jul 28 12:06:18.192168 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:18.192140 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.292960 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:18.292923 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.348724 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:18.348681 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70634fadc0c17920af7cef2bc204f24.slice/crio-f15bc5db032ab3a592d4854e60d224445e5675c525abb4a8c35af4ef35106bee WatchSource:0}: Error finding container f15bc5db032ab3a592d4854e60d224445e5675c525abb4a8c35af4ef35106bee: Status 404 returned error can't find the container with id f15bc5db032ab3a592d4854e60d224445e5675c525abb4a8c35af4ef35106bee Jul 28 12:06:18.350762 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:18.350553 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400b660e2598cf37b7081c7128e52a11.slice/crio-04c05d305df05066ee82a5aa2cd938f374a8b9d53b2f2d5c66c89f3571c61cee WatchSource:0}: Error finding container 04c05d305df05066ee82a5aa2cd938f374a8b9d53b2f2d5c66c89f3571c61cee: Status 404 returned error can't find the container with id 04c05d305df05066ee82a5aa2cd938f374a8b9d53b2f2d5c66c89f3571c61cee Jul 28 12:06:18.356344 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.356322 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:06:18.393951 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:18.393918 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.494668 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:18.494554 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.519641 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.519615 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:06:18.596256 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:18.596202 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-240.ec2.internal\" not found" Jul 28 12:06:18.621953 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.621924 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:06:18.624040 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.624018 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:06:18.659800 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.659759 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" Jul 28 12:06:18.676588 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.676550 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 12:06:18.677723 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.677706 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" Jul 28 12:06:18.687312 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.687288 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 12:06:18.919145 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:18.919053 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 12:06:19.139320 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.139282 2565 apiserver.go:52] "Watching apiserver" Jul 28 12:06:19.149859 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.149822 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 12:06:19.151303 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.151268 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-gx2nl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-ksg7x","kube-system/konnectivity-agent-jnvzp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr","openshift-dns/node-resolver-m4p26","openshift-multus/multus-additional-cni-plugins-ngrlm","openshift-multus/multus-c27fg","openshift-multus/network-metrics-daemon-qd9sp","openshift-network-diagnostics/network-check-target-w2mr5","openshift-network-operator/iptables-alerter-8r2g5","kube-system/global-pull-secret-syncer-5b4gp","kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8llhh"] Jul 28 12:06:19.153310 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.153284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.155470 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.155441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.156912 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.156882 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.158440 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.158417 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.159651 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.159631 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 12:06:19.159788 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.159771 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.162763 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.162326 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.164063 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.164041 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.164235 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.164204 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:19.165703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.165681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.167025 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.167002 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.168685 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.168661 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:19.168819 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.168772 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:19.169554 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.169502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.171015 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.170995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.171087 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.171071 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:19.172990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.172825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd-konnectivity-ca\") pod \"konnectivity-agent-jnvzp\" (UID: \"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd\") " pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.172990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.172865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4xzx\" (UniqueName: \"kubernetes.io/projected/33ef797f-621e-497a-bf03-f0881b179e22-kube-api-access-m4xzx\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.172990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.172895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.172990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.172931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbzsf\" (UniqueName: \"kubernetes.io/projected/c1a172ba-8701-4c27-9c72-8d37dda47333-kube-api-access-zbzsf\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.172990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.172960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/706a5828-b3c1-4947-acae-f3daac313363-host-slash\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.173194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.172995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovnkube-config\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-socket-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.173194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-registration-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.173194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-device-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.173194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d6f68fb-32bf-494e-83b9-9f79f6115e71-hosts-file\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6f68fb-32bf-494e-83b9-9f79f6115e71-tmp-dir\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-cnibin\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v4g5\" (UniqueName: \"kubernetes.io/projected/706a5828-b3c1-4947-acae-f3daac313363-kube-api-access-6v4g5\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-run-netns\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-ovn\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-cni-netd\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-env-overrides\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovn-node-metrics-cert\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovnkube-script-lib\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd-agent-certs\") pod \"konnectivity-agent-jnvzp\" (UID: \"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd\") " pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-system-cni-dir\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-slash\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-node-log\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-cni-bin\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-sys-fs\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-systemd-units\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-var-lib-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-etc-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.173936 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.173880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/706a5828-b3c1-4947-acae-f3daac313363-iptables-alerter-script\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-kubelet\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-log-socket\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxmw\" (UniqueName: \"kubernetes.io/projected/7d6f68fb-32bf-494e-83b9-9f79f6115e71-kube-api-access-4hxmw\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-systemd\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-os-release\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.174492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.174925 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.174503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr4p2\" (UniqueName: \"kubernetes.io/projected/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-kube-api-access-hr4p2\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.177532 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.177507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.177615 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.177539 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 12:06:19.178127 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.178109 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.178466 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.178434 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.178775 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.179294 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.179307 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.179464 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.179993 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180040 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180086 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180127 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180305 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180473 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180767 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.180927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181408 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181466 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mgvkm\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181512 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181555 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181679 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.181916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.181874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 12:06:19.182758 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.182295 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gw884\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.183990 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-69f9v\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184098 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2xmw\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184147 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m9pnd\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xd5b5\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qz5td\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184398 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184469 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184535 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-crf9p\"" Jul 28 12:06:19.184637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184621 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-msj8h\"" Jul 28 12:06:19.185204 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184714 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.185204 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.184749 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 12:06:19.185350 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.185324 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 12:06:19.201940 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.201769 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 12:06:19.226059 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.226028 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lwckr" Jul 28 12:06:19.236604 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.236200 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lwckr" Jul 28 12:06:19.263673 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.263620 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 12:06:19.275873 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.275835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/706a5828-b3c1-4947-acae-f3daac313363-host-slash\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.275873 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.275885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-modprobe-d\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.275920 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-multus-certs\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.275952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-socket-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.275978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-registration-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.275983 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/706a5828-b3c1-4947-acae-f3daac313363-host-slash\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-env-overrides\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-cni-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-daemon-config\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1541d440-2a02-4d0a-b5d0-11e508b08ecb-host\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysctl-conf\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276112 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-registration-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.276148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v4g5\" (UniqueName: \"kubernetes.io/projected/706a5828-b3c1-4947-acae-f3daac313363-kube-api-access-6v4g5\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovn-node-metrics-cert\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysconfig\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-cnibin\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-os-release\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-cni-multus\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd-agent-certs\") pod \"konnectivity-agent-jnvzp\" (UID: \"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd\") " pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-system-cni-dir\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndkfh\" (UniqueName: \"kubernetes.io/projected/b33359e2-316a-4f52-9ec2-13cf860641bf-kube-api-access-ndkfh\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-system-cni-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-kubelet\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-hostroot\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-netns\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21f28e07-939d-4582-8596-26d60b09037f-kubelet-config\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-env-overrides\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-log-socket\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.276819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-host\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxmw\" (UniqueName: \"kubernetes.io/projected/7d6f68fb-32bf-494e-83b9-9f79f6115e71-kube-api-access-4hxmw\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-os-release\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysctl-d\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-conf-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-kubernetes\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276874 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-socket-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276897 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbzsf\" (UniqueName: \"kubernetes.io/projected/c1a172ba-8701-4c27-9c72-8d37dda47333-kube-api-access-zbzsf\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.276973 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovnkube-config\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-k8s-cni-cncf-io\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-device-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.277650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d6f68fb-32bf-494e-83b9-9f79f6115e71-hosts-file\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6f68fb-32bf-494e-83b9-9f79f6115e71-tmp-dir\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-cnibin\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0444982b-3cdd-48a2-bcf3-b181c07b7537-cni-binary-copy\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277222 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d6f68fb-32bf-494e-83b9-9f79f6115e71-hosts-file\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277236 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-device-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277276 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-etc-selinux\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277284 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-log-socket\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-socket-dir-parent\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277322 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277358 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-system-cni-dir\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d6f68fb-32bf-494e-83b9-9f79f6115e71-tmp-dir\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-systemd\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-run-netns\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.278524 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277560 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-os-release\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-ovn\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277626 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-run-netns\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277667 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-cnibin\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-cni-netd\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovnkube-script-lib\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-cni-netd\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277756 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-lib-modules\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1541d440-2a02-4d0a-b5d0-11e508b08ecb-serviceca\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovnkube-config\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277868 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-ovn\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277868 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.277951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-slash\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-node-log\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-cni-bin\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-var-lib-kubelet\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1a172ba-8701-4c27-9c72-8d37dda47333-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-tuned\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278087 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-slash\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278158 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-node-log\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-etc-kubernetes\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278241 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-cni-bin\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-sys-fs\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278326 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-sys-fs\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-systemd-units\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278371 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovnkube-script-lib\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-var-lib-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278420 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-systemd-units\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-etc-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-var-lib-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.279857 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278504 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-etc-openvswitch\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-sys\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-cni-bin\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jtd\" (UniqueName: \"kubernetes.io/projected/0444982b-3cdd-48a2-bcf3-b181c07b7537-kube-api-access-p2jtd\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278784 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/706a5828-b3c1-4947-acae-f3daac313363-iptables-alerter-script\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278797 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33ef797f-621e-497a-bf03-f0881b179e22-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-kubelet\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-run\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.278926 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpt79\" (UniqueName: \"kubernetes.io/projected/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-kube-api-access-jpt79\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279106 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-host-kubelet\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279151 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zpwb\" (UniqueName: \"kubernetes.io/projected/1541d440-2a02-4d0a-b5d0-11e508b08ecb-kube-api-access-7zpwb\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-systemd\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-tmp\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr4p2\" (UniqueName: \"kubernetes.io/projected/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-kube-api-access-hr4p2\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21f28e07-939d-4582-8596-26d60b09037f-dbus\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.280619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd-konnectivity-ca\") pod \"konnectivity-agent-jnvzp\" (UID: \"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd\") " pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.281405 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.279388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4xzx\" (UniqueName: \"kubernetes.io/projected/33ef797f-621e-497a-bf03-f0881b179e22-kube-api-access-m4xzx\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.281405 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.280267 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-run-systemd\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.281405 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.280361 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd-konnectivity-ca\") pod \"konnectivity-agent-jnvzp\" (UID: \"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd\") " pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.281405 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.280384 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1a172ba-8701-4c27-9c72-8d37dda47333-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.281405 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.280513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/706a5828-b3c1-4947-acae-f3daac313363-iptables-alerter-script\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.281650 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.281504 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-ovn-node-metrics-cert\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.281713 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.281684 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd-agent-certs\") pod \"konnectivity-agent-jnvzp\" (UID: \"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd\") " pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.292224 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.292149 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbzsf\" (UniqueName: \"kubernetes.io/projected/c1a172ba-8701-4c27-9c72-8d37dda47333-kube-api-access-zbzsf\") pod \"multus-additional-cni-plugins-ngrlm\" (UID: \"c1a172ba-8701-4c27-9c72-8d37dda47333\") " pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.292384 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.292230 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr4p2\" (UniqueName: \"kubernetes.io/projected/83541d93-1f2d-42d5-9a44-40e0fd8a1e60-kube-api-access-hr4p2\") pod \"ovnkube-node-ksg7x\" (UID: \"83541d93-1f2d-42d5-9a44-40e0fd8a1e60\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.292564 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.292528 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxmw\" (UniqueName: \"kubernetes.io/projected/7d6f68fb-32bf-494e-83b9-9f79f6115e71-kube-api-access-4hxmw\") pod \"node-resolver-m4p26\" (UID: \"7d6f68fb-32bf-494e-83b9-9f79f6115e71\") " pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.293811 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.293777 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4xzx\" (UniqueName: \"kubernetes.io/projected/33ef797f-621e-497a-bf03-f0881b179e22-kube-api-access-m4xzx\") pod \"aws-ebs-csi-driver-node-w4kbr\" (UID: \"33ef797f-621e-497a-bf03-f0881b179e22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.294169 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.294148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v4g5\" (UniqueName: \"kubernetes.io/projected/706a5828-b3c1-4947-acae-f3daac313363-kube-api-access-6v4g5\") pod \"iptables-alerter-8r2g5\" (UID: \"706a5828-b3c1-4947-acae-f3daac313363\") " pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.344772 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.344702 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" event={"ID":"b70634fadc0c17920af7cef2bc204f24","Type":"ContainerStarted","Data":"f15bc5db032ab3a592d4854e60d224445e5675c525abb4a8c35af4ef35106bee"} Jul 28 12:06:19.346910 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.346873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"400b660e2598cf37b7081c7128e52a11","Type":"ContainerStarted","Data":"04c05d305df05066ee82a5aa2cd938f374a8b9d53b2f2d5c66c89f3571c61cee"} Jul 28 12:06:19.380044 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.379998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-netns\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.380250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21f28e07-939d-4582-8596-26d60b09037f-kubelet-config\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.380250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380138 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21f28e07-939d-4582-8596-26d60b09037f-kubelet-config\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.380250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380139 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-netns\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.380250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-host\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.380250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.380250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysctl-d\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-conf-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-kubernetes\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-k8s-cni-cncf-io\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0444982b-3cdd-48a2-bcf3-b181c07b7537-cni-binary-copy\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.380372 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380381 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-socket-dir-parent\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-systemd\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.380489 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:06:19.88044247 +0000 UTC m=+3.096156016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380497 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-systemd\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-lib-modules\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.380567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380558 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-host\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1541d440-2a02-4d0a-b5d0-11e508b08ecb-serviceca\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-var-lib-kubelet\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-tuned\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-etc-kubernetes\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-sys\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-cni-bin\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jtd\" (UniqueName: \"kubernetes.io/projected/0444982b-3cdd-48a2-bcf3-b181c07b7537-kube-api-access-p2jtd\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-run\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpt79\" (UniqueName: \"kubernetes.io/projected/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-kube-api-access-jpt79\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zpwb\" (UniqueName: \"kubernetes.io/projected/1541d440-2a02-4d0a-b5d0-11e508b08ecb-kube-api-access-7zpwb\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-tmp\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21f28e07-939d-4582-8596-26d60b09037f-dbus\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-modprobe-d\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380968 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-lib-modules\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.380979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-multus-certs\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-cni-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381028 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-multus-certs\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.381288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-daemon-config\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1541d440-2a02-4d0a-b5d0-11e508b08ecb-host\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysctl-conf\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysconfig\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-cnibin\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-os-release\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-cni-multus\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndkfh\" (UniqueName: \"kubernetes.io/projected/b33359e2-316a-4f52-9ec2-13cf860641bf-kube-api-access-ndkfh\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-system-cni-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-kubelet\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-hostroot\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-hostroot\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381598 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-daemon-config\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysctl-d\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381812 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-conf-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381868 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-kubernetes\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381914 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-run-k8s-cni-cncf-io\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.382209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.381945 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1541d440-2a02-4d0a-b5d0-11e508b08ecb-serviceca\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382019 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-var-lib-kubelet\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0444982b-3cdd-48a2-bcf3-b181c07b7537-cni-binary-copy\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-modprobe-d\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382606 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-cni-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-etc-kubernetes\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382668 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-run\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382765 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-sys\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-multus-socket-dir-parent\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-cni-bin\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382833 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-os-release\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.382884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1541d440-2a02-4d0a-b5d0-11e508b08ecb-host\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383026 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysctl-conf\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383080 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-sysconfig\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.383148 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383134 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-cnibin\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383683 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383178 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-cni-multus\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383683 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383230 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-system-cni-dir\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383683 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0444982b-3cdd-48a2-bcf3-b181c07b7537-host-var-lib-kubelet\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.383683 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.383334 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:19.383683 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.383356 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21f28e07-939d-4582-8596-26d60b09037f-dbus\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.383683 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.383412 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:06:19.883390917 +0000 UTC m=+3.099104461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:19.385642 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.385614 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-etc-tuned\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.391858 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.391829 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:19.391858 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.391861 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:19.392031 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.391877 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:19.392031 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.391953 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:19.891937598 +0000 UTC m=+3.107651135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:19.393366 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.393339 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-tmp\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.398336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.398273 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zpwb\" (UniqueName: \"kubernetes.io/projected/1541d440-2a02-4d0a-b5d0-11e508b08ecb-kube-api-access-7zpwb\") pod \"node-ca-gx2nl\" (UID: \"1541d440-2a02-4d0a-b5d0-11e508b08ecb\") " pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.399472 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.399439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpt79\" (UniqueName: \"kubernetes.io/projected/1ecc9a4e-2d4f-442b-92fd-1f5c692ca308-kube-api-access-jpt79\") pod \"tuned-8llhh\" (UID: \"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308\") " pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.399967 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.399946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndkfh\" (UniqueName: \"kubernetes.io/projected/b33359e2-316a-4f52-9ec2-13cf860641bf-kube-api-access-ndkfh\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.402532 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.402500 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jtd\" (UniqueName: \"kubernetes.io/projected/0444982b-3cdd-48a2-bcf3-b181c07b7537-kube-api-access-p2jtd\") pod \"multus-c27fg\" (UID: \"0444982b-3cdd-48a2-bcf3-b181c07b7537\") " pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.468777 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.468679 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" Jul 28 12:06:19.486357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.486319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8r2g5" Jul 28 12:06:19.497679 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.497624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:19.505867 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.505813 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:19.514265 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.514232 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" Jul 28 12:06:19.525223 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.525196 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4p26" Jul 28 12:06:19.535206 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.535177 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8llhh" Jul 28 12:06:19.543589 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.543554 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c27fg" Jul 28 12:06:19.552729 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.552694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gx2nl" Jul 28 12:06:19.886672 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.886556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:19.886672 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.886666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:19.886904 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.886743 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:19.886904 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.886794 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:19.886904 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.886827 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:06:20.886803902 +0000 UTC m=+4.102517436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:19.886904 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.886846 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:06:20.886837171 +0000 UTC m=+4.102550694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:19.988010 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:19.987961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:19.988219 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.988186 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:19.988219 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.988215 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:19.988327 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.988230 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:19.988327 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:19.988313 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:20.988289236 +0000 UTC m=+4.204002780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:20.238689 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:20.238531 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:01:19 +0000 UTC" deadline="2028-03-21 11:34:57.329322874 +0000 UTC" Jul 28 12:06:20.238689 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:20.238613 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14447h28m37.090714335s" Jul 28 12:06:20.339545 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:20.339500 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:20.339755 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.339656 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:20.421608 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:20.421436 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83541d93_1f2d_42d5_9a44_40e0fd8a1e60.slice/crio-eb7af027344e1994d335de963611e77c7488f570f3b6fe586be43fb67010f481 WatchSource:0}: Error finding container eb7af027344e1994d335de963611e77c7488f570f3b6fe586be43fb67010f481: Status 404 returned error can't find the container with id eb7af027344e1994d335de963611e77c7488f570f3b6fe586be43fb67010f481 Jul 28 12:06:20.424313 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:20.424280 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a172ba_8701_4c27_9c72_8d37dda47333.slice/crio-574e8a2dd5a0d7a0935ed158bec57d85de87df869015b82ad2863ac0d60cb099 WatchSource:0}: Error finding container 574e8a2dd5a0d7a0935ed158bec57d85de87df869015b82ad2863ac0d60cb099: Status 404 returned error can't find the container with id 574e8a2dd5a0d7a0935ed158bec57d85de87df869015b82ad2863ac0d60cb099 Jul 28 12:06:20.427581 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:20.427549 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abc18af_7ab0_40e5_b9a3_3bb6f4e232bd.slice/crio-7897237ad3349e2d51408b2b3c1a7f4c164ed4da5401dbf4a6a8b58a46264899 WatchSource:0}: Error finding container 7897237ad3349e2d51408b2b3c1a7f4c164ed4da5401dbf4a6a8b58a46264899: Status 404 returned error can't find the container with id 7897237ad3349e2d51408b2b3c1a7f4c164ed4da5401dbf4a6a8b58a46264899 Jul 28 12:06:20.428260 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:20.428235 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecc9a4e_2d4f_442b_92fd_1f5c692ca308.slice/crio-7969f4d0a28097b370f5370b26a144c5bb8a225370b008e6fe230b375a532f1e WatchSource:0}: Error finding container 7969f4d0a28097b370f5370b26a144c5bb8a225370b008e6fe230b375a532f1e: Status 404 returned error can't find the container with id 7969f4d0a28097b370f5370b26a144c5bb8a225370b008e6fe230b375a532f1e Jul 28 12:06:20.896571 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:20.896053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:20.896571 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:20.896384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:20.896571 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.896203 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:20.896571 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.896489 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:06:22.89646644 +0000 UTC m=+6.112179980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:20.896571 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.896511 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:20.896571 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.896547 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:06:22.89653634 +0000 UTC m=+6.112249873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:20.997427 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:20.997383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:20.997646 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.997554 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:20.997646 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.997576 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:20.997646 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.997591 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:20.997894 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:20.997653 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:22.997634874 +0000 UTC m=+6.213348397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:21.239580 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.239443 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:01:19 +0000 UTC" deadline="2028-03-03 17:53:34.607523921 +0000 UTC" Jul 28 12:06:21.239580 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.239486 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14021h47m13.368043772s" Jul 28 12:06:21.342035 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.341280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:21.342035 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:21.341420 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:21.342035 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.341862 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:21.342035 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:21.341971 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:21.377575 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.377535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"400b660e2598cf37b7081c7128e52a11","Type":"ContainerDied","Data":"fd2dec987475674855f550a7613524cb9be0c134ff4095c1ca8f548bd4274658"} Jul 28 12:06:21.377888 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.376820 2565 generic.go:356] "Generic (PLEG): container finished" podID="400b660e2598cf37b7081c7128e52a11" containerID="fd2dec987475674855f550a7613524cb9be0c134ff4095c1ca8f548bd4274658" exitCode=0 Jul 28 12:06:21.422583 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.422487 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" event={"ID":"33ef797f-621e-497a-bf03-f0881b179e22","Type":"ContainerStarted","Data":"ae119166c6c64c06b5147330e35c34dbeffef1293d07440015b025962d57f1dc"} Jul 28 12:06:21.445793 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.445750 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gx2nl" event={"ID":"1541d440-2a02-4d0a-b5d0-11e508b08ecb","Type":"ContainerStarted","Data":"ec87525b881e16d8a6a55fa3ac7668f5e7e708f86fa259670656dc60c94ea482"} Jul 28 12:06:21.458028 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.457978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c27fg" event={"ID":"0444982b-3cdd-48a2-bcf3-b181c07b7537","Type":"ContainerStarted","Data":"5fc32824ce6021ad32f6d379c6b6138f9ee325cf57f6e7971e8e7f75f12e2de1"} Jul 28 12:06:21.471628 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.471519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jnvzp" event={"ID":"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd","Type":"ContainerStarted","Data":"7897237ad3349e2d51408b2b3c1a7f4c164ed4da5401dbf4a6a8b58a46264899"} Jul 28 12:06:21.494818 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.494058 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" event={"ID":"b70634fadc0c17920af7cef2bc204f24","Type":"ContainerStarted","Data":"e777352121fef9fdc9fa9f8c59a54cca8ec36d4d29fdde57478219c6fd68edff"} Jul 28 12:06:21.497748 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.497717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8r2g5" event={"ID":"706a5828-b3c1-4947-acae-f3daac313363","Type":"ContainerStarted","Data":"14a2efc031813c8efa3a6d4fbc8d246b7b6b02f4c01521b5c36eae2056499b10"} Jul 28 12:06:21.513297 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.513233 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-240.ec2.internal" podStartSLOduration=3.513206444 podStartE2EDuration="3.513206444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:21.512561711 +0000 UTC m=+4.728275255" watchObservedRunningTime="2026-07-28 12:06:21.513206444 +0000 UTC m=+4.728920005" Jul 28 12:06:21.514305 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.514270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4p26" event={"ID":"7d6f68fb-32bf-494e-83b9-9f79f6115e71","Type":"ContainerStarted","Data":"6c38406d6e2c9ba95c63be2279636b1c3bed64c5c5a2e6e4b72c9ac6130f5787"} Jul 28 12:06:21.527810 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.527690 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8llhh" event={"ID":"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308","Type":"ContainerStarted","Data":"7969f4d0a28097b370f5370b26a144c5bb8a225370b008e6fe230b375a532f1e"} Jul 28 12:06:21.535123 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.535023 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerStarted","Data":"574e8a2dd5a0d7a0935ed158bec57d85de87df869015b82ad2863ac0d60cb099"} Jul 28 12:06:21.538763 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:21.538709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"eb7af027344e1994d335de963611e77c7488f570f3b6fe586be43fb67010f481"} Jul 28 12:06:22.339892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:22.339358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:22.339892 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:22.339503 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:22.568743 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:22.568706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" event={"ID":"400b660e2598cf37b7081c7128e52a11","Type":"ContainerStarted","Data":"e5a5e2d92c066ba600bea4e01f4240296b228a6047064e0a413fde7bb32aec9f"} Jul 28 12:06:22.915031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:22.914194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:22.915031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:22.914310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:22.915031 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:22.914440 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:22.915031 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:22.914511 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:06:26.914485562 +0000 UTC m=+10.130199091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:22.915031 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:22.914939 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:22.915031 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:22.914994 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:06:26.914977684 +0000 UTC m=+10.130691221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:23.015474 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:23.015305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:23.015799 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:23.015501 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:23.015799 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:23.015532 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:23.015799 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:23.015546 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:23.015799 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:23.015617 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:27.01559513 +0000 UTC m=+10.231308663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:23.339747 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:23.339118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:23.339747 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:23.339248 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:23.340155 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:23.339980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:23.340155 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:23.340109 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:24.339497 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:24.339456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:24.339721 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:24.339605 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:25.342137 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:25.341376 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:25.342137 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:25.341506 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:25.342137 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:25.341970 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:25.342137 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:25.342087 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:26.339071 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:26.338987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:26.339245 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:26.339128 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:26.951861 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:26.951623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:26.951861 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:26.951739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:26.951861 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:26.951781 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:26.951861 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:26.951814 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:26.951861 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:26.951848 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:06:34.951827852 +0000 UTC m=+18.167541388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:26.951861 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:26.951865 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:06:34.951857154 +0000 UTC m=+18.167570675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:27.052609 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:27.052566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:27.052821 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:27.052793 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:27.052821 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:27.052816 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:27.052902 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:27.052830 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:27.052958 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:27.052903 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:35.052883845 +0000 UTC m=+18.268597380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:27.340400 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:27.340310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:27.340572 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:27.340440 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:27.340572 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:27.340496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:27.340700 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:27.340630 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:28.339426 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:28.338874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:28.339426 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:28.339022 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:29.340891 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:29.340797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:29.341348 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:29.340932 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:29.341348 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:29.341045 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:29.341348 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:29.340928 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:30.339298 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:30.339257 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:30.339495 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:30.339413 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:31.339476 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:31.339434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:31.340007 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:31.339434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:31.340007 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:31.339552 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:31.340007 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:31.339612 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:32.338684 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:32.338629 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:32.338884 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:32.338780 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:33.338739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:33.338683 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:33.339209 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:33.338848 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:33.339209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:33.339206 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:33.339327 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:33.339302 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:34.339562 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:34.339521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:34.340062 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:34.339687 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:35.008386 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:35.008343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:35.008593 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:35.008429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:35.008593 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.008546 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:35.008593 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.008556 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:35.008745 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.008627 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:06:51.008606641 +0000 UTC m=+34.224320176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:35.008745 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.008646 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:06:51.008637317 +0000 UTC m=+34.224350842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:35.108884 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:35.108848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:35.109398 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.109352 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:35.109398 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.109401 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:35.109607 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.109417 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:35.109607 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.109497 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:51.109476429 +0000 UTC m=+34.325189965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:35.339213 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:35.339130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:35.339379 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.339259 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:35.339616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:35.339130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:35.339969 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:35.339695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:36.339070 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:36.339032 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:36.339257 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:36.339159 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:37.339929 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:37.339891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:37.340365 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:37.339944 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:37.340365 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:37.340025 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:37.340365 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:37.340157 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:38.338666 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:38.338624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:38.338853 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:38.338807 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:39.342741 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.341899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:39.342741 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:39.342030 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:39.342741 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.342435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:39.342741 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:39.342532 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:39.609826 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.609475 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4p26" event={"ID":"7d6f68fb-32bf-494e-83b9-9f79f6115e71","Type":"ContainerStarted","Data":"bc88c9e557ba8546b522e2b36101a8864bf1b89a8fb71e0177fdf83ff3821fbb"} Jul 28 12:06:39.611550 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.611511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8llhh" event={"ID":"1ecc9a4e-2d4f-442b-92fd-1f5c692ca308","Type":"ContainerStarted","Data":"4f21420e3bc8c84f44fc8149e34a4e1b50ff0c6ce45988ef702aad8d0c9b2aac"} Jul 28 12:06:39.612959 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.612934 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1a172ba-8701-4c27-9c72-8d37dda47333" containerID="19053093cc9327b91dd17b51ce7045e2b82841caa27ac633644c170bfc5af4b0" exitCode=0 Jul 28 12:06:39.613079 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.612995 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerDied","Data":"19053093cc9327b91dd17b51ce7045e2b82841caa27ac633644c170bfc5af4b0"} Jul 28 12:06:39.616323 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.616298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"ed36a960f60b589f85b7a6a8880349569fb7a499d464b9c0fbbabfc8782bbf08"} Jul 28 12:06:39.616463 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.616373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"1fb83424befcae00b0b35d218b134bd159e28f70fb0aae00052bc8410a230644"} Jul 28 12:06:39.618070 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.618052 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" event={"ID":"33ef797f-621e-497a-bf03-f0881b179e22","Type":"ContainerStarted","Data":"d1e81680915b5ba549d96a5f97ee3605b57453507e34e84023346df21f3aad06"} Jul 28 12:06:39.619239 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.619224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gx2nl" event={"ID":"1541d440-2a02-4d0a-b5d0-11e508b08ecb","Type":"ContainerStarted","Data":"cd439749da93f4b6b66e0f65a904851fea586c80d50358594e150f4e3e2fdb2b"} Jul 28 12:06:39.620727 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.620711 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c27fg" event={"ID":"0444982b-3cdd-48a2-bcf3-b181c07b7537","Type":"ContainerStarted","Data":"0f6a6871320c00c46c7aa139dc6e0fe815164e8e3baafb2ed843763887c09c65"} Jul 28 12:06:39.622300 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.622180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jnvzp" event={"ID":"8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd","Type":"ContainerStarted","Data":"18bd1f885f22ae3cb69e7c620382c24822bcf5ed6ee00054fc45119c936a6e4c"} Jul 28 12:06:39.626423 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.626370 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-240.ec2.internal" podStartSLOduration=21.626351381 podStartE2EDuration="21.626351381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:22.58810946 +0000 UTC m=+5.803823001" watchObservedRunningTime="2026-07-28 12:06:39.626351381 +0000 UTC m=+22.842064922" Jul 28 12:06:39.626975 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.626866 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m4p26" podStartSLOduration=3.766776591 podStartE2EDuration="22.626854519s" totalImagesPullingTime="18.860077928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:39.626075308 +0000 UTC m=+22.841788858" watchObservedRunningTime="2026-07-28 12:06:39.626854519 +0000 UTC m=+22.842568061" Jul 28 12:06:39.644510 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.644444 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jnvzp" podStartSLOduration=3.777789309 podStartE2EDuration="22.644428638s" totalImagesPullingTime="18.866639329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:39.644034352 +0000 UTC m=+22.859747916" watchObservedRunningTime="2026-07-28 12:06:39.644428638 +0000 UTC m=+22.860142191" Jul 28 12:06:39.665549 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.665482 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8llhh" podStartSLOduration=3.776920793 podStartE2EDuration="22.665458206s" totalImagesPullingTime="18.888537413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:39.665253871 +0000 UTC m=+22.880967412" watchObservedRunningTime="2026-07-28 12:06:39.665458206 +0000 UTC m=+22.881171748" Jul 28 12:06:39.687619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.687570 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c27fg" podStartSLOduration=3.7456727770000002 podStartE2EDuration="22.687551652s" totalImagesPullingTime="18.941878875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:39.687250778 +0000 UTC m=+22.902964318" watchObservedRunningTime="2026-07-28 12:06:39.687551652 +0000 UTC m=+22.903265191" Jul 28 12:06:39.751971 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:39.751921 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gx2nl" podStartSLOduration=3.885513558 podStartE2EDuration="22.751904048s" totalImagesPullingTime="18.86639049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:39.708324421 +0000 UTC m=+22.924037960" watchObservedRunningTime="2026-07-28 12:06:39.751904048 +0000 UTC m=+22.967617588" Jul 28 12:06:40.338924 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:40.338892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:40.339178 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:40.339043 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:40.628890 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:40.628795 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"53a1e7015af80f11f51f0f3f9b558c2c7e38a3de2f438cd9f8d4b02e2d430a9f"} Jul 28 12:06:40.629884 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:40.628894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"4daa42a410956b877194cf8f6a095e6087ad735aebf1774f8f784ca642e1eb23"} Jul 28 12:06:40.629884 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:40.628940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"7a9bdd335302e99df665a5a0d5013f20da02ffb17f99e978f332dc9cb1216830"} Jul 28 12:06:40.629884 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:40.628981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"ad24f142938221240768909d688b8fa783f2f82a6e7909ee09f3d3e12628731e"} Jul 28 12:06:40.793685 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:40.793638 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 12:06:41.238957 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.238846 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T12:06:40.793674991Z","UUID":"ed70e8d8-9d51-44eb-b4a2-b6b613c68654","Handler":null,"Name":"","Endpoint":""} Jul 28 12:06:41.240549 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.240515 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 12:06:41.240722 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.240560 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 12:06:41.340772 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.340699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:41.340933 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:41.340833 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:41.340996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.340941 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:41.341063 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:41.341044 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:41.400734 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.400701 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:41.402038 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.401999 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:41.634468 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.634371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" event={"ID":"33ef797f-621e-497a-bf03-f0881b179e22","Type":"ContainerStarted","Data":"9ae00629fd5843d20b69d01470857178a39d9e251054d8d9b3ec3cd311ab1f64"} Jul 28 12:06:41.637347 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.637310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8r2g5" event={"ID":"706a5828-b3c1-4947-acae-f3daac313363","Type":"ContainerStarted","Data":"7ac18d872eff1ba25c2d915b41f394ba5fe8c9127547206b5c0e97bfcdf33f99"} Jul 28 12:06:41.658469 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.658417 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8r2g5" podStartSLOduration=5.773944322 podStartE2EDuration="24.658399451s" totalImagesPullingTime="18.884455129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:41.658119391 +0000 UTC m=+24.873832935" watchObservedRunningTime="2026-07-28 12:06:41.658399451 +0000 UTC m=+24.874112990" Jul 28 12:06:41.830832 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.830797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:41.831472 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:41.831447 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jnvzp" Jul 28 12:06:42.338641 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:42.338546 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:42.338872 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:42.338743 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:42.642634 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:42.642530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" event={"ID":"33ef797f-621e-497a-bf03-f0881b179e22","Type":"ContainerStarted","Data":"9938ad54bf1fd4b99c23bd2d25f701ed32d653d1d686123a9d016952d3db7bdb"} Jul 28 12:06:42.646526 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:42.646482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"36f36445611b597b343f3974e695c2ccfd6f2e8b16408aa614ee31af2c9373a5"} Jul 28 12:06:42.664185 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:42.664114 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w4kbr" podStartSLOduration=4.4062061 podStartE2EDuration="25.664096408s" totalImagesPullingTime="21.257890308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:42.663855072 +0000 UTC m=+25.879568633" watchObservedRunningTime="2026-07-28 12:06:42.664096408 +0000 UTC m=+25.879809948" Jul 28 12:06:43.339183 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:43.338977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:43.339393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:43.339047 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:43.339393 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:43.339286 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:43.339512 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:43.339382 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:44.340133 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.340106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:44.340763 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:44.340227 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:44.653504 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.653470 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1a172ba-8701-4c27-9c72-8d37dda47333" containerID="261b8e36bfe48c8db03754598a726d73c9f943e2573fe3c3cd37bd3762567b6e" exitCode=0 Jul 28 12:06:44.653700 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.653557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerDied","Data":"261b8e36bfe48c8db03754598a726d73c9f943e2573fe3c3cd37bd3762567b6e"} Jul 28 12:06:44.657594 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.657544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" event={"ID":"83541d93-1f2d-42d5-9a44-40e0fd8a1e60","Type":"ContainerStarted","Data":"c07ad2014ec6ad11beae86c95cc4cf849e477d1345b194d5dbbd60f3fc86500a"} Jul 28 12:06:44.657916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.657893 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:44.658023 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.657965 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:44.658023 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.658008 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:44.676250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.676215 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:44.676392 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.676384 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:06:44.714517 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:44.714463 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" podStartSLOduration=8.776742341 podStartE2EDuration="27.714444751s" totalImagesPullingTime="18.93770241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:44.714123486 +0000 UTC m=+27.929837045" watchObservedRunningTime="2026-07-28 12:06:44.714444751 +0000 UTC m=+27.930158290" Jul 28 12:06:45.339440 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:45.339243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:45.339620 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:45.339243 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:45.339620 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:45.339536 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:45.339620 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:45.339582 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:45.666916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:45.666880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerStarted","Data":"ba2eb4db7958414aa257564f5ae7c10e8b5e88085d3a8da6755b1a69f61dbeb1"} Jul 28 12:06:46.339315 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.339278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:46.339540 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:46.339395 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:46.447259 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.447206 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5b4gp"] Jul 28 12:06:46.447726 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.447376 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:46.447726 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:46.447492 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:46.447922 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.447858 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2mr5"] Jul 28 12:06:46.447978 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.447950 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:46.448052 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:46.448033 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:46.450081 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.450056 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qd9sp"] Jul 28 12:06:46.671521 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.671412 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1a172ba-8701-4c27-9c72-8d37dda47333" containerID="ba2eb4db7958414aa257564f5ae7c10e8b5e88085d3a8da6755b1a69f61dbeb1" exitCode=0 Jul 28 12:06:46.671521 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.671492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:46.671521 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:46.671510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerDied","Data":"ba2eb4db7958414aa257564f5ae7c10e8b5e88085d3a8da6755b1a69f61dbeb1"} Jul 28 12:06:46.671980 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:46.671847 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:48.339438 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:48.339241 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:48.339872 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:48.339292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:48.339872 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:48.339512 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:48.339872 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:48.339293 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:48.339872 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:48.339591 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:48.339872 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:48.339720 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:48.678320 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:48.678227 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1a172ba-8701-4c27-9c72-8d37dda47333" containerID="2799303df2d7f75e6a76decbdc2c05b93834e06dfd0a12e92feb89c84cbdfdeb" exitCode=0 Jul 28 12:06:48.678476 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:48.678307 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerDied","Data":"2799303df2d7f75e6a76decbdc2c05b93834e06dfd0a12e92feb89c84cbdfdeb"} Jul 28 12:06:50.338580 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:50.338540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:50.339090 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:50.338540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:50.339090 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:50.338697 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:50.339090 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:50.338541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:50.339090 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:50.338787 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:50.339090 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:50.338860 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:51.022848 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:51.022809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:51.023062 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:51.022865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:51.023062 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.022972 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:51.023062 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.023010 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:51.023062 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.023056 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret podName:21f28e07-939d-4582-8596-26d60b09037f nodeName:}" failed. No retries permitted until 2026-07-28 12:07:23.023032413 +0000 UTC m=+66.238745947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret") pod "global-pull-secret-syncer-5b4gp" (UID: "21f28e07-939d-4582-8596-26d60b09037f") : object "kube-system"/"original-pull-secret" not registered Jul 28 12:06:51.023252 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.023077 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs podName:b33359e2-316a-4f52-9ec2-13cf860641bf nodeName:}" failed. No retries permitted until 2026-07-28 12:07:23.023067389 +0000 UTC m=+66.238780918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs") pod "network-metrics-daemon-qd9sp" (UID: "b33359e2-316a-4f52-9ec2-13cf860641bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 12:06:51.124014 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:51.123978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:51.124226 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.124116 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 12:06:51.124226 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.124132 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 12:06:51.124226 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.124143 2565 projected.go:196] Error preparing data for projected volume kube-api-access-fq5sp for pod openshift-network-diagnostics/network-check-target-w2mr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:51.124226 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:51.124196 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp podName:d3193f48-e403-40aa-88b7-b828fbd7b4c9 nodeName:}" failed. No retries permitted until 2026-07-28 12:07:23.124181039 +0000 UTC m=+66.339894570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq5sp" (UniqueName: "kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp") pod "network-check-target-w2mr5" (UID: "d3193f48-e403-40aa-88b7-b828fbd7b4c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 12:06:51.169132 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:51.169094 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4p26_7d6f68fb-32bf-494e-83b9-9f79f6115e71/dns-node-resolver/0.log" Jul 28 12:06:52.339249 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:52.339212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:52.339885 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:52.339212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:52.339885 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:52.339365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:52.339885 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:52.339356 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5b4gp" podUID="21f28e07-939d-4582-8596-26d60b09037f" Jul 28 12:06:52.339885 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:52.339470 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w2mr5" podUID="d3193f48-e403-40aa-88b7-b828fbd7b4c9" Jul 28 12:06:52.339885 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:52.339581 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qd9sp" podUID="b33359e2-316a-4f52-9ec2-13cf860641bf" Jul 28 12:06:52.344070 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:52.344045 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gx2nl_1541d440-2a02-4d0a-b5d0-11e508b08ecb/node-ca/0.log" Jul 28 12:06:53.126556 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.126529 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-240.ec2.internal" event="NodeReady" Jul 28 12:06:53.126763 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.126677 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 12:06:53.181300 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.181270 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jf7w7"] Jul 28 12:06:53.183093 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.183076 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.184329 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.184306 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qm68g"] Jul 28 12:06:53.185938 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.185916 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 12:06:53.186038 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.186024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.186360 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.186330 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 12:06:53.186456 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.186330 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-64w8m\"" Jul 28 12:06:53.186605 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.186591 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 12:06:53.190912 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.190891 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 12:06:53.191310 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.191150 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 12:06:53.191310 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.191187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9qrk5\"" Jul 28 12:06:53.191310 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.191197 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 12:06:53.191636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.191470 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 12:06:53.198834 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.198808 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jf7w7"] Jul 28 12:06:53.204872 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.204849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qm68g"] Jul 28 12:06:53.288921 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.288886 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-95f9k"] Jul 28 12:06:53.290823 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.290807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.293535 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.293518 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 12:06:53.293643 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.293573 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4j8p8\"" Jul 28 12:06:53.293643 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.293632 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 12:06:53.306680 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.306642 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95f9k"] Jul 28 12:06:53.340631 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340603 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-crio-socket\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.340631 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-data-volume\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.341355 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340673 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p7rx\" (UniqueName: \"kubernetes.io/projected/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-api-access-6p7rx\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.341355 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.341355 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc1a281-3703-4af1-b929-fee27beb10f4-cert\") pod \"ingress-canary-jf7w7\" (UID: \"bfc1a281-3703-4af1-b929-fee27beb10f4\") " pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.341355 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57hpn\" (UniqueName: \"kubernetes.io/projected/bfc1a281-3703-4af1-b929-fee27beb10f4-kube-api-access-57hpn\") pod \"ingress-canary-jf7w7\" (UID: \"bfc1a281-3703-4af1-b929-fee27beb10f4\") " pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.341355 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.340850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.441793 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-crio-socket\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.441793 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-data-volume\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.441793 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p7rx\" (UniqueName: \"kubernetes.io/projected/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-api-access-6p7rx\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.441793 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-tmp-dir\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441857 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czkz5\" (UniqueName: \"kubernetes.io/projected/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-kube-api-access-czkz5\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-config-volume\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441968 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-crio-socket\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.441982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc1a281-3703-4af1-b929-fee27beb10f4-cert\") pod \"ingress-canary-jf7w7\" (UID: \"bfc1a281-3703-4af1-b929-fee27beb10f4\") " pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.441929 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.442042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57hpn\" (UniqueName: \"kubernetes.io/projected/bfc1a281-3703-4af1-b929-fee27beb10f4-kube-api-access-57hpn\") pod \"ingress-canary-jf7w7\" (UID: \"bfc1a281-3703-4af1-b929-fee27beb10f4\") " pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.442089 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.442079 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:06:53.942054579 +0000 UTC m=+37.157768114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : secret "insights-runtime-extractor-tls" not found Jul 28 12:06:53.442415 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.442102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.442415 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.442126 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-data-volume\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.442415 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.442263 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:06:53.442415 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.442312 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:06:53.942299135 +0000 UTC m=+37.158012684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : configmap "kube-rbac-proxy" not found Jul 28 12:06:53.446901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.446874 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc1a281-3703-4af1-b929-fee27beb10f4-cert\") pod \"ingress-canary-jf7w7\" (UID: \"bfc1a281-3703-4af1-b929-fee27beb10f4\") " pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.452818 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.452685 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p7rx\" (UniqueName: \"kubernetes.io/projected/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-api-access-6p7rx\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.453419 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.453393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57hpn\" (UniqueName: \"kubernetes.io/projected/bfc1a281-3703-4af1-b929-fee27beb10f4-kube-api-access-57hpn\") pod \"ingress-canary-jf7w7\" (UID: \"bfc1a281-3703-4af1-b929-fee27beb10f4\") " pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.494801 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.494758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jf7w7" Jul 28 12:06:53.543398 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.543362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.543398 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.543406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-tmp-dir\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.543630 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.543425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czkz5\" (UniqueName: \"kubernetes.io/projected/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-kube-api-access-czkz5\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.543630 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.543452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-config-volume\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.543630 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.543536 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:06:53.543630 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.543618 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls podName:a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:54.043595805 +0000 UTC m=+37.259309336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls") pod "dns-default-95f9k" (UID: "a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4") : secret "dns-default-metrics-tls" not found Jul 28 12:06:53.543827 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.543728 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-tmp-dir\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.544029 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.544013 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-config-volume\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.554587 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.554374 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czkz5\" (UniqueName: \"kubernetes.io/projected/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-kube-api-access-czkz5\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:53.633516 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.633464 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jf7w7"] Jul 28 12:06:53.637521 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:53.637485 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc1a281_3703_4af1_b929_fee27beb10f4.slice/crio-c5af4f5f611c79f1f9d0f3173392f66d1988987103f195789a63221b39b46f01 WatchSource:0}: Error finding container c5af4f5f611c79f1f9d0f3173392f66d1988987103f195789a63221b39b46f01: Status 404 returned error can't find the container with id c5af4f5f611c79f1f9d0f3173392f66d1988987103f195789a63221b39b46f01 Jul 28 12:06:53.691774 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.691738 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jf7w7" event={"ID":"bfc1a281-3703-4af1-b929-fee27beb10f4","Type":"ContainerStarted","Data":"c5af4f5f611c79f1f9d0f3173392f66d1988987103f195789a63221b39b46f01"} Jul 28 12:06:53.694217 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.694122 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1a172ba-8701-4c27-9c72-8d37dda47333" containerID="7178b89992917ee07ffdd75d113ccff3fee4e2cab70c8680d0d992e6f755c87e" exitCode=0 Jul 28 12:06:53.694217 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.694158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerDied","Data":"7178b89992917ee07ffdd75d113ccff3fee4e2cab70c8680d0d992e6f755c87e"} Jul 28 12:06:53.945887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.945852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.946064 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:53.945919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:53.946064 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.945986 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:06:53.946064 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.946040 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:06:53.946064 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.946054 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:06:54.946036748 +0000 UTC m=+38.161750265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : configmap "kube-rbac-proxy" not found Jul 28 12:06:53.946229 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:53.946083 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:06:54.946071336 +0000 UTC m=+38.161784855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : secret "insights-runtime-extractor-tls" not found Jul 28 12:06:54.046880 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.046836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:54.047038 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:54.047002 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:06:54.047098 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:54.047073 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls podName:a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:55.047055807 +0000 UTC m=+38.262769325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls") pod "dns-default-95f9k" (UID: "a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4") : secret "dns-default-metrics-tls" not found Jul 28 12:06:54.338833 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.338749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:06:54.339010 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.338754 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:06:54.339010 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.338766 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:06:54.341728 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.341705 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 12:06:54.342113 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.341754 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 12:06:54.342113 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.341713 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 12:06:54.342113 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.341957 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 12:06:54.342113 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.342008 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjs5z\"" Jul 28 12:06:54.342258 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.342193 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7r5r\"" Jul 28 12:06:54.701055 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.701018 2565 generic.go:356] "Generic (PLEG): container finished" podID="c1a172ba-8701-4c27-9c72-8d37dda47333" containerID="dc71ebd36e5215d763d7baf0fcd89c4e12ab860326e9be34e492222e1edfe94d" exitCode=0 Jul 28 12:06:54.701246 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.701094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerDied","Data":"dc71ebd36e5215d763d7baf0fcd89c4e12ab860326e9be34e492222e1edfe94d"} Jul 28 12:06:54.862496 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.862225 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-dkx4m"] Jul 28 12:06:54.864505 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.864478 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:54.867314 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.867257 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 12:06:54.867314 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.867304 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 12:06:54.867613 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.867522 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 12:06:54.867613 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.867598 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qw968\"" Jul 28 12:06:54.867855 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.867837 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 12:06:54.875868 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.875846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-dkx4m"] Jul 28 12:06:54.954665 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.954555 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mxn\" (UniqueName: \"kubernetes.io/projected/9c944531-cde1-4e0a-8437-a0e83ee1a402-kube-api-access-58mxn\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:54.954665 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.954625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:54.954894 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.954731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c944531-cde1-4e0a-8437-a0e83ee1a402-signing-cabundle\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:54.954894 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:54.954769 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:06:54.954894 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:54.954827 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:06:56.954811832 +0000 UTC m=+40.170525353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : secret "insights-runtime-extractor-tls" not found Jul 28 12:06:54.954894 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.954882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c944531-cde1-4e0a-8437-a0e83ee1a402-signing-key\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:54.955083 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:54.954909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:54.955129 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:54.955113 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:06:54.955174 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:54.955167 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:06:56.955151129 +0000 UTC m=+40.170864654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : configmap "kube-rbac-proxy" not found Jul 28 12:06:55.055977 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.055936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c944531-cde1-4e0a-8437-a0e83ee1a402-signing-cabundle\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.056190 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.056051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c944531-cde1-4e0a-8437-a0e83ee1a402-signing-key\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.056190 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.056113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mxn\" (UniqueName: \"kubernetes.io/projected/9c944531-cde1-4e0a-8437-a0e83ee1a402-kube-api-access-58mxn\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.056284 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.056244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:55.056368 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:55.056353 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:06:55.056416 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:55.056405 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls podName:a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4 nodeName:}" failed. No retries permitted until 2026-07-28 12:06:57.05639033 +0000 UTC m=+40.272103865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls") pod "dns-default-95f9k" (UID: "a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4") : secret "dns-default-metrics-tls" not found Jul 28 12:06:55.057063 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.057033 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c944531-cde1-4e0a-8437-a0e83ee1a402-signing-cabundle\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.060542 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.060523 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c944531-cde1-4e0a-8437-a0e83ee1a402-signing-key\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.065344 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.065318 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mxn\" (UniqueName: \"kubernetes.io/projected/9c944531-cde1-4e0a-8437-a0e83ee1a402-kube-api-access-58mxn\") pod \"service-ca-658d7b7c78-dkx4m\" (UID: \"9c944531-cde1-4e0a-8437-a0e83ee1a402\") " pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.176358 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.176325 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" Jul 28 12:06:55.327536 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.327498 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-dkx4m"] Jul 28 12:06:55.710939 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:55.710894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" event={"ID":"c1a172ba-8701-4c27-9c72-8d37dda47333","Type":"ContainerStarted","Data":"8fddd54487c8241f7e9f34b2ab8a9dd301c972321e5f95ea4adf10d6ce0f5b70"} Jul 28 12:06:56.070624 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:06:56.070591 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c944531_cde1_4e0a_8437_a0e83ee1a402.slice/crio-e9e1203f9186e79d208f1cf09f71746f6b57ca14f5ce286884f5b09309f7da1b WatchSource:0}: Error finding container e9e1203f9186e79d208f1cf09f71746f6b57ca14f5ce286884f5b09309f7da1b: Status 404 returned error can't find the container with id e9e1203f9186e79d208f1cf09f71746f6b57ca14f5ce286884f5b09309f7da1b Jul 28 12:06:56.715714 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:56.715456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jf7w7" event={"ID":"bfc1a281-3703-4af1-b929-fee27beb10f4","Type":"ContainerStarted","Data":"65cabaeb3d2a59066843ab7d342fec916af3b7dc48ce8e805551c2ac2f9fb502"} Jul 28 12:06:56.716815 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:56.716788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" event={"ID":"9c944531-cde1-4e0a-8437-a0e83ee1a402","Type":"ContainerStarted","Data":"e9e1203f9186e79d208f1cf09f71746f6b57ca14f5ce286884f5b09309f7da1b"} Jul 28 12:06:56.734468 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:56.734400 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ngrlm" podStartSLOduration=10.245588184 podStartE2EDuration="39.734373932s" totalImagesPullingTime="29.488785748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:55.748488013 +0000 UTC m=+38.964201577" watchObservedRunningTime="2026-07-28 12:06:56.734373932 +0000 UTC m=+39.950087477" Jul 28 12:06:56.735153 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:56.735111 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jf7w7" podStartSLOduration=0.978624875 podStartE2EDuration="3.73509572s" totalImagesPullingTime="2.756470845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:56.733550389 +0000 UTC m=+39.949263969" watchObservedRunningTime="2026-07-28 12:06:56.73509572 +0000 UTC m=+39.950809261" Jul 28 12:06:56.972638 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:56.972303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:56.972638 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:56.972387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:06:56.972638 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:56.972448 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:06:56.972638 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:56.972517 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:06:56.972638 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:56.972538 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:07:00.9725135 +0000 UTC m=+44.188227024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : configmap "kube-rbac-proxy" not found Jul 28 12:06:56.972638 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:56.972568 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:07:00.972555134 +0000 UTC m=+44.188268683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : secret "insights-runtime-extractor-tls" not found Jul 28 12:06:57.073770 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:57.073732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:06:57.073966 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:57.073905 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:06:57.074035 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:06:57.073971 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls podName:a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4 nodeName:}" failed. No retries permitted until 2026-07-28 12:07:01.073955234 +0000 UTC m=+44.289668786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls") pod "dns-default-95f9k" (UID: "a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4") : secret "dns-default-metrics-tls" not found Jul 28 12:06:58.723387 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:58.723347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" event={"ID":"9c944531-cde1-4e0a-8437-a0e83ee1a402","Type":"ContainerStarted","Data":"3bc920e30b904dcef2519880488e3558cca4fc3f65f374ca012448c257fe72e4"} Jul 28 12:06:58.749031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:06:58.748978 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-dkx4m" podStartSLOduration=2.46449739 podStartE2EDuration="4.748960874s" totalImagesPullingTime="2.284463484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:06:58.748573023 +0000 UTC m=+41.964286564" watchObservedRunningTime="2026-07-28 12:06:58.748960874 +0000 UTC m=+41.964674413" Jul 28 12:07:01.011357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:01.011302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:01.011859 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:01.011393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:01.011859 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:01.011441 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 12:07:01.011859 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:01.011520 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:07:09.011504636 +0000 UTC m=+52.227218154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : configmap "kube-rbac-proxy" not found Jul 28 12:07:01.011859 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:01.011573 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:07:01.011859 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:01.011678 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:07:09.011630252 +0000 UTC m=+52.227343786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : secret "insights-runtime-extractor-tls" not found Jul 28 12:07:01.112350 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:01.112305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:07:01.112533 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:01.112457 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 12:07:01.112533 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:01.112524 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls podName:a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4 nodeName:}" failed. No retries permitted until 2026-07-28 12:07:09.112507173 +0000 UTC m=+52.328220691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls") pod "dns-default-95f9k" (UID: "a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4") : secret "dns-default-metrics-tls" not found Jul 28 12:07:09.076886 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.076838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:09.077416 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.076914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:09.077416 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:09.077008 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 12:07:09.077416 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:09.077067 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls podName:246ee6ab-73a2-4ee5-a4a3-0499593c6a6a nodeName:}" failed. No retries permitted until 2026-07-28 12:07:25.077051937 +0000 UTC m=+68.292765454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qm68g" (UID: "246ee6ab-73a2-4ee5-a4a3-0499593c6a6a") : secret "insights-runtime-extractor-tls" not found Jul 28 12:07:09.077529 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.077435 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:09.178325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.178280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:07:09.181108 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.181075 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4-metrics-tls\") pod \"dns-default-95f9k\" (UID: \"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4\") " pod="openshift-dns/dns-default-95f9k" Jul 28 12:07:09.200199 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.200155 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95f9k" Jul 28 12:07:09.350353 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.350276 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95f9k"] Jul 28 12:07:09.353395 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:09.353365 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e6a0ee_eb75_4ccb_a766_6c8b69d58aa4.slice/crio-f85b8927db2112932c0672c5f99364ed893d9babc9d536e599b4f285a08106c7 WatchSource:0}: Error finding container f85b8927db2112932c0672c5f99364ed893d9babc9d536e599b4f285a08106c7: Status 404 returned error can't find the container with id f85b8927db2112932c0672c5f99364ed893d9babc9d536e599b4f285a08106c7 Jul 28 12:07:09.753350 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:09.753311 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95f9k" event={"ID":"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4","Type":"ContainerStarted","Data":"f85b8927db2112932c0672c5f99364ed893d9babc9d536e599b4f285a08106c7"} Jul 28 12:07:11.760870 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:11.760835 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95f9k" event={"ID":"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4","Type":"ContainerStarted","Data":"7b3bc15beea00f94729f88bd501754a60ab93a79f52d5d54f50c55fea07fe70b"} Jul 28 12:07:12.765821 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:12.765785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95f9k" event={"ID":"a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4","Type":"ContainerStarted","Data":"9cab4311928f21234cddf58d6ff5df2955860b3d44bb63cb525bf614cab29a91"} Jul 28 12:07:12.766231 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:12.765917 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-95f9k" Jul 28 12:07:12.789431 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:12.789373 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-95f9k" podStartSLOduration=17.541316669 podStartE2EDuration="19.789357348s" totalImagesPullingTime="2.248040679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:12.789319432 +0000 UTC m=+56.005032972" watchObservedRunningTime="2026-07-28 12:07:12.789357348 +0000 UTC m=+56.005070888" Jul 28 12:07:14.550473 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.550437 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk"] Jul 28 12:07:14.552577 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.552554 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.558295 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.558260 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 12:07:14.558448 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.558260 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 12:07:14.558448 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.558361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 28 12:07:14.558666 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.558633 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 12:07:14.560249 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.560232 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xhs8v\"" Jul 28 12:07:14.567313 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.567284 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4"] Jul 28 12:07:14.569348 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.569334 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.571849 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.571825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 12:07:14.571849 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.571837 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 12:07:14.572158 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.572144 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 12:07:14.576674 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.576636 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk"] Jul 28 12:07:14.579904 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.579874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 12:07:14.591589 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.591553 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4"] Jul 28 12:07:14.622002 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.621970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c94c6d554-zgqnk\" (UID: \"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.622002 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.622278 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.622278 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-ca\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.622278 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-hub\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.622278 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/158801cc-7a9d-4c4c-b40a-4968d43ad078-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.622278 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52jm\" (UniqueName: \"kubernetes.io/projected/7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f-kube-api-access-k52jm\") pod \"managed-serviceaccount-addon-agent-7c94c6d554-zgqnk\" (UID: \"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.622470 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.622290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/158801cc-7a9d-4c4c-b40a-4968d43ad078-kube-api-access-5zzb6\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.723165 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-hub\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.723349 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/158801cc-7a9d-4c4c-b40a-4968d43ad078-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.723349 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k52jm\" (UniqueName: \"kubernetes.io/projected/7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f-kube-api-access-k52jm\") pod \"managed-serviceaccount-addon-agent-7c94c6d554-zgqnk\" (UID: \"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.723446 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/158801cc-7a9d-4c4c-b40a-4968d43ad078-kube-api-access-5zzb6\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.723499 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c94c6d554-zgqnk\" (UID: \"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.723548 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.723548 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.723645 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-ca\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.724082 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.723994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/158801cc-7a9d-4c4c-b40a-4968d43ad078-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.726455 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.726430 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.726591 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.726426 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-hub\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.726751 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.726728 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-ca\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.726829 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.726787 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/158801cc-7a9d-4c4c-b40a-4968d43ad078-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.726829 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.726809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c94c6d554-zgqnk\" (UID: \"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.733547 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.733511 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52jm\" (UniqueName: \"kubernetes.io/projected/7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f-kube-api-access-k52jm\") pod \"managed-serviceaccount-addon-agent-7c94c6d554-zgqnk\" (UID: \"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.739471 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.739448 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/158801cc-7a9d-4c4c-b40a-4968d43ad078-kube-api-access-5zzb6\") pod \"cluster-proxy-proxy-agent-84fdcdfff4-d9fs4\" (UID: \"158801cc-7a9d-4c4c-b40a-4968d43ad078\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:14.870699 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.870591 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" Jul 28 12:07:14.879058 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:14.879013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" Jul 28 12:07:15.018287 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:15.018251 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk"] Jul 28 12:07:15.022254 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:15.022223 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7535c3cd_d3ab_4ca9_a813_ca32c5e7ec7f.slice/crio-6fdc61c912a3ac8644acb7c0eb601132ce9e6ac77adbc77570dad002b03ae357 WatchSource:0}: Error finding container 6fdc61c912a3ac8644acb7c0eb601132ce9e6ac77adbc77570dad002b03ae357: Status 404 returned error can't find the container with id 6fdc61c912a3ac8644acb7c0eb601132ce9e6ac77adbc77570dad002b03ae357 Jul 28 12:07:15.039125 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:15.037975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4"] Jul 28 12:07:15.046510 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:15.046478 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod158801cc_7a9d_4c4c_b40a_4968d43ad078.slice/crio-0621da97a35978dffb0c33379c45cbee89a9ee0167ac49af81fc456edb0eb985 WatchSource:0}: Error finding container 0621da97a35978dffb0c33379c45cbee89a9ee0167ac49af81fc456edb0eb985: Status 404 returned error can't find the container with id 0621da97a35978dffb0c33379c45cbee89a9ee0167ac49af81fc456edb0eb985 Jul 28 12:07:15.774132 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:15.774095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" event={"ID":"158801cc-7a9d-4c4c-b40a-4968d43ad078","Type":"ContainerStarted","Data":"0621da97a35978dffb0c33379c45cbee89a9ee0167ac49af81fc456edb0eb985"} Jul 28 12:07:15.775251 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:15.775226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" event={"ID":"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f","Type":"ContainerStarted","Data":"6fdc61c912a3ac8644acb7c0eb601132ce9e6ac77adbc77570dad002b03ae357"} Jul 28 12:07:16.700139 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:16.700106 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksg7x" Jul 28 12:07:19.789253 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:19.789207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" event={"ID":"7535c3cd-d3ab-4ca9-a813-ca32c5e7ec7f","Type":"ContainerStarted","Data":"2acbdbe139256cdb5f85819f1c0d72d2c22bf27ef8962f1fc6a8a5ea18774822"} Jul 28 12:07:19.791334 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:19.791305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" event={"ID":"158801cc-7a9d-4c4c-b40a-4968d43ad078","Type":"ContainerStarted","Data":"794b178ed540e6aeee8ea5c998b3fc7e10f7067799f9156365239b7190afcd09"} Jul 28 12:07:19.791459 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:19.791344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" event={"ID":"158801cc-7a9d-4c4c-b40a-4968d43ad078","Type":"ContainerStarted","Data":"40156a2d3beda5c0d2fedb612cbdd8caa94457e522ff3155bfb76f554fb516fa"} Jul 28 12:07:19.791459 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:19.791357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" event={"ID":"158801cc-7a9d-4c4c-b40a-4968d43ad078","Type":"ContainerStarted","Data":"ecea52d99d621a2eec8e1a78621fba4e6f5877ecdd01d4eeaa10994634ac2e16"} Jul 28 12:07:19.806624 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:19.806573 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c94c6d554-zgqnk" podStartSLOduration=1.409054183 podStartE2EDuration="5.806557813s" totalImagesPullingTime="4.39750363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:19.80601477 +0000 UTC m=+63.021728337" watchObservedRunningTime="2026-07-28 12:07:19.806557813 +0000 UTC m=+63.022271353" Jul 28 12:07:19.825561 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:19.825496 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84fdcdfff4-d9fs4" podStartSLOduration=1.43816672 podStartE2EDuration="5.825471529s" totalImagesPullingTime="4.387304809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:19.823907575 +0000 UTC m=+63.039621115" watchObservedRunningTime="2026-07-28 12:07:19.825471529 +0000 UTC m=+63.041185069" Jul 28 12:07:22.770640 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:22.770601 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-95f9k" Jul 28 12:07:23.095867 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.095768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:07:23.095867 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.095831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:07:23.101477 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.101453 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 12:07:23.101563 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.101536 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 12:07:23.108385 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.108350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b33359e2-316a-4f52-9ec2-13cf860641bf-metrics-certs\") pod \"network-metrics-daemon-qd9sp\" (UID: \"b33359e2-316a-4f52-9ec2-13cf860641bf\") " pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:07:23.108520 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.108394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21f28e07-939d-4582-8596-26d60b09037f-original-pull-secret\") pod \"global-pull-secret-syncer-5b4gp\" (UID: \"21f28e07-939d-4582-8596-26d60b09037f\") " pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:07:23.159813 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.159780 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n7r5r\"" Jul 28 12:07:23.160830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.160808 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5b4gp" Jul 28 12:07:23.167197 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.167172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qd9sp" Jul 28 12:07:23.196560 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.196512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:07:23.199582 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.199560 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 12:07:23.210138 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.210112 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 12:07:23.220689 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.220440 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq5sp\" (UniqueName: \"kubernetes.io/projected/d3193f48-e403-40aa-88b7-b828fbd7b4c9-kube-api-access-fq5sp\") pod \"network-check-target-w2mr5\" (UID: \"d3193f48-e403-40aa-88b7-b828fbd7b4c9\") " pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:07:23.303701 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.303646 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5b4gp"] Jul 28 12:07:23.307280 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:23.307253 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f28e07_939d_4582_8596_26d60b09037f.slice/crio-fc1172155bdfdb3e59a3b88d4e3f28b5386bd5dc08de73f1481d9856c884de38 WatchSource:0}: Error finding container fc1172155bdfdb3e59a3b88d4e3f28b5386bd5dc08de73f1481d9856c884de38: Status 404 returned error can't find the container with id fc1172155bdfdb3e59a3b88d4e3f28b5386bd5dc08de73f1481d9856c884de38 Jul 28 12:07:23.320396 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.320363 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qd9sp"] Jul 28 12:07:23.323723 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:23.323701 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33359e2_316a_4f52_9ec2_13cf860641bf.slice/crio-b50b5ea8cd8235452cb97d7f73db788913c56940f61c603b9296a0b1ae2225ac WatchSource:0}: Error finding container b50b5ea8cd8235452cb97d7f73db788913c56940f61c603b9296a0b1ae2225ac: Status 404 returned error can't find the container with id b50b5ea8cd8235452cb97d7f73db788913c56940f61c603b9296a0b1ae2225ac Jul 28 12:07:23.453925 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.453900 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjs5z\"" Jul 28 12:07:23.461911 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.461892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:07:23.590230 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.590185 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w2mr5"] Jul 28 12:07:23.594479 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:23.594449 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3193f48_e403_40aa_88b7_b828fbd7b4c9.slice/crio-c4a050621f08627519d298447e8ea24dda9b1f86943df49d24ab979dc75920ac WatchSource:0}: Error finding container c4a050621f08627519d298447e8ea24dda9b1f86943df49d24ab979dc75920ac: Status 404 returned error can't find the container with id c4a050621f08627519d298447e8ea24dda9b1f86943df49d24ab979dc75920ac Jul 28 12:07:23.808085 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.807989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5b4gp" event={"ID":"21f28e07-939d-4582-8596-26d60b09037f","Type":"ContainerStarted","Data":"fc1172155bdfdb3e59a3b88d4e3f28b5386bd5dc08de73f1481d9856c884de38"} Jul 28 12:07:23.809503 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.809465 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2mr5" event={"ID":"d3193f48-e403-40aa-88b7-b828fbd7b4c9","Type":"ContainerStarted","Data":"c4a050621f08627519d298447e8ea24dda9b1f86943df49d24ab979dc75920ac"} Jul 28 12:07:23.810848 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:23.810818 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qd9sp" event={"ID":"b33359e2-316a-4f52-9ec2-13cf860641bf","Type":"ContainerStarted","Data":"b50b5ea8cd8235452cb97d7f73db788913c56940f61c603b9296a0b1ae2225ac"} Jul 28 12:07:24.818263 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:24.817563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qd9sp" event={"ID":"b33359e2-316a-4f52-9ec2-13cf860641bf","Type":"ContainerStarted","Data":"78f27c4ebfa49a4ff79e2904e8bf2dc3d8488c03c882e6bd889b7e642b7e42b0"} Jul 28 12:07:24.818263 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:24.817635 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qd9sp" event={"ID":"b33359e2-316a-4f52-9ec2-13cf860641bf","Type":"ContainerStarted","Data":"e5d0ad40fec14472486fa7727e3c85562361d287857b50c186db118cc7bbb05f"} Jul 28 12:07:24.836516 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:24.836160 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qd9sp" podStartSLOduration=66.782374733 podStartE2EDuration="1m7.836136576s" totalImagesPullingTime="1.053761843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:24.834271399 +0000 UTC m=+68.049984939" watchObservedRunningTime="2026-07-28 12:07:24.836136576 +0000 UTC m=+68.051850116" Jul 28 12:07:25.112894 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:25.112856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:25.117106 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:25.117067 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/246ee6ab-73a2-4ee5-a4a3-0499593c6a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qm68g\" (UID: \"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a\") " pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:25.301860 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:25.301821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9qrk5\"" Jul 28 12:07:25.310143 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:25.310111 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qm68g" Jul 28 12:07:25.484093 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:25.484047 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qm68g"] Jul 28 12:07:25.490336 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:25.490296 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246ee6ab_73a2_4ee5_a4a3_0499593c6a6a.slice/crio-c9405ecff19e79fb9bf10f88c86d599dea14ce40bfbde462c5f5975e17ac300b WatchSource:0}: Error finding container c9405ecff19e79fb9bf10f88c86d599dea14ce40bfbde462c5f5975e17ac300b: Status 404 returned error can't find the container with id c9405ecff19e79fb9bf10f88c86d599dea14ce40bfbde462c5f5975e17ac300b Jul 28 12:07:25.824799 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:25.824741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm68g" event={"ID":"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a","Type":"ContainerStarted","Data":"c9405ecff19e79fb9bf10f88c86d599dea14ce40bfbde462c5f5975e17ac300b"} Jul 28 12:07:28.845421 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:28.845380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w2mr5" event={"ID":"d3193f48-e403-40aa-88b7-b828fbd7b4c9","Type":"ContainerStarted","Data":"1ee21a462018804f40f31ba08ed4348754b3ccec2be70011bcf65c23288a413f"} Jul 28 12:07:28.845865 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:28.845737 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:07:28.848348 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:28.847924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5b4gp" event={"ID":"21f28e07-939d-4582-8596-26d60b09037f","Type":"ContainerStarted","Data":"b0ed8cf425ae26f9569a4901aa105f1ca8ba7a899e078c81aa8f5c997390199a"} Jul 28 12:07:28.863772 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:28.863256 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w2mr5" podStartSLOduration=66.817526135 podStartE2EDuration="1m11.863236374s" totalImagesPullingTime="5.045710239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:28.8619811 +0000 UTC m=+72.077694642" watchObservedRunningTime="2026-07-28 12:07:28.863236374 +0000 UTC m=+72.078949934" Jul 28 12:07:28.879055 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:28.878270 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5b4gp" podStartSLOduration=66.542202247 podStartE2EDuration="1m11.878252301s" totalImagesPullingTime="5.336050054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:28.877262241 +0000 UTC m=+72.092975783" watchObservedRunningTime="2026-07-28 12:07:28.878252301 +0000 UTC m=+72.093965841" Jul 28 12:07:33.869876 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:33.869840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm68g" event={"ID":"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a","Type":"ContainerStarted","Data":"cc0c069649f23ba157da33aba3639917507c99e2f902ca937a056962f9f3bdd5"} Jul 28 12:07:37.048416 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.048378 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-547cff6dd7-z8spk"] Jul 28 12:07:37.061226 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.061191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.070404 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.070373 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.070913 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.072963 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547cff6dd7-z8spk"] Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.073134 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kdzdd\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.073321 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.073465 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.073588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.073809 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 12:07:37.076744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.073967 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 12:07:37.078771 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.078746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 12:07:37.104850 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.104795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-service-ca\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.105042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.104858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-config\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.105042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.104881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-trusted-ca-bundle\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.105042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.104949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-oauth-config\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.105042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.104998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-serving-cert\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.105213 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.105075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-oauth-serving-cert\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.105213 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.105104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkk25\" (UniqueName: \"kubernetes.io/projected/6e17a1a9-7aa1-4540-a661-09d0721f1752-kube-api-access-jkk25\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206304 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-service-ca\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-config\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-trusted-ca-bundle\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-oauth-config\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-serving-cert\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-oauth-serving-cert\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.206485 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.206424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkk25\" (UniqueName: \"kubernetes.io/projected/6e17a1a9-7aa1-4540-a661-09d0721f1752-kube-api-access-jkk25\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.207268 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.207086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-config\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.207268 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.207218 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-service-ca\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.207268 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.207255 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-oauth-serving-cert\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.207646 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.207624 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-trusted-ca-bundle\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.210029 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.210005 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-oauth-config\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.210127 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.210010 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-serving-cert\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.217587 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.217558 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkk25\" (UniqueName: \"kubernetes.io/projected/6e17a1a9-7aa1-4540-a661-09d0721f1752-kube-api-access-jkk25\") pod \"console-547cff6dd7-z8spk\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.372245 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.372212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:37.525009 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.524974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-547cff6dd7-z8spk"] Jul 28 12:07:37.528226 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:37.528194 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e17a1a9_7aa1_4540_a661_09d0721f1752.slice/crio-8607fdb6f97d70837235cb553dab3d8d855c3690e15243da78d038a99d89a99f WatchSource:0}: Error finding container 8607fdb6f97d70837235cb553dab3d8d855c3690e15243da78d038a99d89a99f: Status 404 returned error can't find the container with id 8607fdb6f97d70837235cb553dab3d8d855c3690e15243da78d038a99d89a99f Jul 28 12:07:37.887781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.887731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm68g" event={"ID":"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a","Type":"ContainerStarted","Data":"7cd14837924b081b40be99fe33a937d8f735359b13c215b4939c824a14da6f17"} Jul 28 12:07:37.889117 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:37.889079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547cff6dd7-z8spk" event={"ID":"6e17a1a9-7aa1-4540-a661-09d0721f1752","Type":"ContainerStarted","Data":"8607fdb6f97d70837235cb553dab3d8d855c3690e15243da78d038a99d89a99f"} Jul 28 12:07:42.910192 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.910150 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qm68g" event={"ID":"246ee6ab-73a2-4ee5-a4a3-0499593c6a6a","Type":"ContainerStarted","Data":"2ec67935e8189f64a3f1563282ecd1c3040a963fad171c3bef4b8a03f2a20787"} Jul 28 12:07:42.912088 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.912053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547cff6dd7-z8spk" event={"ID":"6e17a1a9-7aa1-4540-a661-09d0721f1752","Type":"ContainerStarted","Data":"9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d"} Jul 28 12:07:42.946969 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.946898 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qm68g" podStartSLOduration=33.369453345 podStartE2EDuration="49.946876881s" totalImagesPullingTime="16.577423536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:06:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:42.946197578 +0000 UTC m=+86.161911119" watchObservedRunningTime="2026-07-28 12:07:42.946876881 +0000 UTC m=+86.162590422" Jul 28 12:07:42.957396 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.957347 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6jnvs"] Jul 28 12:07:42.960937 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.960912 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:42.968730 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.964599 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 12:07:42.968730 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.964827 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 12:07:42.968730 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.965202 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 12:07:42.968730 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.965819 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 12:07:42.968730 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.966629 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7vm6j\"" Jul 28 12:07:42.971863 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.971832 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 12:07:42.972697 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.972645 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 12:07:42.983884 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:42.983824 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-547cff6dd7-z8spk" podStartSLOduration=1.321622649 podStartE2EDuration="5.983807711s" totalImagesPullingTime="4.662185062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:42.982615896 +0000 UTC m=+86.198329452" watchObservedRunningTime="2026-07-28 12:07:42.983807711 +0000 UTC m=+86.199521288" Jul 28 12:07:43.059534 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-wtmp\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059766 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-textfile\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059766 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-root\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059766 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47hz\" (UniqueName: \"kubernetes.io/projected/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-kube-api-access-g47hz\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059766 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-sys\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059766 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-tls\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059994 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059994 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.059994 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.059978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-metrics-client-ca\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.160899 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-metrics-client-ca\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.160899 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-wtmp\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.160899 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-textfile\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.160899 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-root\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.160899 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47hz\" (UniqueName: \"kubernetes.io/projected/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-kube-api-access-g47hz\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-sys\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-tls\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160969 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-root\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.160994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.161026 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-wtmp\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.161075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.161089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-sys\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:43.161177 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 12:07:43.161280 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:07:43.161264 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-tls podName:59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc nodeName:}" failed. No retries permitted until 2026-07-28 12:07:43.661229379 +0000 UTC m=+86.876942897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-tls") pod "node-exporter-6jnvs" (UID: "59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc") : secret "node-exporter-tls" not found Jul 28 12:07:43.161646 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.161384 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-textfile\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161646 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.161624 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.161748 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.161646 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-metrics-client-ca\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.163564 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.163537 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.173169 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.173143 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47hz\" (UniqueName: \"kubernetes.io/projected/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-kube-api-access-g47hz\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.665039 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.664998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-tls\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.667560 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.667527 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc-node-exporter-tls\") pod \"node-exporter-6jnvs\" (UID: \"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc\") " pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.876598 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.876555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6jnvs" Jul 28 12:07:43.889093 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:43.889057 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ac2176_29e4_4ce1_93eb_a0ef9abdc5dc.slice/crio-785683fd4b2070897d14e5eb8360641df8a16d6fca47741e923a031a0f7ff564 WatchSource:0}: Error finding container 785683fd4b2070897d14e5eb8360641df8a16d6fca47741e923a031a0f7ff564: Status 404 returned error can't find the container with id 785683fd4b2070897d14e5eb8360641df8a16d6fca47741e923a031a0f7ff564 Jul 28 12:07:43.916786 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:43.916695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jnvs" event={"ID":"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc","Type":"ContainerStarted","Data":"785683fd4b2070897d14e5eb8360641df8a16d6fca47741e923a031a0f7ff564"} Jul 28 12:07:45.925876 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:45.925836 2565 generic.go:356] "Generic (PLEG): container finished" podID="59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc" containerID="d4cb276ba3496d3354ebb442261409b4595c918840b3cc708632ac165529aedf" exitCode=0 Jul 28 12:07:45.926379 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:45.925931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jnvs" event={"ID":"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc","Type":"ContainerDied","Data":"d4cb276ba3496d3354ebb442261409b4595c918840b3cc708632ac165529aedf"} Jul 28 12:07:46.932152 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:46.932108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jnvs" event={"ID":"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc","Type":"ContainerStarted","Data":"207b71a3274d9f9775aec670ab2a6679325a3fd1d53c76f5eeca27b071b02c14"} Jul 28 12:07:46.932551 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:46.932215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6jnvs" event={"ID":"59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc","Type":"ContainerStarted","Data":"d7d31125b8ed08027e23ebaf3b572bd588e02f68e823d8c75e00294c94bcc055"} Jul 28 12:07:46.957341 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:46.957280 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6jnvs" podStartSLOduration=3.65493498 podStartE2EDuration="4.957260439s" totalImagesPullingTime="1.229533253s" totalInitContainerRuntime="72.792206ms" isStatefulPod=true podCreationTimestamp="2026-07-28 12:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:46.957118189 +0000 UTC m=+90.172831730" watchObservedRunningTime="2026-07-28 12:07:46.957260439 +0000 UTC m=+90.172973979" Jul 28 12:07:47.372801 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:47.372763 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:47.373028 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:47.372838 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:47.377703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:47.377677 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:47.939266 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:47.939238 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:07:54.973614 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:54.973579 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-777457886d-dhbhg"] Jul 28 12:07:54.978215 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:54.978194 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:54.999172 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:54.999142 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777457886d-dhbhg"] Jul 28 12:07:55.057141 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-trusted-ca-bundle\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.057336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-serving-cert\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.057336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-config\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.057336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-oauth-serving-cert\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.057336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-oauth-config\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.057336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-service-ca\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.057336 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.057309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6r77\" (UniqueName: \"kubernetes.io/projected/e50e7792-a5fd-46d8-abdd-2aab499452b6-kube-api-access-k6r77\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158076 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-serving-cert\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158076 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-config\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158366 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-oauth-serving-cert\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158366 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-oauth-config\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158366 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-service-ca\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158366 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6r77\" (UniqueName: \"kubernetes.io/projected/e50e7792-a5fd-46d8-abdd-2aab499452b6-kube-api-access-k6r77\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158366 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-trusted-ca-bundle\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158998 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158911 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-config\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.158998 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.158911 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-service-ca\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.159237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.159115 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-trusted-ca-bundle\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.159237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.159145 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-oauth-serving-cert\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.160768 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.160747 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-oauth-config\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.160891 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.160872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-serving-cert\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.167567 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.167544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6r77\" (UniqueName: \"kubernetes.io/projected/e50e7792-a5fd-46d8-abdd-2aab499452b6-kube-api-access-k6r77\") pod \"console-777457886d-dhbhg\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.286745 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.286601 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:07:55.425287 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.425251 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777457886d-dhbhg"] Jul 28 12:07:55.428391 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:07:55.428368 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50e7792_a5fd_46d8_abdd_2aab499452b6.slice/crio-0abd5892ef929ef1598fdddd2d0b3f3f470d1ae1080f0b3411ee845ce65ef666 WatchSource:0}: Error finding container 0abd5892ef929ef1598fdddd2d0b3f3f470d1ae1080f0b3411ee845ce65ef666: Status 404 returned error can't find the container with id 0abd5892ef929ef1598fdddd2d0b3f3f470d1ae1080f0b3411ee845ce65ef666 Jul 28 12:07:55.964693 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.964637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777457886d-dhbhg" event={"ID":"e50e7792-a5fd-46d8-abdd-2aab499452b6","Type":"ContainerStarted","Data":"483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8"} Jul 28 12:07:55.964926 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.964719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777457886d-dhbhg" event={"ID":"e50e7792-a5fd-46d8-abdd-2aab499452b6","Type":"ContainerStarted","Data":"0abd5892ef929ef1598fdddd2d0b3f3f470d1ae1080f0b3411ee845ce65ef666"} Jul 28 12:07:55.983818 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:55.983762 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-777457886d-dhbhg" podStartSLOduration=1.9837435399999999 podStartE2EDuration="1.98374354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:07:55.983311534 +0000 UTC m=+99.199025074" watchObservedRunningTime="2026-07-28 12:07:55.98374354 +0000 UTC m=+99.199457079" Jul 28 12:07:59.855490 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:07:59.855447 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w2mr5" Jul 28 12:08:05.287678 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:05.287620 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:08:05.288094 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:05.287714 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:08:05.292394 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:05.292369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:08:06.005553 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:06.005517 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:08:06.054678 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:06.054628 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-547cff6dd7-z8spk"] Jul 28 12:08:31.075084 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.075031 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-547cff6dd7-z8spk" podUID="6e17a1a9-7aa1-4540-a661-09d0721f1752" containerName="console" containerID="cri-o://9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d" gracePeriod=15 Jul 28 12:08:31.313822 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.313787 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:08:31.420540 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420437 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-oauth-config\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.420540 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420492 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-oauth-serving-cert\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.420540 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420523 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-serving-cert\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.420540 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420540 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-config\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.420873 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420719 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkk25\" (UniqueName: \"kubernetes.io/projected/6e17a1a9-7aa1-4540-a661-09d0721f1752-kube-api-access-jkk25\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.420873 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420771 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-service-ca\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.420873 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.420801 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-trusted-ca-bundle\") pod \"6e17a1a9-7aa1-4540-a661-09d0721f1752\" (UID: \"6e17a1a9-7aa1-4540-a661-09d0721f1752\") " Jul 28 12:08:31.421065 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.421034 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:08:31.421149 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.421086 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-config" (OuterVolumeSpecName: "console-config") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:08:31.421208 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.421169 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:08:31.421670 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.421619 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:08:31.423074 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.423042 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:08:31.423074 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.423057 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:08:31.423074 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.423048 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e17a1a9-7aa1-4540-a661-09d0721f1752-kube-api-access-jkk25" (OuterVolumeSpecName: "kube-api-access-jkk25") pod "6e17a1a9-7aa1-4540-a661-09d0721f1752" (UID: "6e17a1a9-7aa1-4540-a661-09d0721f1752"). InnerVolumeSpecName "kube-api-access-jkk25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:08:31.521621 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521578 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-oauth-config\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:31.521621 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521611 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-oauth-serving-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:31.521621 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521621 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-serving-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:31.521621 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521631 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-console-config\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:31.521911 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521640 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkk25\" (UniqueName: \"kubernetes.io/projected/6e17a1a9-7aa1-4540-a661-09d0721f1752-kube-api-access-jkk25\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:31.521911 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521673 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:31.521911 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:31.521682 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e17a1a9-7aa1-4540-a661-09d0721f1752-trusted-ca-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:08:32.094678 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.094624 2565 generic.go:356] "Generic (PLEG): container finished" podID="6e17a1a9-7aa1-4540-a661-09d0721f1752" containerID="9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d" exitCode=0 Jul 28 12:08:32.095110 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.094682 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-547cff6dd7-z8spk" Jul 28 12:08:32.095110 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.094708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547cff6dd7-z8spk" event={"ID":"6e17a1a9-7aa1-4540-a661-09d0721f1752","Type":"ContainerDied","Data":"9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d"} Jul 28 12:08:32.095110 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.094760 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-547cff6dd7-z8spk" event={"ID":"6e17a1a9-7aa1-4540-a661-09d0721f1752","Type":"ContainerDied","Data":"8607fdb6f97d70837235cb553dab3d8d855c3690e15243da78d038a99d89a99f"} Jul 28 12:08:32.095110 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.094783 2565 scope.go:117] "RemoveContainer" containerID="9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d" Jul 28 12:08:32.103605 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.103586 2565 scope.go:117] "RemoveContainer" containerID="9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d" Jul 28 12:08:32.103931 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:08:32.103913 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d\": container with ID starting with 9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d not found: ID does not exist" containerID="9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d" Jul 28 12:08:32.103994 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.103941 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d"} err="failed to get container status \"9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d\": rpc error: code = NotFound desc = could not find container \"9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d\": container with ID starting with 9d602bb5c5babbfdc472bb8c0d6e8db9f4768c4c9c12a6fc232ce433ff7b2b4d not found: ID does not exist" Jul 28 12:08:32.121211 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.121178 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-547cff6dd7-z8spk"] Jul 28 12:08:32.127541 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:32.127513 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-547cff6dd7-z8spk"] Jul 28 12:08:33.346394 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:08:33.344126 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e17a1a9-7aa1-4540-a661-09d0721f1752" path="/var/lib/kubelet/pods/6e17a1a9-7aa1-4540-a661-09d0721f1752/volumes" Jul 28 12:09:09.115820 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.115736 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b985654c7-dq89n"] Jul 28 12:09:09.116288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.116035 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e17a1a9-7aa1-4540-a661-09d0721f1752" containerName="console" Jul 28 12:09:09.116288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.116048 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e17a1a9-7aa1-4540-a661-09d0721f1752" containerName="console" Jul 28 12:09:09.116288 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.116092 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e17a1a9-7aa1-4540-a661-09d0721f1752" containerName="console" Jul 28 12:09:09.118887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.118868 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.135829 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.135790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b985654c7-dq89n"] Jul 28 12:09:09.209763 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.209722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-serving-cert\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.209763 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.209761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/337b4408-5e58-4e91-b405-c1b931c43f38-kube-api-access-8lnbn\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.209996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.209781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-console-config\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.209996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.209901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-oauth-serving-cert\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.209996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.209944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-service-ca\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.209996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.209972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-trusted-ca-bundle\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.210130 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.210005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-oauth-config\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-oauth-serving-cert\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-service-ca\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-trusted-ca-bundle\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-oauth-config\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-serving-cert\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310833 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/337b4408-5e58-4e91-b405-c1b931c43f38-kube-api-access-8lnbn\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.310916 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.310862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-console-config\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.311434 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.311401 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-service-ca\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.311539 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.311523 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-oauth-serving-cert\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.311595 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.311559 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-console-config\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.311852 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.311831 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-trusted-ca-bundle\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.313486 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.313463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-oauth-config\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.313703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.313680 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-serving-cert\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.327502 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.327462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/337b4408-5e58-4e91-b405-c1b931c43f38-kube-api-access-8lnbn\") pod \"console-5b985654c7-dq89n\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.428167 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.428060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:09.576429 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:09.576393 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b985654c7-dq89n"] Jul 28 12:09:09.579770 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:09:09.579733 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337b4408_5e58_4e91_b405_c1b931c43f38.slice/crio-cb912488442c1dfca3c4205a179768a75f1cde9e17874ed3081cc1a6b50df437 WatchSource:0}: Error finding container cb912488442c1dfca3c4205a179768a75f1cde9e17874ed3081cc1a6b50df437: Status 404 returned error can't find the container with id cb912488442c1dfca3c4205a179768a75f1cde9e17874ed3081cc1a6b50df437 Jul 28 12:09:10.222098 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:10.222062 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b985654c7-dq89n" event={"ID":"337b4408-5e58-4e91-b405-c1b931c43f38","Type":"ContainerStarted","Data":"cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7"} Jul 28 12:09:10.222507 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:10.222112 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b985654c7-dq89n" event={"ID":"337b4408-5e58-4e91-b405-c1b931c43f38","Type":"ContainerStarted","Data":"cb912488442c1dfca3c4205a179768a75f1cde9e17874ed3081cc1a6b50df437"} Jul 28 12:09:10.244347 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:10.244290 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b985654c7-dq89n" podStartSLOduration=1.244273921 podStartE2EDuration="1.244273921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:09:10.242712684 +0000 UTC m=+173.458426227" watchObservedRunningTime="2026-07-28 12:09:10.244273921 +0000 UTC m=+173.459987461" Jul 28 12:09:19.429197 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:19.429147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:19.429640 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:19.429234 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:19.434006 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:19.433976 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:20.258753 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:20.258728 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:09:20.318268 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:20.318232 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777457886d-dhbhg"] Jul 28 12:09:45.337817 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.337743 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-777457886d-dhbhg" podUID="e50e7792-a5fd-46d8-abdd-2aab499452b6" containerName="console" containerID="cri-o://483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8" gracePeriod=15 Jul 28 12:09:45.581482 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.581453 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:09:45.682515 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682414 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-serving-cert\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.682515 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682465 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-service-ca\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.682515 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682497 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-trusted-ca-bundle\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.682838 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682526 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-config\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.682838 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682635 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-oauth-serving-cert\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.682838 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682700 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6r77\" (UniqueName: \"kubernetes.io/projected/e50e7792-a5fd-46d8-abdd-2aab499452b6-kube-api-access-k6r77\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.682985 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682855 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-oauth-config\") pod \"e50e7792-a5fd-46d8-abdd-2aab499452b6\" (UID: \"e50e7792-a5fd-46d8-abdd-2aab499452b6\") " Jul 28 12:09:45.683108 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.683083 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:09:45.683170 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.682974 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-config" (OuterVolumeSpecName: "console-config") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:09:45.683170 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.683135 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:09:45.683272 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.683228 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:09:45.684973 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.684948 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:09:45.685083 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.685000 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:09:45.685083 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.685004 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50e7792-a5fd-46d8-abdd-2aab499452b6-kube-api-access-k6r77" (OuterVolumeSpecName: "kube-api-access-k6r77") pod "e50e7792-a5fd-46d8-abdd-2aab499452b6" (UID: "e50e7792-a5fd-46d8-abdd-2aab499452b6"). InnerVolumeSpecName "kube-api-access-k6r77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:09:45.783546 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783505 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-serving-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:45.783546 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783540 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:45.783546 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783550 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-trusted-ca-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:45.783837 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783558 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-config\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:45.783837 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783569 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e50e7792-a5fd-46d8-abdd-2aab499452b6-oauth-serving-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:45.783837 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783577 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6r77\" (UniqueName: \"kubernetes.io/projected/e50e7792-a5fd-46d8-abdd-2aab499452b6-kube-api-access-k6r77\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:45.783837 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:45.783586 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e50e7792-a5fd-46d8-abdd-2aab499452b6-console-oauth-config\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:09:46.342786 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.342751 2565 generic.go:356] "Generic (PLEG): container finished" podID="e50e7792-a5fd-46d8-abdd-2aab499452b6" containerID="483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8" exitCode=0 Jul 28 12:09:46.343207 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.342798 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777457886d-dhbhg" Jul 28 12:09:46.343207 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.342840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777457886d-dhbhg" event={"ID":"e50e7792-a5fd-46d8-abdd-2aab499452b6","Type":"ContainerDied","Data":"483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8"} Jul 28 12:09:46.343207 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.342893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777457886d-dhbhg" event={"ID":"e50e7792-a5fd-46d8-abdd-2aab499452b6","Type":"ContainerDied","Data":"0abd5892ef929ef1598fdddd2d0b3f3f470d1ae1080f0b3411ee845ce65ef666"} Jul 28 12:09:46.343207 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.342921 2565 scope.go:117] "RemoveContainer" containerID="483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8" Jul 28 12:09:46.351339 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.351318 2565 scope.go:117] "RemoveContainer" containerID="483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8" Jul 28 12:09:46.351636 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:09:46.351618 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8\": container with ID starting with 483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8 not found: ID does not exist" containerID="483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8" Jul 28 12:09:46.351788 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.351645 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8"} err="failed to get container status \"483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8\": rpc error: code = NotFound desc = could not find container \"483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8\": container with ID starting with 483677ebadd4535a9caca26a27c0232459e8215207e5e2ab576a7b14a8cfd9e8 not found: ID does not exist" Jul 28 12:09:46.365861 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.365832 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777457886d-dhbhg"] Jul 28 12:09:46.370445 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:46.370418 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-777457886d-dhbhg"] Jul 28 12:09:47.343605 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:09:47.343565 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50e7792-a5fd-46d8-abdd-2aab499452b6" path="/var/lib/kubelet/pods/e50e7792-a5fd-46d8-abdd-2aab499452b6/volumes" Jul 28 12:11:17.174445 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:11:17.174414 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 12:13:09.714188 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.714153 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb6459f8c-5dh5s"] Jul 28 12:13:09.714700 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.714407 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50e7792-a5fd-46d8-abdd-2aab499452b6" containerName="console" Jul 28 12:13:09.714700 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.714417 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50e7792-a5fd-46d8-abdd-2aab499452b6" containerName="console" Jul 28 12:13:09.714700 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.714456 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50e7792-a5fd-46d8-abdd-2aab499452b6" containerName="console" Jul 28 12:13:09.717165 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.717148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.729250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.729223 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb6459f8c-5dh5s"] Jul 28 12:13:09.733992 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.733966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-trusted-ca-bundle\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.734154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.734000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-oauth-serving-cert\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.734154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.734029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c443788-4231-4604-94d8-623139e2b052-console-serving-cert\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.734154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.734054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-service-ca\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.734154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.734089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c443788-4231-4604-94d8-623139e2b052-console-oauth-config\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.734154 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.734133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-console-config\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.734335 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.734164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5kfv\" (UniqueName: \"kubernetes.io/projected/9c443788-4231-4604-94d8-623139e2b052-kube-api-access-w5kfv\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835314 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-trusted-ca-bundle\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835314 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-oauth-serving-cert\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835551 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c443788-4231-4604-94d8-623139e2b052-console-serving-cert\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835551 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-service-ca\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835551 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835399 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c443788-4231-4604-94d8-623139e2b052-console-oauth-config\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835735 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-console-config\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.835735 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.835607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5kfv\" (UniqueName: \"kubernetes.io/projected/9c443788-4231-4604-94d8-623139e2b052-kube-api-access-w5kfv\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.836269 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.836239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-service-ca\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.836382 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.836240 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-oauth-serving-cert\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.836599 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.836575 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-console-config\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.836774 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.836750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c443788-4231-4604-94d8-623139e2b052-trusted-ca-bundle\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.838145 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.838115 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c443788-4231-4604-94d8-623139e2b052-console-serving-cert\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.838252 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.838154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c443788-4231-4604-94d8-623139e2b052-console-oauth-config\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:09.845213 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:09.845189 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5kfv\" (UniqueName: \"kubernetes.io/projected/9c443788-4231-4604-94d8-623139e2b052-kube-api-access-w5kfv\") pod \"console-5cb6459f8c-5dh5s\" (UID: \"9c443788-4231-4604-94d8-623139e2b052\") " pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:10.025469 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:10.025359 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:10.163802 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:10.163770 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb6459f8c-5dh5s"] Jul 28 12:13:10.166748 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:13:10.166721 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c443788_4231_4604_94d8_623139e2b052.slice/crio-ca5d9b98e0d58936bf468fdd8e55cec016c4cfaff598cf493bc791099ab8a60d WatchSource:0}: Error finding container ca5d9b98e0d58936bf468fdd8e55cec016c4cfaff598cf493bc791099ab8a60d: Status 404 returned error can't find the container with id ca5d9b98e0d58936bf468fdd8e55cec016c4cfaff598cf493bc791099ab8a60d Jul 28 12:13:11.005703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:11.005671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb6459f8c-5dh5s" event={"ID":"9c443788-4231-4604-94d8-623139e2b052","Type":"ContainerStarted","Data":"495bca6dbc9d6c35977eaadb655319c2cc53f8948b8829f410a7efcb4bacd1be"} Jul 28 12:13:11.006099 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:11.005719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb6459f8c-5dh5s" event={"ID":"9c443788-4231-4604-94d8-623139e2b052","Type":"ContainerStarted","Data":"ca5d9b98e0d58936bf468fdd8e55cec016c4cfaff598cf493bc791099ab8a60d"} Jul 28 12:13:11.025634 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:11.025573 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb6459f8c-5dh5s" podStartSLOduration=2.025554178 podStartE2EDuration="2.025554178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:13:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:13:11.025303981 +0000 UTC m=+414.241017520" watchObservedRunningTime="2026-07-28 12:13:11.025554178 +0000 UTC m=+414.241267719" Jul 28 12:13:20.026224 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:20.026167 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:20.026774 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:20.026245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:20.031049 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:20.031026 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:20.039549 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:20.039523 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb6459f8c-5dh5s" Jul 28 12:13:20.101499 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:20.101463 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b985654c7-dq89n"] Jul 28 12:13:45.120707 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.120587 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b985654c7-dq89n" podUID="337b4408-5e58-4e91-b405-c1b931c43f38" containerName="console" containerID="cri-o://cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7" gracePeriod=15 Jul 28 12:13:45.361934 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.361909 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:13:45.492235 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492196 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-service-ca\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492243 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-console-config\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492266 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-trusted-ca-bundle\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492295 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-oauth-config\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492332 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-oauth-serving-cert\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492379 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-serving-cert\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492433 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492416 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/337b4408-5e58-4e91-b405-c1b931c43f38-kube-api-access-8lnbn\") pod \"337b4408-5e58-4e91-b405-c1b931c43f38\" (UID: \"337b4408-5e58-4e91-b405-c1b931c43f38\") " Jul 28 12:13:45.492751 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492674 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-console-config" (OuterVolumeSpecName: "console-config") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:13:45.492751 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492730 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-service-ca" (OuterVolumeSpecName: "service-ca") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:13:45.492868 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492796 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:13:45.492868 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.492838 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:13:45.494770 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.494744 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337b4408-5e58-4e91-b405-c1b931c43f38-kube-api-access-8lnbn" (OuterVolumeSpecName: "kube-api-access-8lnbn") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "kube-api-access-8lnbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:13:45.494889 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.494787 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:13:45.494889 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.494845 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "337b4408-5e58-4e91-b405-c1b931c43f38" (UID: "337b4408-5e58-4e91-b405-c1b931c43f38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:13:45.592891 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592860 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-service-ca\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:45.592891 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592886 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-console-config\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:45.592891 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592895 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-trusted-ca-bundle\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:45.593102 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592905 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-oauth-config\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:45.593102 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592914 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/337b4408-5e58-4e91-b405-c1b931c43f38-oauth-serving-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:45.593102 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592922 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/337b4408-5e58-4e91-b405-c1b931c43f38-console-serving-cert\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:45.593102 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:45.592930 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lnbn\" (UniqueName: \"kubernetes.io/projected/337b4408-5e58-4e91-b405-c1b931c43f38-kube-api-access-8lnbn\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:13:46.122513 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.122471 2565 generic.go:356] "Generic (PLEG): container finished" podID="337b4408-5e58-4e91-b405-c1b931c43f38" containerID="cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7" exitCode=0 Jul 28 12:13:46.122957 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.122519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b985654c7-dq89n" event={"ID":"337b4408-5e58-4e91-b405-c1b931c43f38","Type":"ContainerDied","Data":"cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7"} Jul 28 12:13:46.122957 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.122558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b985654c7-dq89n" event={"ID":"337b4408-5e58-4e91-b405-c1b931c43f38","Type":"ContainerDied","Data":"cb912488442c1dfca3c4205a179768a75f1cde9e17874ed3081cc1a6b50df437"} Jul 28 12:13:46.122957 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.122577 2565 scope.go:117] "RemoveContainer" containerID="cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7" Jul 28 12:13:46.122957 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.122523 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b985654c7-dq89n" Jul 28 12:13:46.130525 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.130507 2565 scope.go:117] "RemoveContainer" containerID="cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7" Jul 28 12:13:46.130806 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:13:46.130784 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7\": container with ID starting with cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7 not found: ID does not exist" containerID="cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7" Jul 28 12:13:46.130862 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.130816 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7"} err="failed to get container status \"cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7\": rpc error: code = NotFound desc = could not find container \"cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7\": container with ID starting with cff6b22043d64fc3bec4bbf5afb29c663d4835b90d5da95ad595f2ed6a51e0a7 not found: ID does not exist" Jul 28 12:13:46.144831 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.144805 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b985654c7-dq89n"] Jul 28 12:13:46.149591 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:46.149572 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b985654c7-dq89n"] Jul 28 12:13:47.342908 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:13:47.342875 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337b4408-5e58-4e91-b405-c1b931c43f38" path="/var/lib/kubelet/pods/337b4408-5e58-4e91-b405-c1b931c43f38/volumes" Jul 28 12:17:36.519602 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.519571 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-mglhp"] Jul 28 12:17:36.521972 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.519840 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337b4408-5e58-4e91-b405-c1b931c43f38" containerName="console" Jul 28 12:17:36.521972 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.519852 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="337b4408-5e58-4e91-b405-c1b931c43f38" containerName="console" Jul 28 12:17:36.521972 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.519904 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="337b4408-5e58-4e91-b405-c1b931c43f38" containerName="console" Jul 28 12:17:36.522869 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.522851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.526406 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.526381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jul 28 12:17:36.526513 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.526381 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 12:17:36.527338 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.527319 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-g7tlb\"" Jul 28 12:17:36.527437 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.527365 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 12:17:36.533454 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.533433 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mglhp"] Jul 28 12:17:36.572133 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.572105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hg4\" (UniqueName: \"kubernetes.io/projected/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-kube-api-access-x6hg4\") pod \"postgres-864846d4f5-mglhp\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.572298 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.572152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-postgresdata\") pod \"postgres-864846d4f5-mglhp\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.672965 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.672922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hg4\" (UniqueName: \"kubernetes.io/projected/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-kube-api-access-x6hg4\") pod \"postgres-864846d4f5-mglhp\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.673178 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.672982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-postgresdata\") pod \"postgres-864846d4f5-mglhp\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.673318 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.673298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-postgresdata\") pod \"postgres-864846d4f5-mglhp\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.682478 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.682447 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hg4\" (UniqueName: \"kubernetes.io/projected/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-kube-api-access-x6hg4\") pod \"postgres-864846d4f5-mglhp\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.831363 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.831270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:17:36.962900 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.962870 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mglhp"] Jul 28 12:17:36.966354 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:17:36.966325 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f3f8c95_74f1_4c08_85ce_80a2a4acc878.slice/crio-0ac41c119611c6aa89ba87bc4ecf6d3ca16fc7e72cc50f66c5821b583a60e85a WatchSource:0}: Error finding container 0ac41c119611c6aa89ba87bc4ecf6d3ca16fc7e72cc50f66c5821b583a60e85a: Status 404 returned error can't find the container with id 0ac41c119611c6aa89ba87bc4ecf6d3ca16fc7e72cc50f66c5821b583a60e85a Jul 28 12:17:36.968284 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:36.968269 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:17:37.857496 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:37.857461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mglhp" event={"ID":"2f3f8c95-74f1-4c08-85ce-80a2a4acc878","Type":"ContainerStarted","Data":"0ac41c119611c6aa89ba87bc4ecf6d3ca16fc7e72cc50f66c5821b583a60e85a"} Jul 28 12:17:43.880259 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:17:43.880221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mglhp" event={"ID":"2f3f8c95-74f1-4c08-85ce-80a2a4acc878","Type":"ContainerStarted","Data":"80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7"} Jul 28 12:19:14.581382 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.581324 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-mglhp" podStartSLOduration=92.281679382 podStartE2EDuration="1m38.581306986s" totalImagesPullingTime="6.299627604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:17:43.923246785 +0000 UTC m=+687.138960392" watchObservedRunningTime="2026-07-28 12:19:14.581306986 +0000 UTC m=+777.797020526" Jul 28 12:19:14.582297 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.582281 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mglhp"] Jul 28 12:19:14.582446 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.582428 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-mglhp" podUID="2f3f8c95-74f1-4c08-85ce-80a2a4acc878" containerName="postgres" containerID="cri-o://80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7" gracePeriod=30 Jul 28 12:19:14.817940 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.817908 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:19:14.841952 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.841874 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-postgresdata\") pod \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " Jul 28 12:19:14.841952 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.841937 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6hg4\" (UniqueName: \"kubernetes.io/projected/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-kube-api-access-x6hg4\") pod \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\" (UID: \"2f3f8c95-74f1-4c08-85ce-80a2a4acc878\") " Jul 28 12:19:14.844252 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.844217 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-kube-api-access-x6hg4" (OuterVolumeSpecName: "kube-api-access-x6hg4") pod "2f3f8c95-74f1-4c08-85ce-80a2a4acc878" (UID: "2f3f8c95-74f1-4c08-85ce-80a2a4acc878"). InnerVolumeSpecName "kube-api-access-x6hg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:19:14.874817 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.874775 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "2f3f8c95-74f1-4c08-85ce-80a2a4acc878" (UID: "2f3f8c95-74f1-4c08-85ce-80a2a4acc878"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:19:14.943177 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.943143 2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-postgresdata\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:19:14.943177 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:14.943175 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6hg4\" (UniqueName: \"kubernetes.io/projected/2f3f8c95-74f1-4c08-85ce-80a2a4acc878-kube-api-access-x6hg4\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:19:15.172481 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.172389 2565 generic.go:356] "Generic (PLEG): container finished" podID="2f3f8c95-74f1-4c08-85ce-80a2a4acc878" containerID="80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7" exitCode=0 Jul 28 12:19:15.172481 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.172432 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-mglhp" Jul 28 12:19:15.172686 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.172481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mglhp" event={"ID":"2f3f8c95-74f1-4c08-85ce-80a2a4acc878","Type":"ContainerDied","Data":"80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7"} Jul 28 12:19:15.172686 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.172522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-mglhp" event={"ID":"2f3f8c95-74f1-4c08-85ce-80a2a4acc878","Type":"ContainerDied","Data":"0ac41c119611c6aa89ba87bc4ecf6d3ca16fc7e72cc50f66c5821b583a60e85a"} Jul 28 12:19:15.172686 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.172539 2565 scope.go:117] "RemoveContainer" containerID="80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7" Jul 28 12:19:15.180223 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.180208 2565 scope.go:117] "RemoveContainer" containerID="80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7" Jul 28 12:19:15.180500 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:19:15.180478 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7\": container with ID starting with 80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7 not found: ID does not exist" containerID="80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7" Jul 28 12:19:15.180570 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.180508 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7"} err="failed to get container status \"80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7\": rpc error: code = NotFound desc = could not find container \"80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7\": container with ID starting with 80099103159f42e4ae884a478b49456da835d0379538e964499b0d03454a0ae7 not found: ID does not exist" Jul 28 12:19:15.200142 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.200115 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mglhp"] Jul 28 12:19:15.204071 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.204053 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-mglhp"] Jul 28 12:19:15.344745 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:19:15.344708 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3f8c95-74f1-4c08-85ce-80a2a4acc878" path="/var/lib/kubelet/pods/2f3f8c95-74f1-4c08-85ce-80a2a4acc878/volumes" Jul 28 12:25:29.017389 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.017354 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n8g5w"] Jul 28 12:25:29.019781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.017709 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3f8c95-74f1-4c08-85ce-80a2a4acc878" containerName="postgres" Jul 28 12:25:29.019781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.017724 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3f8c95-74f1-4c08-85ce-80a2a4acc878" containerName="postgres" Jul 28 12:25:29.019781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.017781 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3f8c95-74f1-4c08-85ce-80a2a4acc878" containerName="postgres" Jul 28 12:25:29.020678 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.020644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:25:29.023159 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.023135 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jul 28 12:25:29.023993 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.023974 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-jgvbv\"" Jul 28 12:25:29.024104 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.024077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jul 28 12:25:29.034940 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.034911 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n8g5w"] Jul 28 12:25:29.072431 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.072397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt4gh\" (UniqueName: \"kubernetes.io/projected/33b2d425-8517-46e5-8c2c-d887469d8eba-kube-api-access-jt4gh\") pod \"redis-69bbd798b6-n8g5w\" (UID: \"33b2d425-8517-46e5-8c2c-d887469d8eba\") " pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:25:29.173016 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.172976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt4gh\" (UniqueName: \"kubernetes.io/projected/33b2d425-8517-46e5-8c2c-d887469d8eba-kube-api-access-jt4gh\") pod \"redis-69bbd798b6-n8g5w\" (UID: \"33b2d425-8517-46e5-8c2c-d887469d8eba\") " pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:25:29.181918 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.181884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt4gh\" (UniqueName: \"kubernetes.io/projected/33b2d425-8517-46e5-8c2c-d887469d8eba-kube-api-access-jt4gh\") pod \"redis-69bbd798b6-n8g5w\" (UID: \"33b2d425-8517-46e5-8c2c-d887469d8eba\") " pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:25:29.329774 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.329676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:25:29.461145 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.461106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n8g5w"] Jul 28 12:25:29.464512 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:25:29.464484 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33b2d425_8517_46e5_8c2c_d887469d8eba.slice/crio-cd27b54489cd8fde1a8d75b30872c2ace76fc8f0c44ee46afbf6e446a8f566e9 WatchSource:0}: Error finding container cd27b54489cd8fde1a8d75b30872c2ace76fc8f0c44ee46afbf6e446a8f566e9: Status 404 returned error can't find the container with id cd27b54489cd8fde1a8d75b30872c2ace76fc8f0c44ee46afbf6e446a8f566e9 Jul 28 12:25:29.466776 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:29.466760 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:25:30.387958 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:30.387915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" event={"ID":"33b2d425-8517-46e5-8c2c-d887469d8eba","Type":"ContainerStarted","Data":"cd27b54489cd8fde1a8d75b30872c2ace76fc8f0c44ee46afbf6e446a8f566e9"} Jul 28 12:25:31.392107 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:31.392066 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" event={"ID":"33b2d425-8517-46e5-8c2c-d887469d8eba","Type":"ContainerStarted","Data":"fa5758f2c16c4f86e408d7d83e7fd7d86761ab002bfff6a6bdea1add6f50c9a3"} Jul 28 12:25:31.415357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:31.415308 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" podStartSLOduration=1.214681328 podStartE2EDuration="2.41529264s" totalImagesPullingTime="1.200611312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:25:31.414592086 +0000 UTC m=+1154.630305651" watchObservedRunningTime="2026-07-28 12:25:31.41529264 +0000 UTC m=+1154.631006180" Jul 28 12:25:34.491104 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.491072 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fpx42"] Jul 28 12:25:34.494249 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.494227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.496716 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.496694 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jul 28 12:25:34.499961 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.499935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fpx42"] Jul 28 12:25:34.614715 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.614676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwz9b\" (UniqueName: \"kubernetes.io/projected/8255ac7c-56fd-4c02-87ee-57d6be635df9-kube-api-access-kwz9b\") pod \"postgres-864846d4f5-fpx42\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.614715 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.614732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8255ac7c-56fd-4c02-87ee-57d6be635df9-postgresdata\") pod \"postgres-864846d4f5-fpx42\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.715906 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.715859 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwz9b\" (UniqueName: \"kubernetes.io/projected/8255ac7c-56fd-4c02-87ee-57d6be635df9-kube-api-access-kwz9b\") pod \"postgres-864846d4f5-fpx42\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.716098 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.715919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8255ac7c-56fd-4c02-87ee-57d6be635df9-postgresdata\") pod \"postgres-864846d4f5-fpx42\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.716271 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.716256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8255ac7c-56fd-4c02-87ee-57d6be635df9-postgresdata\") pod \"postgres-864846d4f5-fpx42\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.724595 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.724562 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwz9b\" (UniqueName: \"kubernetes.io/projected/8255ac7c-56fd-4c02-87ee-57d6be635df9-kube-api-access-kwz9b\") pod \"postgres-864846d4f5-fpx42\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.805328 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.805227 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:25:34.931946 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:34.931914 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fpx42"] Jul 28 12:25:34.935550 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:25:34.935519 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8255ac7c_56fd_4c02_87ee_57d6be635df9.slice/crio-7a992084f1f7dd0154548730e835d7ea44006efb1230ed3ec400e8a942817dcb WatchSource:0}: Error finding container 7a992084f1f7dd0154548730e835d7ea44006efb1230ed3ec400e8a942817dcb: Status 404 returned error can't find the container with id 7a992084f1f7dd0154548730e835d7ea44006efb1230ed3ec400e8a942817dcb Jul 28 12:25:35.406610 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:35.406574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" event={"ID":"8255ac7c-56fd-4c02-87ee-57d6be635df9","Type":"ContainerStarted","Data":"8e239926b9a2b1c56d8980db519eb7cb7cd864da5d5bede07d017b7f6168f9a0"} Jul 28 12:25:35.406610 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:25:35.406616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" event={"ID":"8255ac7c-56fd-4c02-87ee-57d6be635df9","Type":"ContainerStarted","Data":"7a992084f1f7dd0154548730e835d7ea44006efb1230ed3ec400e8a942817dcb"} Jul 28 12:27:54.683069 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.683014 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" podStartSLOduration=140.682996241 podStartE2EDuration="2m20.682996241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:25:35.426828442 +0000 UTC m=+1158.642541983" watchObservedRunningTime="2026-07-28 12:27:54.682996241 +0000 UTC m=+1297.898709782" Jul 28 12:27:54.683739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.683719 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fpx42"] Jul 28 12:27:54.683918 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.683899 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" podUID="8255ac7c-56fd-4c02-87ee-57d6be635df9" containerName="postgres" containerID="cri-o://8e239926b9a2b1c56d8980db519eb7cb7cd864da5d5bede07d017b7f6168f9a0" gracePeriod=30 Jul 28 12:27:54.689127 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.689099 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n8g5w"] Jul 28 12:27:54.689529 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.689480 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" podUID="33b2d425-8517-46e5-8c2c-d887469d8eba" containerName="redis" containerID="cri-o://fa5758f2c16c4f86e408d7d83e7fd7d86761ab002bfff6a6bdea1add6f50c9a3" gracePeriod=30 Jul 28 12:27:54.866955 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.866923 2565 generic.go:356] "Generic (PLEG): container finished" podID="8255ac7c-56fd-4c02-87ee-57d6be635df9" containerID="8e239926b9a2b1c56d8980db519eb7cb7cd864da5d5bede07d017b7f6168f9a0" exitCode=0 Jul 28 12:27:54.867115 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.867008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" event={"ID":"8255ac7c-56fd-4c02-87ee-57d6be635df9","Type":"ContainerDied","Data":"8e239926b9a2b1c56d8980db519eb7cb7cd864da5d5bede07d017b7f6168f9a0"} Jul 28 12:27:54.868430 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.868406 2565 generic.go:356] "Generic (PLEG): container finished" podID="33b2d425-8517-46e5-8c2c-d887469d8eba" containerID="fa5758f2c16c4f86e408d7d83e7fd7d86761ab002bfff6a6bdea1add6f50c9a3" exitCode=0 Jul 28 12:27:54.868542 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.868463 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" event={"ID":"33b2d425-8517-46e5-8c2c-d887469d8eba","Type":"ContainerDied","Data":"fa5758f2c16c4f86e408d7d83e7fd7d86761ab002bfff6a6bdea1add6f50c9a3"} Jul 28 12:27:54.929209 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.929182 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:27:54.946509 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:54.946429 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:27:55.029744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.029711 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8255ac7c-56fd-4c02-87ee-57d6be635df9-postgresdata\") pod \"8255ac7c-56fd-4c02-87ee-57d6be635df9\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " Jul 28 12:27:55.029953 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.029770 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwz9b\" (UniqueName: \"kubernetes.io/projected/8255ac7c-56fd-4c02-87ee-57d6be635df9-kube-api-access-kwz9b\") pod \"8255ac7c-56fd-4c02-87ee-57d6be635df9\" (UID: \"8255ac7c-56fd-4c02-87ee-57d6be635df9\") " Jul 28 12:27:55.029953 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.029791 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt4gh\" (UniqueName: \"kubernetes.io/projected/33b2d425-8517-46e5-8c2c-d887469d8eba-kube-api-access-jt4gh\") pod \"33b2d425-8517-46e5-8c2c-d887469d8eba\" (UID: \"33b2d425-8517-46e5-8c2c-d887469d8eba\") " Jul 28 12:27:55.032085 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.032052 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8255ac7c-56fd-4c02-87ee-57d6be635df9-kube-api-access-kwz9b" (OuterVolumeSpecName: "kube-api-access-kwz9b") pod "8255ac7c-56fd-4c02-87ee-57d6be635df9" (UID: "8255ac7c-56fd-4c02-87ee-57d6be635df9"). InnerVolumeSpecName "kube-api-access-kwz9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:27:55.032202 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.032047 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b2d425-8517-46e5-8c2c-d887469d8eba-kube-api-access-jt4gh" (OuterVolumeSpecName: "kube-api-access-jt4gh") pod "33b2d425-8517-46e5-8c2c-d887469d8eba" (UID: "33b2d425-8517-46e5-8c2c-d887469d8eba"). InnerVolumeSpecName "kube-api-access-jt4gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:27:55.059545 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.059506 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8255ac7c-56fd-4c02-87ee-57d6be635df9-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "8255ac7c-56fd-4c02-87ee-57d6be635df9" (UID: "8255ac7c-56fd-4c02-87ee-57d6be635df9"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:27:55.130622 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.130579 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwz9b\" (UniqueName: \"kubernetes.io/projected/8255ac7c-56fd-4c02-87ee-57d6be635df9-kube-api-access-kwz9b\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:27:55.130622 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.130608 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt4gh\" (UniqueName: \"kubernetes.io/projected/33b2d425-8517-46e5-8c2c-d887469d8eba-kube-api-access-jt4gh\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:27:55.130622 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.130620 2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8255ac7c-56fd-4c02-87ee-57d6be635df9-postgresdata\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:27:55.873217 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.873180 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" Jul 28 12:27:55.873217 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.873191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-fpx42" event={"ID":"8255ac7c-56fd-4c02-87ee-57d6be635df9","Type":"ContainerDied","Data":"7a992084f1f7dd0154548730e835d7ea44006efb1230ed3ec400e8a942817dcb"} Jul 28 12:27:55.873802 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.873253 2565 scope.go:117] "RemoveContainer" containerID="8e239926b9a2b1c56d8980db519eb7cb7cd864da5d5bede07d017b7f6168f9a0" Jul 28 12:27:55.874599 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.874444 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" event={"ID":"33b2d425-8517-46e5-8c2c-d887469d8eba","Type":"ContainerDied","Data":"cd27b54489cd8fde1a8d75b30872c2ace76fc8f0c44ee46afbf6e446a8f566e9"} Jul 28 12:27:55.874599 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.874499 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-n8g5w" Jul 28 12:27:55.881335 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.881318 2565 scope.go:117] "RemoveContainer" containerID="fa5758f2c16c4f86e408d7d83e7fd7d86761ab002bfff6a6bdea1add6f50c9a3" Jul 28 12:27:55.889399 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.889377 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fpx42"] Jul 28 12:27:55.891767 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.891744 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-fpx42"] Jul 28 12:27:55.903060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.903035 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n8g5w"] Jul 28 12:27:55.906836 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:55.906814 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-n8g5w"] Jul 28 12:27:57.343540 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:57.343510 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b2d425-8517-46e5-8c2c-d887469d8eba" path="/var/lib/kubelet/pods/33b2d425-8517-46e5-8c2c-d887469d8eba/volumes" Jul 28 12:27:57.343947 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:27:57.343858 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8255ac7c-56fd-4c02-87ee-57d6be635df9" path="/var/lib/kubelet/pods/8255ac7c-56fd-4c02-87ee-57d6be635df9/volumes" Jul 28 12:28:11.799619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799580 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b"] Jul 28 12:28:11.800031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799828 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b2d425-8517-46e5-8c2c-d887469d8eba" containerName="redis" Jul 28 12:28:11.800031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799840 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b2d425-8517-46e5-8c2c-d887469d8eba" containerName="redis" Jul 28 12:28:11.800031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799851 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8255ac7c-56fd-4c02-87ee-57d6be635df9" containerName="postgres" Jul 28 12:28:11.800031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799856 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8255ac7c-56fd-4c02-87ee-57d6be635df9" containerName="postgres" Jul 28 12:28:11.800031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799900 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b2d425-8517-46e5-8c2c-d887469d8eba" containerName="redis" Jul 28 12:28:11.800031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.799907 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8255ac7c-56fd-4c02-87ee-57d6be635df9" containerName="postgres" Jul 28 12:28:11.807806 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.807786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:11.810787 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.810760 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 28 12:28:11.811557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.811539 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 28 12:28:11.811557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.811549 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-qq258\"" Jul 28 12:28:11.819000 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.818974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b"] Jul 28 12:28:11.951386 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:11.951327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5tvg\" (UniqueName: \"kubernetes.io/projected/2db41d38-4c13-47d5-a235-6d5766e7efbc-kube-api-access-j5tvg\") pod \"feast-operator-controller-manager-7495bcd-mng5b\" (UID: \"2db41d38-4c13-47d5-a235-6d5766e7efbc\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:12.052070 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:12.051987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5tvg\" (UniqueName: \"kubernetes.io/projected/2db41d38-4c13-47d5-a235-6d5766e7efbc-kube-api-access-j5tvg\") pod \"feast-operator-controller-manager-7495bcd-mng5b\" (UID: \"2db41d38-4c13-47d5-a235-6d5766e7efbc\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:12.063719 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:12.063680 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5tvg\" (UniqueName: \"kubernetes.io/projected/2db41d38-4c13-47d5-a235-6d5766e7efbc-kube-api-access-j5tvg\") pod \"feast-operator-controller-manager-7495bcd-mng5b\" (UID: \"2db41d38-4c13-47d5-a235-6d5766e7efbc\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:12.117428 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:12.117386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:12.258775 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:12.258745 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b"] Jul 28 12:28:12.261166 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:28:12.261133 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db41d38_4c13_47d5_a235_6d5766e7efbc.slice/crio-197519c9090e2facd6ce1a3541d63fe47b0b7194349dffe2604ab11b615bde71 WatchSource:0}: Error finding container 197519c9090e2facd6ce1a3541d63fe47b0b7194349dffe2604ab11b615bde71: Status 404 returned error can't find the container with id 197519c9090e2facd6ce1a3541d63fe47b0b7194349dffe2604ab11b615bde71 Jul 28 12:28:12.941206 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:12.941158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" event={"ID":"2db41d38-4c13-47d5-a235-6d5766e7efbc","Type":"ContainerStarted","Data":"197519c9090e2facd6ce1a3541d63fe47b0b7194349dffe2604ab11b615bde71"} Jul 28 12:28:14.952015 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:14.951977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" event={"ID":"2db41d38-4c13-47d5-a235-6d5766e7efbc","Type":"ContainerStarted","Data":"7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5"} Jul 28 12:28:14.952481 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:14.952086 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:14.999441 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:14.999381 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" podStartSLOduration=1.6241946459999999 podStartE2EDuration="3.99936655s" totalImagesPullingTime="2.375171904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:28:14.997049071 +0000 UTC m=+1318.212762623" watchObservedRunningTime="2026-07-28 12:28:14.99936655 +0000 UTC m=+1318.215080089" Jul 28 12:28:25.958843 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:25.958811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:28:28.567072 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.567031 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l"] Jul 28 12:28:28.572941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.572918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.577678 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.577627 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 12:28:28.577898 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.577686 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 28 12:28:28.577978 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.577685 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 28 12:28:28.578090 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.577744 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 28 12:28:28.578090 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.577759 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 28 12:28:28.578305 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.578288 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xxv29\"" Jul 28 12:28:28.578381 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.578324 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 12:28:28.584568 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.584546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.584677 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.584585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.584729 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.584683 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.584781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.584735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.584781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.584765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.584851 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.584802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jnl2\" (UniqueName: \"kubernetes.io/projected/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-kube-api-access-4jnl2\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.615384 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.615343 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l"] Jul 28 12:28:28.685819 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.685782 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686009 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.685827 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686009 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.685879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jnl2\" (UniqueName: \"kubernetes.io/projected/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-kube-api-access-4jnl2\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686009 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.685906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686009 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.685934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686009 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.685992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686324 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:28:28.686025 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 28 12:28:28.686324 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:28:28.686110 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls podName:bf39e08c-b0de-4109-ac52-c433eb5ce2d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:28:29.186086086 +0000 UTC m=+1332.401799625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls") pod "feast-simple-feast-setup-777d6cc998-8gr4l" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5") : secret "feast-simple-feast-setup-ui-tls" not found Jul 28 12:28:28.686324 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:28:28.686306 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 28 12:28:28.686492 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.686386 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.686492 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:28:28.686396 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls podName:bf39e08c-b0de-4109-ac52-c433eb5ce2d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:28:29.186378089 +0000 UTC m=+1332.402091611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls") pod "feast-simple-feast-setup-777d6cc998-8gr4l" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5") : secret "feast-simple-feast-setup-offline-tls" not found Jul 28 12:28:28.688720 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.688698 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.688862 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.688643 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:28.712535 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:28.712504 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jnl2\" (UniqueName: \"kubernetes.io/projected/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-kube-api-access-4jnl2\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:29.188809 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:29.188762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:29.188809 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:29.188816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:29.191426 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:29.191396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:29.191536 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:29.191401 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8gr4l\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:29.483074 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:29.483035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:29.620990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:29.620956 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l"] Jul 28 12:28:29.623853 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:28:29.623825 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf39e08c_b0de_4109_ac52_c433eb5ce2d5.slice/crio-58501035a7c76a7f79cf4f366e73252194720e998a6a016f66d823e7fbd3c448 WatchSource:0}: Error finding container 58501035a7c76a7f79cf4f366e73252194720e998a6a016f66d823e7fbd3c448: Status 404 returned error can't find the container with id 58501035a7c76a7f79cf4f366e73252194720e998a6a016f66d823e7fbd3c448 Jul 28 12:28:30.006118 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:30.006077 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"58501035a7c76a7f79cf4f366e73252194720e998a6a016f66d823e7fbd3c448"} Jul 28 12:28:44.060944 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:44.060907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"79fed46b43b635845ef0f9b76765fc253268dd1a4343758f4d9c8d7666cc21a7"} Jul 28 12:28:49.079920 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:49.079886 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerID="79fed46b43b635845ef0f9b76765fc253268dd1a4343758f4d9c8d7666cc21a7" exitCode=0 Jul 28 12:28:49.080333 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:49.079944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"79fed46b43b635845ef0f9b76765fc253268dd1a4343758f4d9c8d7666cc21a7"} Jul 28 12:28:50.085705 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:50.085668 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"d0bb278e9660837352951ff37f5a9c9efd7d982e13356126ecbd95c4eb62dad9"} Jul 28 12:28:55.104871 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:55.104839 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerID="d0bb278e9660837352951ff37f5a9c9efd7d982e13356126ecbd95c4eb62dad9" exitCode=0 Jul 28 12:28:55.105339 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:55.104879 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"d0bb278e9660837352951ff37f5a9c9efd7d982e13356126ecbd95c4eb62dad9"} Jul 28 12:28:56.115357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.115314 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"67769ac51f002364f49cee82ac9a006fe78d1cc174c4feb19d3be333b3a431ac"} Jul 28 12:28:56.115887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.115377 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"59862775ade2a22aca8589c2976919e042649defe911be6868ace77886539d6a"} Jul 28 12:28:56.115887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.115397 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"f95a77db7e2e504933f0e23cd854ee3bf02e604a59456bca3646df22bfddcafa"} Jul 28 12:28:56.115887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.115414 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerStarted","Data":"e9022d108e2f8e7a86cafab474b0870ea62268242df62a99e98a39c56aa05c3b"} Jul 28 12:28:56.144395 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.144336 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podStartSLOduration=14.303252766 podStartE2EDuration="28.144315183s" totalImagesPullingTime="13.841062417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:28:56.142316377 +0000 UTC m=+1359.358029917" watchObservedRunningTime="2026-07-28 12:28:56.144315183 +0000 UTC m=+1359.360028722" Jul 28 12:28:56.484201 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.484165 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:56.484490 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.484467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:56.484616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.484499 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:56.484616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.484517 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:56.486454 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.486410 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 28 12:28:56.486645 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.486431 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Jul 28 12:28:56.486645 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.486453 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Jul 28 12:28:56.486863 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:56.486486 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 28 12:28:59.483673 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.483625 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:59.484296 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.483701 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:59.484296 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.483721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:59.484296 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.483865 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 28 12:28:59.484296 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.484048 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Jul 28 12:28:59.484296 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.484115 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Jul 28 12:28:59.484616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.484333 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:28:59.484616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:28:59.484356 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 28 12:29:02.484943 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.484910 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:02.485397 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.485099 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:02.485397 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.485338 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:02.485812 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.485789 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:02.485935 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.485863 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:02.485935 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.485913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:02.490015 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:02.489994 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:29:03.150607 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:29:03.150579 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:30:05.956185 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:05.956152 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l"] Jul 28 12:30:05.956747 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:05.956388 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="registry" containerID="cri-o://e9022d108e2f8e7a86cafab474b0870ea62268242df62a99e98a39c56aa05c3b" gracePeriod=30 Jul 28 12:30:05.956747 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:05.956423 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" containerID="cri-o://67769ac51f002364f49cee82ac9a006fe78d1cc174c4feb19d3be333b3a431ac" gracePeriod=30 Jul 28 12:30:05.956747 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:05.956472 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="offline" containerID="cri-o://59862775ade2a22aca8589c2976919e042649defe911be6868ace77886539d6a" gracePeriod=30 Jul 28 12:30:05.956747 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:05.956535 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" containerID="cri-o://f95a77db7e2e504933f0e23cd854ee3bf02e604a59456bca3646df22bfddcafa" gracePeriod=30 Jul 28 12:30:06.286792 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.286703 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg"] Jul 28 12:30:06.290489 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.290465 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.292971 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.292949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ff4z8\"" Jul 28 12:30:06.304215 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.304186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg"] Jul 28 12:30:06.350943 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.350899 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34d15cdf-9927-4da5-af4b-0637de48b831-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.351156 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.351002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.351156 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.351036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.351156 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.351108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.351156 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.351134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgvx\" (UniqueName: \"kubernetes.io/projected/34d15cdf-9927-4da5-af4b-0637de48b831-kube-api-access-7jgvx\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.351354 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.351168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.452558 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.452482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.452558 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.452533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgvx\" (UniqueName: \"kubernetes.io/projected/34d15cdf-9927-4da5-af4b-0637de48b831-kube-api-access-7jgvx\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.452892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.452593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.452892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.452626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34d15cdf-9927-4da5-af4b-0637de48b831-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.452892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.452715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.452892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.452761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.453588 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:30:06.453228 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 28 12:30:06.453588 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:30:06.453300 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls podName:34d15cdf-9927-4da5-af4b-0637de48b831 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:06.953279688 +0000 UTC m=+1430.168993225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls") pod "feast-simple-feast-setup-777d6cc998-g5sdg" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831") : secret "feast-simple-feast-setup-registry-tls" not found Jul 28 12:30:06.453588 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.453490 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34d15cdf-9927-4da5-af4b-0637de48b831-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.453588 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:30:06.453523 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 28 12:30:06.453588 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:30:06.453565 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls podName:34d15cdf-9927-4da5-af4b-0637de48b831 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:06.953551779 +0000 UTC m=+1430.169265303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls") pod "feast-simple-feast-setup-777d6cc998-g5sdg" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831") : secret "feast-simple-feast-setup-offline-tls" not found Jul 28 12:30:06.455941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.455912 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.456051 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.455972 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.462177 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.462118 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgvx\" (UniqueName: \"kubernetes.io/projected/34d15cdf-9927-4da5-af4b-0637de48b831-kube-api-access-7jgvx\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.956703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.956677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.957068 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.956744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.959227 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.959201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:06.959358 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:06.959334 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-g5sdg\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:07.204122 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.204089 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:07.334572 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.334547 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg"] Jul 28 12:30:07.336485 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:30:07.336456 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34d15cdf_9927_4da5_af4b_0637de48b831.slice/crio-8cca6d8d627c6c328deab95fb664111cafa7ea13d4b8e19f3e5525aa076c25f1 WatchSource:0}: Error finding container 8cca6d8d627c6c328deab95fb664111cafa7ea13d4b8e19f3e5525aa076c25f1: Status 404 returned error can't find the container with id 8cca6d8d627c6c328deab95fb664111cafa7ea13d4b8e19f3e5525aa076c25f1 Jul 28 12:30:07.359906 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.359882 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerID="67769ac51f002364f49cee82ac9a006fe78d1cc174c4feb19d3be333b3a431ac" exitCode=0 Jul 28 12:30:07.359906 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.359903 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerID="f95a77db7e2e504933f0e23cd854ee3bf02e604a59456bca3646df22bfddcafa" exitCode=0 Jul 28 12:30:07.360052 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.359957 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"67769ac51f002364f49cee82ac9a006fe78d1cc174c4feb19d3be333b3a431ac"} Jul 28 12:30:07.360052 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.359999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"f95a77db7e2e504933f0e23cd854ee3bf02e604a59456bca3646df22bfddcafa"} Jul 28 12:30:07.360944 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:07.360926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"8cca6d8d627c6c328deab95fb664111cafa7ea13d4b8e19f3e5525aa076c25f1"} Jul 28 12:30:08.365901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:08.365826 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"71cde1223a73fca8c151de3330acc94903020694a26af23cbdc66e7878961252"} Jul 28 12:30:12.379839 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:12.379801 2565 generic.go:356] "Generic (PLEG): container finished" podID="34d15cdf-9927-4da5-af4b-0637de48b831" containerID="71cde1223a73fca8c151de3330acc94903020694a26af23cbdc66e7878961252" exitCode=0 Jul 28 12:30:12.380283 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:12.379880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"71cde1223a73fca8c151de3330acc94903020694a26af23cbdc66e7878961252"} Jul 28 12:30:12.486591 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:12.486540 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 28 12:30:13.147451 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:13.147404 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 28 12:30:13.385705 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:13.385670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"d752cf3c5d63af769a1be6d30924c1f54facf1c4d27532e4331a616ec6066b9d"} Jul 28 12:30:18.405531 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:18.405497 2565 generic.go:356] "Generic (PLEG): container finished" podID="34d15cdf-9927-4da5-af4b-0637de48b831" containerID="d752cf3c5d63af769a1be6d30924c1f54facf1c4d27532e4331a616ec6066b9d" exitCode=0 Jul 28 12:30:18.405917 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:18.405538 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"d752cf3c5d63af769a1be6d30924c1f54facf1c4d27532e4331a616ec6066b9d"} Jul 28 12:30:19.414778 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:19.414733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"cfca8461b8318901966d457530b0430aca07c2a6fb29c9298d61445c4e7eec13"} Jul 28 12:30:19.415252 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:19.414794 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"dde7f85e1eff5f2b6787488d0a414821e5df3a69f833fdda470a614d411bd4fb"} Jul 28 12:30:19.415252 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:19.414816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"994ebbf698042544b4a803ac2cb35ba62b7e0515fa94ab023c4f960ba3c9900a"} Jul 28 12:30:19.415252 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:19.414833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerStarted","Data":"3f2894e9554a907553c739d5ada27095156c0434ed2abf11410efbfd951269aa"} Jul 28 12:30:19.440830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:19.440766 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podStartSLOduration=13.440743689 podStartE2EDuration="13.440743689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:19.438528809 +0000 UTC m=+1442.654242377" watchObservedRunningTime="2026-07-28 12:30:19.440743689 +0000 UTC m=+1442.656457229" Jul 28 12:30:22.204915 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.204877 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:22.205483 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.205466 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:22.205580 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.205570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:22.205988 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.205960 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:22.206668 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.206613 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Jul 28 12:30:22.206668 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.206634 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused" Jul 28 12:30:22.206839 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.206696 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Jul 28 12:30:22.206839 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.206792 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused" Jul 28 12:30:22.485961 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:22.485845 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 28 12:30:23.148534 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:23.148489 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 28 12:30:25.205739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.205704 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206222 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.205883 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206222 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206057 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206480 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206457 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206480 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206485 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206690 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206497 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206877 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.206993 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.206976 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.210720 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.210699 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.440919 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.440883 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:25.444139 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:25.444120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:30:32.486604 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:32.486552 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Jul 28 12:30:32.489130 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:32.486740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:30:33.148462 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:33.148420 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Jul 28 12:30:33.148674 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:33.148529 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:30:36.481688 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.481629 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerID="59862775ade2a22aca8589c2976919e042649defe911be6868ace77886539d6a" exitCode=137 Jul 28 12:30:36.481688 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.481685 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerID="e9022d108e2f8e7a86cafab474b0870ea62268242df62a99e98a39c56aa05c3b" exitCode=137 Jul 28 12:30:36.482019 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.481686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"59862775ade2a22aca8589c2976919e042649defe911be6868ace77886539d6a"} Jul 28 12:30:36.482019 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.481727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"e9022d108e2f8e7a86cafab474b0870ea62268242df62a99e98a39c56aa05c3b"} Jul 28 12:30:36.603689 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.603663 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:30:36.704878 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.704840 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls\") pod \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " Jul 28 12:30:36.704878 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.704877 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-online-tls\") pod \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " Jul 28 12:30:36.705094 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.704901 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls\") pod \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " Jul 28 12:30:36.705094 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.704918 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-registry-tls\") pod \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " Jul 28 12:30:36.705094 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.704941 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-feast-data\") pod \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " Jul 28 12:30:36.705094 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.704969 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jnl2\" (UniqueName: \"kubernetes.io/projected/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-kube-api-access-4jnl2\") pod \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\" (UID: \"bf39e08c-b0de-4109-ac52-c433eb5ce2d5\") " Jul 28 12:30:36.705794 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.705563 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-feast-data" (OuterVolumeSpecName: "feast-data") pod "bf39e08c-b0de-4109-ac52-c433eb5ce2d5" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:30:36.707353 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.707319 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bf39e08c-b0de-4109-ac52-c433eb5ce2d5" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:30:36.707464 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.707343 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bf39e08c-b0de-4109-ac52-c433eb5ce2d5" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:30:36.707464 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.707372 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-kube-api-access-4jnl2" (OuterVolumeSpecName: "kube-api-access-4jnl2") pod "bf39e08c-b0de-4109-ac52-c433eb5ce2d5" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5"). InnerVolumeSpecName "kube-api-access-4jnl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:30:36.707546 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.707533 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "bf39e08c-b0de-4109-ac52-c433eb5ce2d5" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:30:36.707579 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.707551 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-online-tls" (OuterVolumeSpecName: "online-tls") pod "bf39e08c-b0de-4109-ac52-c433eb5ce2d5" (UID: "bf39e08c-b0de-4109-ac52-c433eb5ce2d5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:30:36.806060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.805975 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-offline-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:30:36.806060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.806004 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-online-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:30:36.806060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.806013 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-ui-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:30:36.806060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.806021 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:30:36.806060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.806030 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-feast-data\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:30:36.806060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:36.806038 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jnl2\" (UniqueName: \"kubernetes.io/projected/bf39e08c-b0de-4109-ac52-c433eb5ce2d5-kube-api-access-4jnl2\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:30:37.488333 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.488301 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" event={"ID":"bf39e08c-b0de-4109-ac52-c433eb5ce2d5","Type":"ContainerDied","Data":"58501035a7c76a7f79cf4f366e73252194720e998a6a016f66d823e7fbd3c448"} Jul 28 12:30:37.488333 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.488324 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l" Jul 28 12:30:37.488867 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.488355 2565 scope.go:117] "RemoveContainer" containerID="67769ac51f002364f49cee82ac9a006fe78d1cc174c4feb19d3be333b3a431ac" Jul 28 12:30:37.496435 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.496417 2565 scope.go:117] "RemoveContainer" containerID="59862775ade2a22aca8589c2976919e042649defe911be6868ace77886539d6a" Jul 28 12:30:37.503648 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.503625 2565 scope.go:117] "RemoveContainer" containerID="f95a77db7e2e504933f0e23cd854ee3bf02e604a59456bca3646df22bfddcafa" Jul 28 12:30:37.507950 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.507929 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l"] Jul 28 12:30:37.510854 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.510831 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8gr4l"] Jul 28 12:30:37.512722 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.512697 2565 scope.go:117] "RemoveContainer" containerID="e9022d108e2f8e7a86cafab474b0870ea62268242df62a99e98a39c56aa05c3b" Jul 28 12:30:37.519991 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.519977 2565 scope.go:117] "RemoveContainer" containerID="d0bb278e9660837352951ff37f5a9c9efd7d982e13356126ecbd95c4eb62dad9" Jul 28 12:30:37.526774 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:37.526728 2565 scope.go:117] "RemoveContainer" containerID="79fed46b43b635845ef0f9b76765fc253268dd1a4343758f4d9c8d7666cc21a7" Jul 28 12:30:39.343904 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:30:39.343872 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" path="/var/lib/kubelet/pods/bf39e08c-b0de-4109-ac52-c433eb5ce2d5/volumes" Jul 28 12:31:28.145877 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.145839 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4"] Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146117 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="offline" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146129 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="offline" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146144 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="registry" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146150 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="registry" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146156 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="feast-apply" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146163 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="feast-apply" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146170 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="feast-init" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146176 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="feast-init" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146185 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146191 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146198 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146202 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146252 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="registry" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146261 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="online" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146267 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="offline" Jul 28 12:31:28.146309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.146273 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf39e08c-b0de-4109-ac52-c433eb5ce2d5" containerName="ui" Jul 28 12:31:28.150582 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.150558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.154575 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.154545 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 28 12:31:28.155331 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.155307 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 28 12:31:28.155331 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.155327 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 28 12:31:28.155646 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.155617 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 28 12:31:28.155830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.155625 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-4qzkz\"" Jul 28 12:31:28.156099 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.156070 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 28 12:31:28.156216 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.156079 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 28 12:31:28.165227 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.165199 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4"] Jul 28 12:31:28.288053 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.288007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82978afb-541d-45db-8692-afccdbec2624-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.288237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.288074 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.288237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.288125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8sqv\" (UniqueName: \"kubernetes.io/projected/82978afb-541d-45db-8692-afccdbec2624-kube-api-access-b8sqv\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.288237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.288156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/82978afb-541d-45db-8692-afccdbec2624-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.288237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.288192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.288237 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.288222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389074 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8sqv\" (UniqueName: \"kubernetes.io/projected/82978afb-541d-45db-8692-afccdbec2624-kube-api-access-b8sqv\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389074 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/82978afb-541d-45db-8692-afccdbec2624-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389334 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389334 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389334 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82978afb-541d-45db-8692-afccdbec2624-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389334 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.389625 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82978afb-541d-45db-8692-afccdbec2624-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.390089 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.389997 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/82978afb-541d-45db-8692-afccdbec2624-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.391739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.391720 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.391829 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.391767 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.391829 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.391803 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.398766 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.398702 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8sqv\" (UniqueName: \"kubernetes.io/projected/82978afb-541d-45db-8692-afccdbec2624-kube-api-access-b8sqv\") pod \"feast-simple-feast-remote-setup-db6955c6c-nqsz4\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.460557 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.460518 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:28.608356 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.608318 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4"] Jul 28 12:31:28.613238 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:31:28.613211 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82978afb_541d_45db_8692_afccdbec2624.slice/crio-6635b518e3632a3d889ec3d098bdf2dc52987b9b6a8839951a909e5f7913f1c5 WatchSource:0}: Error finding container 6635b518e3632a3d889ec3d098bdf2dc52987b9b6a8839951a909e5f7913f1c5: Status 404 returned error can't find the container with id 6635b518e3632a3d889ec3d098bdf2dc52987b9b6a8839951a909e5f7913f1c5 Jul 28 12:31:28.659842 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:28.659804 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerStarted","Data":"6635b518e3632a3d889ec3d098bdf2dc52987b9b6a8839951a909e5f7913f1c5"} Jul 28 12:31:29.664696 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:29.664638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerStarted","Data":"5da12118f049a227b0fafa5b381a8906fce6fc99e1d0fa41de673e22e1f0939a"} Jul 28 12:31:34.686075 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:34.686038 2565 generic.go:356] "Generic (PLEG): container finished" podID="82978afb-541d-45db-8692-afccdbec2624" containerID="5da12118f049a227b0fafa5b381a8906fce6fc99e1d0fa41de673e22e1f0939a" exitCode=0 Jul 28 12:31:34.686499 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:34.686113 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerDied","Data":"5da12118f049a227b0fafa5b381a8906fce6fc99e1d0fa41de673e22e1f0939a"} Jul 28 12:31:35.692797 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:35.692757 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerStarted","Data":"f8a906f933286101c43340465180216a9e5db6c965380b227b57aea206ddaafd"} Jul 28 12:31:41.716086 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:41.716053 2565 generic.go:356] "Generic (PLEG): container finished" podID="82978afb-541d-45db-8692-afccdbec2624" containerID="f8a906f933286101c43340465180216a9e5db6c965380b227b57aea206ddaafd" exitCode=0 Jul 28 12:31:41.716593 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:41.716125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerDied","Data":"f8a906f933286101c43340465180216a9e5db6c965380b227b57aea206ddaafd"} Jul 28 12:31:42.723595 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:42.723552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerStarted","Data":"d595f523e7b12f5b5447303f518cf0b337785467f1212695e0054b06c1675e2f"} Jul 28 12:31:42.724031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:42.723619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerStarted","Data":"5f7e03022b448520f386ec9d4665e761a03dcdad630647192fb1005cf2a16299"} Jul 28 12:31:42.724031 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:42.723641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerStarted","Data":"3f643a523d979964c09c7af8b99f380eed972173bff24b86b1b534e1ff5791e2"} Jul 28 12:31:42.748646 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:42.748572 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podStartSLOduration=14.74855154 podStartE2EDuration="14.74855154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:31:42.747557933 +0000 UTC m=+1525.963271497" watchObservedRunningTime="2026-07-28 12:31:42.74855154 +0000 UTC m=+1525.964265082" Jul 28 12:31:43.461335 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:43.461286 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:43.461555 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:43.461530 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:43.461670 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:43.461572 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:43.463042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:43.463004 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused" Jul 28 12:31:43.463164 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:43.463052 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Jul 28 12:31:43.463164 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:43.463107 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Jul 28 12:31:46.461347 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:46.461300 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused" Jul 28 12:31:46.461818 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:46.461377 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Jul 28 12:31:46.461818 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:46.461299 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Jul 28 12:31:48.461390 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:48.461325 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:48.462042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:48.461412 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:48.462042 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:48.461429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:49.462465 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:49.462432 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:49.462973 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:49.462590 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:49.463262 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:49.463245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:49.463393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:49.463380 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:49.469343 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:49.469305 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:31:49.761810 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:31:49.761714 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:32:51.565919 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.565886 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4"] Jul 28 12:32:51.566550 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.566119 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" containerID="cri-o://3f643a523d979964c09c7af8b99f380eed972173bff24b86b1b534e1ff5791e2" gracePeriod=30 Jul 28 12:32:51.566550 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.566255 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="offline" containerID="cri-o://5f7e03022b448520f386ec9d4665e761a03dcdad630647192fb1005cf2a16299" gracePeriod=30 Jul 28 12:32:51.566550 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.566501 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" containerID="cri-o://d595f523e7b12f5b5447303f518cf0b337785467f1212695e0054b06c1675e2f" gracePeriod=30 Jul 28 12:32:51.789575 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.789542 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg"] Jul 28 12:32:51.789825 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.789795 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="registry" containerID="cri-o://3f2894e9554a907553c739d5ada27095156c0434ed2abf11410efbfd951269aa" gracePeriod=30 Jul 28 12:32:51.789908 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.789865 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" containerID="cri-o://994ebbf698042544b4a803ac2cb35ba62b7e0515fa94ab023c4f960ba3c9900a" gracePeriod=30 Jul 28 12:32:51.789908 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.789845 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" containerID="cri-o://cfca8461b8318901966d457530b0430aca07c2a6fb29c9298d61445c4e7eec13" gracePeriod=30 Jul 28 12:32:51.790011 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:51.789889 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="offline" containerID="cri-o://dde7f85e1eff5f2b6787488d0a414821e5df3a69f833fdda470a614d411bd4fb" gracePeriod=30 Jul 28 12:32:52.981775 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.981740 2565 generic.go:356] "Generic (PLEG): container finished" podID="82978afb-541d-45db-8692-afccdbec2624" containerID="d595f523e7b12f5b5447303f518cf0b337785467f1212695e0054b06c1675e2f" exitCode=0 Jul 28 12:32:52.981775 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.981766 2565 generic.go:356] "Generic (PLEG): container finished" podID="82978afb-541d-45db-8692-afccdbec2624" containerID="3f643a523d979964c09c7af8b99f380eed972173bff24b86b1b534e1ff5791e2" exitCode=0 Jul 28 12:32:52.982228 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.981812 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerDied","Data":"d595f523e7b12f5b5447303f518cf0b337785467f1212695e0054b06c1675e2f"} Jul 28 12:32:52.982228 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.981852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerDied","Data":"3f643a523d979964c09c7af8b99f380eed972173bff24b86b1b534e1ff5791e2"} Jul 28 12:32:52.984356 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.984333 2565 generic.go:356] "Generic (PLEG): container finished" podID="34d15cdf-9927-4da5-af4b-0637de48b831" containerID="cfca8461b8318901966d457530b0430aca07c2a6fb29c9298d61445c4e7eec13" exitCode=0 Jul 28 12:32:52.984356 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.984352 2565 generic.go:356] "Generic (PLEG): container finished" podID="34d15cdf-9927-4da5-af4b-0637de48b831" containerID="994ebbf698042544b4a803ac2cb35ba62b7e0515fa94ab023c4f960ba3c9900a" exitCode=0 Jul 28 12:32:52.984495 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.984389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"cfca8461b8318901966d457530b0430aca07c2a6fb29c9298d61445c4e7eec13"} Jul 28 12:32:52.984495 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:52.984416 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"994ebbf698042544b4a803ac2cb35ba62b7e0515fa94ab023c4f960ba3c9900a"} Jul 28 12:32:55.207026 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:55.206975 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Jul 28 12:32:55.442075 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:55.442026 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Jul 28 12:32:59.463481 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:59.463430 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Jul 28 12:32:59.753716 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:32:59.753607 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Jul 28 12:33:05.206780 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:05.206736 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Jul 28 12:33:05.441887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:05.441848 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Jul 28 12:33:09.463497 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:09.463390 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Jul 28 12:33:09.753621 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:09.753522 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Jul 28 12:33:15.206741 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:15.206693 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Jul 28 12:33:15.207186 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:15.206847 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:33:15.441778 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:15.441733 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Jul 28 12:33:15.441950 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:15.441868 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:33:19.463128 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:19.463076 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Jul 28 12:33:19.463586 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:19.463200 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:33:19.753806 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:19.753707 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Jul 28 12:33:19.753956 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:19.753837 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:33:22.092172 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.092142 2565 generic.go:356] "Generic (PLEG): container finished" podID="34d15cdf-9927-4da5-af4b-0637de48b831" containerID="dde7f85e1eff5f2b6787488d0a414821e5df3a69f833fdda470a614d411bd4fb" exitCode=137 Jul 28 12:33:22.092172 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.092166 2565 generic.go:356] "Generic (PLEG): container finished" podID="34d15cdf-9927-4da5-af4b-0637de48b831" containerID="3f2894e9554a907553c739d5ada27095156c0434ed2abf11410efbfd951269aa" exitCode=137 Jul 28 12:33:22.092616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.092209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"dde7f85e1eff5f2b6787488d0a414821e5df3a69f833fdda470a614d411bd4fb"} Jul 28 12:33:22.092616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.092253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"3f2894e9554a907553c739d5ada27095156c0434ed2abf11410efbfd951269aa"} Jul 28 12:33:22.094965 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.094940 2565 generic.go:356] "Generic (PLEG): container finished" podID="82978afb-541d-45db-8692-afccdbec2624" containerID="5f7e03022b448520f386ec9d4665e761a03dcdad630647192fb1005cf2a16299" exitCode=137 Jul 28 12:33:22.095077 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.094978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerDied","Data":"5f7e03022b448520f386ec9d4665e761a03dcdad630647192fb1005cf2a16299"} Jul 28 12:33:22.219990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.219959 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:33:22.262990 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.262961 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8sqv\" (UniqueName: \"kubernetes.io/projected/82978afb-541d-45db-8692-afccdbec2624-kube-api-access-b8sqv\") pod \"82978afb-541d-45db-8692-afccdbec2624\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " Jul 28 12:33:22.263236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263009 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-ui-tls\") pod \"82978afb-541d-45db-8692-afccdbec2624\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " Jul 28 12:33:22.263236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263030 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82978afb-541d-45db-8692-afccdbec2624-feast-data\") pod \"82978afb-541d-45db-8692-afccdbec2624\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " Jul 28 12:33:22.263236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263060 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/82978afb-541d-45db-8692-afccdbec2624-registry-tls\") pod \"82978afb-541d-45db-8692-afccdbec2624\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " Jul 28 12:33:22.263236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263096 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-offline-tls\") pod \"82978afb-541d-45db-8692-afccdbec2624\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " Jul 28 12:33:22.263236 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263172 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-online-tls\") pod \"82978afb-541d-45db-8692-afccdbec2624\" (UID: \"82978afb-541d-45db-8692-afccdbec2624\") " Jul 28 12:33:22.263504 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263480 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82978afb-541d-45db-8692-afccdbec2624-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "82978afb-541d-45db-8692-afccdbec2624" (UID: "82978afb-541d-45db-8692-afccdbec2624"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:33:22.263604 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.263580 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82978afb-541d-45db-8692-afccdbec2624-feast-data" (OuterVolumeSpecName: "feast-data") pod "82978afb-541d-45db-8692-afccdbec2624" (UID: "82978afb-541d-45db-8692-afccdbec2624"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:33:22.265456 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.265414 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "82978afb-541d-45db-8692-afccdbec2624" (UID: "82978afb-541d-45db-8692-afccdbec2624"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.265556 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.265480 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "82978afb-541d-45db-8692-afccdbec2624" (UID: "82978afb-541d-45db-8692-afccdbec2624"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.265556 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.265494 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82978afb-541d-45db-8692-afccdbec2624-kube-api-access-b8sqv" (OuterVolumeSpecName: "kube-api-access-b8sqv") pod "82978afb-541d-45db-8692-afccdbec2624" (UID: "82978afb-541d-45db-8692-afccdbec2624"). InnerVolumeSpecName "kube-api-access-b8sqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:33:22.265556 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.265516 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-online-tls" (OuterVolumeSpecName: "online-tls") pod "82978afb-541d-45db-8692-afccdbec2624" (UID: "82978afb-541d-45db-8692-afccdbec2624"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.364194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.364163 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8sqv\" (UniqueName: \"kubernetes.io/projected/82978afb-541d-45db-8692-afccdbec2624-kube-api-access-b8sqv\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.364194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.364189 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-ui-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.364194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.364199 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/82978afb-541d-45db-8692-afccdbec2624-feast-data\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.364543 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.364208 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/82978afb-541d-45db-8692-afccdbec2624-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.364543 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.364215 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-offline-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.364543 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.364222 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/82978afb-541d-45db-8692-afccdbec2624-online-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.440100 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.440069 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:33:22.465357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.465324 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls\") pod \"34d15cdf-9927-4da5-af4b-0637de48b831\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " Jul 28 12:33:22.465501 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.465371 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-ui-tls\") pod \"34d15cdf-9927-4da5-af4b-0637de48b831\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " Jul 28 12:33:22.465501 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.465387 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls\") pod \"34d15cdf-9927-4da5-af4b-0637de48b831\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " Jul 28 12:33:22.465501 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.465414 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34d15cdf-9927-4da5-af4b-0637de48b831-feast-data\") pod \"34d15cdf-9927-4da5-af4b-0637de48b831\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " Jul 28 12:33:22.465501 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.465463 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-online-tls\") pod \"34d15cdf-9927-4da5-af4b-0637de48b831\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " Jul 28 12:33:22.465501 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.465494 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jgvx\" (UniqueName: \"kubernetes.io/projected/34d15cdf-9927-4da5-af4b-0637de48b831-kube-api-access-7jgvx\") pod \"34d15cdf-9927-4da5-af4b-0637de48b831\" (UID: \"34d15cdf-9927-4da5-af4b-0637de48b831\") " Jul 28 12:33:22.466094 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.466037 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34d15cdf-9927-4da5-af4b-0637de48b831-feast-data" (OuterVolumeSpecName: "feast-data") pod "34d15cdf-9927-4da5-af4b-0637de48b831" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:33:22.468093 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.468062 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "34d15cdf-9927-4da5-af4b-0637de48b831" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.468451 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.468420 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "34d15cdf-9927-4da5-af4b-0637de48b831" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.468558 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.468486 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-online-tls" (OuterVolumeSpecName: "online-tls") pod "34d15cdf-9927-4da5-af4b-0637de48b831" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.468558 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.468475 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "34d15cdf-9927-4da5-af4b-0637de48b831" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:33:22.468697 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.468555 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34d15cdf-9927-4da5-af4b-0637de48b831-kube-api-access-7jgvx" (OuterVolumeSpecName: "kube-api-access-7jgvx") pod "34d15cdf-9927-4da5-af4b-0637de48b831" (UID: "34d15cdf-9927-4da5-af4b-0637de48b831"). InnerVolumeSpecName "kube-api-access-7jgvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:33:22.566701 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.566644 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-ui-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.566701 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.566696 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-offline-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.566701 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.566706 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34d15cdf-9927-4da5-af4b-0637de48b831-feast-data\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.566941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.566713 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-online-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.566941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.566721 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jgvx\" (UniqueName: \"kubernetes.io/projected/34d15cdf-9927-4da5-af4b-0637de48b831-kube-api-access-7jgvx\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:22.566941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:22.566729 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34d15cdf-9927-4da5-af4b-0637de48b831-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:23.101228 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.101197 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" Jul 28 12:33:23.101228 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.101216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4" event={"ID":"82978afb-541d-45db-8692-afccdbec2624","Type":"ContainerDied","Data":"6635b518e3632a3d889ec3d098bdf2dc52987b9b6a8839951a909e5f7913f1c5"} Jul 28 12:33:23.101809 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.101270 2565 scope.go:117] "RemoveContainer" containerID="d595f523e7b12f5b5447303f518cf0b337785467f1212695e0054b06c1675e2f" Jul 28 12:33:23.104415 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.104390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" event={"ID":"34d15cdf-9927-4da5-af4b-0637de48b831","Type":"ContainerDied","Data":"8cca6d8d627c6c328deab95fb664111cafa7ea13d4b8e19f3e5525aa076c25f1"} Jul 28 12:33:23.104521 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.104433 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg" Jul 28 12:33:23.111311 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.111297 2565 scope.go:117] "RemoveContainer" containerID="5f7e03022b448520f386ec9d4665e761a03dcdad630647192fb1005cf2a16299" Jul 28 12:33:23.118830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.118813 2565 scope.go:117] "RemoveContainer" containerID="3f643a523d979964c09c7af8b99f380eed972173bff24b86b1b534e1ff5791e2" Jul 28 12:33:23.124984 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.124931 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4"] Jul 28 12:33:23.126043 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.126027 2565 scope.go:117] "RemoveContainer" containerID="f8a906f933286101c43340465180216a9e5db6c965380b227b57aea206ddaafd" Jul 28 12:33:23.128873 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.128846 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-nqsz4"] Jul 28 12:33:23.133231 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.133211 2565 scope.go:117] "RemoveContainer" containerID="5da12118f049a227b0fafa5b381a8906fce6fc99e1d0fa41de673e22e1f0939a" Jul 28 12:33:23.140302 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.140286 2565 scope.go:117] "RemoveContainer" containerID="cfca8461b8318901966d457530b0430aca07c2a6fb29c9298d61445c4e7eec13" Jul 28 12:33:23.147188 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.147172 2565 scope.go:117] "RemoveContainer" containerID="dde7f85e1eff5f2b6787488d0a414821e5df3a69f833fdda470a614d411bd4fb" Jul 28 12:33:23.149868 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.149846 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg"] Jul 28 12:33:23.154736 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.154645 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-g5sdg"] Jul 28 12:33:23.155005 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.154990 2565 scope.go:117] "RemoveContainer" containerID="994ebbf698042544b4a803ac2cb35ba62b7e0515fa94ab023c4f960ba3c9900a" Jul 28 12:33:23.163603 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.163576 2565 scope.go:117] "RemoveContainer" containerID="3f2894e9554a907553c739d5ada27095156c0434ed2abf11410efbfd951269aa" Jul 28 12:33:23.170783 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.170762 2565 scope.go:117] "RemoveContainer" containerID="d752cf3c5d63af769a1be6d30924c1f54facf1c4d27532e4331a616ec6066b9d" Jul 28 12:33:23.177455 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.177429 2565 scope.go:117] "RemoveContainer" containerID="71cde1223a73fca8c151de3330acc94903020694a26af23cbdc66e7878961252" Jul 28 12:33:23.342976 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.342948 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" path="/var/lib/kubelet/pods/34d15cdf-9927-4da5-af4b-0637de48b831/volumes" Jul 28 12:33:23.343507 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:23.343495 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82978afb-541d-45db-8692-afccdbec2624" path="/var/lib/kubelet/pods/82978afb-541d-45db-8692-afccdbec2624/volumes" Jul 28 12:33:41.145181 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:41.145141 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b"] Jul 28 12:33:41.145714 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:41.145365 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" podUID="2db41d38-4c13-47d5-a235-6d5766e7efbc" containerName="manager" containerID="cri-o://7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5" gracePeriod=10 Jul 28 12:33:41.383712 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:41.383688 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:33:41.506598 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:41.506567 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5tvg\" (UniqueName: \"kubernetes.io/projected/2db41d38-4c13-47d5-a235-6d5766e7efbc-kube-api-access-j5tvg\") pod \"2db41d38-4c13-47d5-a235-6d5766e7efbc\" (UID: \"2db41d38-4c13-47d5-a235-6d5766e7efbc\") " Jul 28 12:33:41.508863 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:41.508829 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db41d38-4c13-47d5-a235-6d5766e7efbc-kube-api-access-j5tvg" (OuterVolumeSpecName: "kube-api-access-j5tvg") pod "2db41d38-4c13-47d5-a235-6d5766e7efbc" (UID: "2db41d38-4c13-47d5-a235-6d5766e7efbc"). InnerVolumeSpecName "kube-api-access-j5tvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:33:41.608023 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:41.607981 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5tvg\" (UniqueName: \"kubernetes.io/projected/2db41d38-4c13-47d5-a235-6d5766e7efbc-kube-api-access-j5tvg\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:33:42.168864 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.168828 2565 generic.go:356] "Generic (PLEG): container finished" podID="2db41d38-4c13-47d5-a235-6d5766e7efbc" containerID="7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5" exitCode=0 Jul 28 12:33:42.169351 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.168899 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" Jul 28 12:33:42.169351 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.168902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" event={"ID":"2db41d38-4c13-47d5-a235-6d5766e7efbc","Type":"ContainerDied","Data":"7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5"} Jul 28 12:33:42.169351 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.169044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b" event={"ID":"2db41d38-4c13-47d5-a235-6d5766e7efbc","Type":"ContainerDied","Data":"197519c9090e2facd6ce1a3541d63fe47b0b7194349dffe2604ab11b615bde71"} Jul 28 12:33:42.169351 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.169067 2565 scope.go:117] "RemoveContainer" containerID="7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5" Jul 28 12:33:42.177716 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.177692 2565 scope.go:117] "RemoveContainer" containerID="7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5" Jul 28 12:33:42.178018 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:33:42.177999 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5\": container with ID starting with 7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5 not found: ID does not exist" containerID="7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5" Jul 28 12:33:42.178078 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.178027 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5"} err="failed to get container status \"7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5\": rpc error: code = NotFound desc = could not find container \"7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5\": container with ID starting with 7911b4d6327f6b9e2b8784d8a10c9d42434a99ab4a824f020802a4a8701b6cb5 not found: ID does not exist" Jul 28 12:33:42.201767 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.201728 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b"] Jul 28 12:33:42.209112 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:42.209085 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-mng5b"] Jul 28 12:33:43.343250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:43.343212 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2db41d38-4c13-47d5-a235-6d5766e7efbc" path="/var/lib/kubelet/pods/2db41d38-4c13-47d5-a235-6d5766e7efbc/volumes" Jul 28 12:33:46.061339 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061307 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-hm976"] Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061533 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db41d38-4c13-47d5-a235-6d5766e7efbc" containerName="manager" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061543 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db41d38-4c13-47d5-a235-6d5766e7efbc" containerName="manager" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061551 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061557 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061565 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="offline" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061571 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="offline" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061581 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="feast-apply" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061585 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="feast-apply" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061594 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061599 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061605 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="feast-init" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061610 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="feast-init" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061615 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="offline" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061620 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="offline" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061627 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="feast-init" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061631 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="feast-init" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061636 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061641 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061646 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="feast-apply" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061669 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="feast-apply" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061680 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061687 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061695 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="registry" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061701 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="registry" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061738 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2db41d38-4c13-47d5-a235-6d5766e7efbc" containerName="manager" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061745 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="ui" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061751 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="registry" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061756 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="ui" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061761 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="online" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061767 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="online" Jul 28 12:33:46.061757 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061772 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="34d15cdf-9927-4da5-af4b-0637de48b831" containerName="offline" Jul 28 12:33:46.062669 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.061777 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="82978afb-541d-45db-8692-afccdbec2624" containerName="offline" Jul 28 12:33:46.066053 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.066035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:33:46.070436 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.070417 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 28 12:33:46.071285 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.071263 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-qq258\"" Jul 28 12:33:46.071285 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.071271 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 28 12:33:46.081928 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.081896 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-hm976"] Jul 28 12:33:46.143370 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.143325 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqvjm\" (UniqueName: \"kubernetes.io/projected/97594995-6e1f-425c-932d-6bfb3e14e756-kube-api-access-qqvjm\") pod \"feast-operator-controller-manager-7495bcd-hm976\" (UID: \"97594995-6e1f-425c-932d-6bfb3e14e756\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:33:46.243838 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.243796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqvjm\" (UniqueName: \"kubernetes.io/projected/97594995-6e1f-425c-932d-6bfb3e14e756-kube-api-access-qqvjm\") pod \"feast-operator-controller-manager-7495bcd-hm976\" (UID: \"97594995-6e1f-425c-932d-6bfb3e14e756\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:33:46.260619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.260586 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqvjm\" (UniqueName: \"kubernetes.io/projected/97594995-6e1f-425c-932d-6bfb3e14e756-kube-api-access-qqvjm\") pod \"feast-operator-controller-manager-7495bcd-hm976\" (UID: \"97594995-6e1f-425c-932d-6bfb3e14e756\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:33:46.375922 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.375822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:33:46.508894 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:46.508824 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-hm976"] Jul 28 12:33:46.511397 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:33:46.511366 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97594995_6e1f_425c_932d_6bfb3e14e756.slice/crio-3a6afbd535159e9aa44b1c3452d1b3f97b557065261b47de11502bb77a7d254e WatchSource:0}: Error finding container 3a6afbd535159e9aa44b1c3452d1b3f97b557065261b47de11502bb77a7d254e: Status 404 returned error can't find the container with id 3a6afbd535159e9aa44b1c3452d1b3f97b557065261b47de11502bb77a7d254e Jul 28 12:33:47.190937 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:47.190901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" event={"ID":"97594995-6e1f-425c-932d-6bfb3e14e756","Type":"ContainerStarted","Data":"419cf5dcb603ae7f7fe7d5b6f0154560fd90bf5db71a0faff87194aa4555ef17"} Jul 28 12:33:47.191330 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:47.190953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" event={"ID":"97594995-6e1f-425c-932d-6bfb3e14e756","Type":"ContainerStarted","Data":"3a6afbd535159e9aa44b1c3452d1b3f97b557065261b47de11502bb77a7d254e"} Jul 28 12:33:47.191330 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:47.191016 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:33:47.261181 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:47.261128 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" podStartSLOduration=1.261111165 podStartE2EDuration="1.261111165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:33:47.252548631 +0000 UTC m=+1650.468262173" watchObservedRunningTime="2026-07-28 12:33:47.261111165 +0000 UTC m=+1650.476824705" Jul 28 12:33:58.196815 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:33:58.196783 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-hm976" Jul 28 12:34:03.943088 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.943051 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh"] Jul 28 12:34:03.947514 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.947481 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:03.950197 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.950172 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 28 12:34:03.950389 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.950372 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 28 12:34:03.950525 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.950502 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 28 12:34:03.950609 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.950589 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 28 12:34:03.950703 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.950472 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-njng9\"" Jul 28 12:34:03.950816 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.950798 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 28 12:34:03.951172 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.951156 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 28 12:34:03.961309 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:03.961284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh"] Jul 28 12:34:04.080417 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.080378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsn6\" (UniqueName: \"kubernetes.io/projected/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-kube-api-access-2vsn6\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.080617 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.080420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.080617 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.080489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.080617 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.080520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.080617 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.080573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.080810 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.080674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181020 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.180978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181232 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.181036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsn6\" (UniqueName: \"kubernetes.io/projected/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-kube-api-access-2vsn6\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181232 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.181189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181359 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.181252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181359 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.181288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181359 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.181346 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.181515 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:34:04.181474 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 28 12:34:04.181562 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:34:04.181545 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls podName:981a26aa-d6bc-4fb2-89fc-bd2debd7b88a nodeName:}" failed. No retries permitted until 2026-07-28 12:34:04.681524206 +0000 UTC m=+1667.897237728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls") pod "feast-simple-feast-setup-777d6cc998-vgwzh" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a") : secret "feast-simple-feast-setup-offline-tls" not found Jul 28 12:34:04.181871 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.181825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.183732 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.183704 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.183862 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.183813 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.183938 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.183915 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.189890 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.189866 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsn6\" (UniqueName: \"kubernetes.io/projected/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-kube-api-access-2vsn6\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.686616 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.686580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.689099 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.689078 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vgwzh\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.859257 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.859214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:04.999382 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:04.999323 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh"] Jul 28 12:34:05.001514 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:34:05.001486 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod981a26aa_d6bc_4fb2_89fc_bd2debd7b88a.slice/crio-94affe5f2df24cd238ab740b6d912674212faa624a184c608739d24dc345e411 WatchSource:0}: Error finding container 94affe5f2df24cd238ab740b6d912674212faa624a184c608739d24dc345e411: Status 404 returned error can't find the container with id 94affe5f2df24cd238ab740b6d912674212faa624a184c608739d24dc345e411 Jul 28 12:34:05.255430 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:05.254691 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db"} Jul 28 12:34:05.255430 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:05.254747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"94affe5f2df24cd238ab740b6d912674212faa624a184c608739d24dc345e411"} Jul 28 12:34:10.272948 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:10.272908 2565 generic.go:356] "Generic (PLEG): container finished" podID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerID="682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db" exitCode=0 Jul 28 12:34:10.272948 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:10.272950 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db"} Jul 28 12:34:11.278673 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:11.278618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b"} Jul 28 12:34:16.298628 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:16.298595 2565 generic.go:356] "Generic (PLEG): container finished" podID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerID="cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b" exitCode=0 Jul 28 12:34:16.299016 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:16.298664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b"} Jul 28 12:34:17.308369 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:17.308328 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca"} Jul 28 12:34:17.308882 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:17.308393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261"} Jul 28 12:34:17.308882 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:17.308415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941"} Jul 28 12:34:17.308882 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:17.308433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerStarted","Data":"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da"} Jul 28 12:34:17.333582 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:17.333520 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podStartSLOduration=14.333499434 podStartE2EDuration="14.333499434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:17.332771748 +0000 UTC m=+1680.548485316" watchObservedRunningTime="2026-07-28 12:34:17.333499434 +0000 UTC m=+1680.549212976" Jul 28 12:34:19.860231 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.860191 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:19.860739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.860258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:19.860739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.860277 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:19.860739 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.860294 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:19.862326 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.862281 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Jul 28 12:34:19.862453 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.862316 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 28 12:34:19.862453 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.862339 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 28 12:34:19.862453 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:19.862419 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused" Jul 28 12:34:22.860331 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:22.860286 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:22.860852 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:22.860744 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:22.860928 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:22.860915 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:22.860987 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:22.860939 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:22.861079 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:22.861058 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:22.865671 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:22.865627 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:23.336755 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:23.336721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:23.336984 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:23.336777 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:23.336984 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:23.336797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:23.337204 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:23.337185 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:23.337449 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:23.337433 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:34:23.342992 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:34:23.342970 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:35:25.947867 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:25.947834 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh"] Jul 28 12:35:25.948393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:25.948082 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="registry" containerID="cri-o://c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da" gracePeriod=30 Jul 28 12:35:25.948393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:25.948144 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="offline" containerID="cri-o://1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261" gracePeriod=30 Jul 28 12:35:25.948393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:25.948144 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" containerID="cri-o://4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941" gracePeriod=30 Jul 28 12:35:25.948393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:25.948092 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" containerID="cri-o://ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca" gracePeriod=30 Jul 28 12:35:26.280250 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.280145 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv"] Jul 28 12:35:26.284609 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.284582 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.287357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.287326 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-b69wb\"" Jul 28 12:35:26.296026 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.295983 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv"] Jul 28 12:35:26.405494 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.405451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfcm8\" (UniqueName: \"kubernetes.io/projected/9ec32644-708d-4fe3-9393-91aeef4c3f0b-kube-api-access-qfcm8\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.405494 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.405495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.405797 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.405562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.405797 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.405577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.405797 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.405602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec32644-708d-4fe3-9393-91aeef4c3f0b-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.405797 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.405638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506458 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.506408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.506477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfcm8\" (UniqueName: \"kubernetes.io/projected/9ec32644-708d-4fe3-9393-91aeef4c3f0b-kube-api-access-qfcm8\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.506520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.506570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506619 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.506594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506856 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.506619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec32644-708d-4fe3-9393-91aeef4c3f0b-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.506856 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:26.506741 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 28 12:35:26.506856 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:26.506814 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls podName:9ec32644-708d-4fe3-9393-91aeef4c3f0b nodeName:}" failed. No retries permitted until 2026-07-28 12:35:27.006794369 +0000 UTC m=+1750.222507908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls") pod "feast-simple-feast-setup-777d6cc998-lfpjv" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b") : secret "feast-simple-feast-setup-registry-tls" not found Jul 28 12:35:26.507036 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.507005 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec32644-708d-4fe3-9393-91aeef4c3f0b-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.509436 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.509402 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.509593 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.509578 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.509925 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.509904 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:26.515284 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:26.515258 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfcm8\" (UniqueName: \"kubernetes.io/projected/9ec32644-708d-4fe3-9393-91aeef4c3f0b-kube-api-access-qfcm8\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:27.012554 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.012517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:27.015108 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.015076 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-lfpjv\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:27.198897 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.198837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:27.333051 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.333022 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv"] Jul 28 12:35:27.334401 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:35:27.334377 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ec32644_708d_4fe3_9393_91aeef4c3f0b.slice/crio-1a9a00f790477a2c7c5d6ebc71b125d63a18ca341523bb46de6196018a149b6b WatchSource:0}: Error finding container 1a9a00f790477a2c7c5d6ebc71b125d63a18ca341523bb46de6196018a149b6b: Status 404 returned error can't find the container with id 1a9a00f790477a2c7c5d6ebc71b125d63a18ca341523bb46de6196018a149b6b Jul 28 12:35:27.557892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.557814 2565 generic.go:356] "Generic (PLEG): container finished" podID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerID="ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca" exitCode=0 Jul 28 12:35:27.557892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.557838 2565 generic.go:356] "Generic (PLEG): container finished" podID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerID="4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941" exitCode=0 Jul 28 12:35:27.557892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.557887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca"} Jul 28 12:35:27.558125 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.557932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941"} Jul 28 12:35:27.559317 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.559294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370"} Jul 28 12:35:27.559414 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:27.559326 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"1a9a00f790477a2c7c5d6ebc71b125d63a18ca341523bb46de6196018a149b6b"} Jul 28 12:35:32.578645 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:32.578540 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerID="9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370" exitCode=0 Jul 28 12:35:32.578645 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:32.578614 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370"} Jul 28 12:35:33.336903 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:33.336860 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 28 12:35:33.337127 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:33.336870 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 28 12:35:33.584472 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:33.584439 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c"} Jul 28 12:35:38.604070 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:38.603986 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerID="0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c" exitCode=0 Jul 28 12:35:38.604421 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:38.604065 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c"} Jul 28 12:35:39.613878 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:39.613835 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba"} Jul 28 12:35:39.614345 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:39.613903 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030"} Jul 28 12:35:39.614345 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:39.613925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a"} Jul 28 12:35:39.614345 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:39.613942 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerStarted","Data":"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849"} Jul 28 12:35:39.643804 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:39.643738 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podStartSLOduration=13.643715462 podStartE2EDuration="13.643715462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:39.641255266 +0000 UTC m=+1762.856968806" watchObservedRunningTime="2026-07-28 12:35:39.643715462 +0000 UTC m=+1762.859429003" Jul 28 12:35:42.200146 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.200099 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:42.200647 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.200172 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:42.200647 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.200193 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:42.200647 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.200210 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:42.202069 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.202029 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Jul 28 12:35:42.202069 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.202049 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 28 12:35:42.202323 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.202059 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Jul 28 12:35:42.202323 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:42.202143 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 28 12:35:43.337136 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:43.337085 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 28 12:35:43.337698 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:43.337135 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 28 12:35:45.200578 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.200546 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201013 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.200677 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201013 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.200811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201013 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.200930 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201013 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.200980 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201280 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.201258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201371 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.201341 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201459 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.201442 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.201519 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.201509 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.205797 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.205779 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.642963 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.642874 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:45.646229 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:45.646206 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:35:53.336992 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:53.336933 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Jul 28 12:35:53.336992 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:53.336975 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Jul 28 12:35:53.337587 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:53.337078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:35:53.337587 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:53.337134 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:35:56.601969 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.601940 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:35:56.657322 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.657285 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-ui-tls\") pod \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " Jul 28 12:35:56.657484 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.657337 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls\") pod \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " Jul 28 12:35:56.657484 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.657359 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-feast-data\") pod \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " Jul 28 12:35:56.657484 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.657389 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-online-tls\") pod \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " Jul 28 12:35:56.657599 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.657498 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vsn6\" (UniqueName: \"kubernetes.io/projected/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-kube-api-access-2vsn6\") pod \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " Jul 28 12:35:56.657599 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.657534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-registry-tls\") pod \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\" (UID: \"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a\") " Jul 28 12:35:56.658058 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.658001 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-feast-data" (OuterVolumeSpecName: "feast-data") pod "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:35:56.659885 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.659852 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:35:56.659885 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.659836 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-online-tls" (OuterVolumeSpecName: "online-tls") pod "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:35:56.660043 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.659947 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-kube-api-access-2vsn6" (OuterVolumeSpecName: "kube-api-access-2vsn6") pod "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a"). InnerVolumeSpecName "kube-api-access-2vsn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:35:56.660139 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.660117 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:35:56.660191 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.660141 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" (UID: "981a26aa-d6bc-4fb2-89fc-bd2debd7b88a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:35:56.683958 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.683921 2565 generic.go:356] "Generic (PLEG): container finished" podID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerID="1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261" exitCode=137 Jul 28 12:35:56.683958 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.683956 2565 generic.go:356] "Generic (PLEG): container finished" podID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerID="c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da" exitCode=137 Jul 28 12:35:56.684140 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.683981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261"} Jul 28 12:35:56.684140 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.684000 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" Jul 28 12:35:56.684140 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.684025 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da"} Jul 28 12:35:56.684140 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.684047 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh" event={"ID":"981a26aa-d6bc-4fb2-89fc-bd2debd7b88a","Type":"ContainerDied","Data":"94affe5f2df24cd238ab740b6d912674212faa624a184c608739d24dc345e411"} Jul 28 12:35:56.684140 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.684070 2565 scope.go:117] "RemoveContainer" containerID="ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca" Jul 28 12:35:56.693194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.693174 2565 scope.go:117] "RemoveContainer" containerID="1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261" Jul 28 12:35:56.701040 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.701022 2565 scope.go:117] "RemoveContainer" containerID="4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941" Jul 28 12:35:56.708287 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.708213 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh"] Jul 28 12:35:56.708360 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.708331 2565 scope.go:117] "RemoveContainer" containerID="c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da" Jul 28 12:35:56.712445 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.712426 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vgwzh"] Jul 28 12:35:56.715814 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.715798 2565 scope.go:117] "RemoveContainer" containerID="cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b" Jul 28 12:35:56.722887 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.722870 2565 scope.go:117] "RemoveContainer" containerID="682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db" Jul 28 12:35:56.729720 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.729699 2565 scope.go:117] "RemoveContainer" containerID="ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca" Jul 28 12:35:56.730006 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:56.729976 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca\": container with ID starting with ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca not found: ID does not exist" containerID="ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca" Jul 28 12:35:56.730056 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730015 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca"} err="failed to get container status \"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca\": rpc error: code = NotFound desc = could not find container \"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca\": container with ID starting with ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca not found: ID does not exist" Jul 28 12:35:56.730056 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730035 2565 scope.go:117] "RemoveContainer" containerID="1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261" Jul 28 12:35:56.730272 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:56.730252 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261\": container with ID starting with 1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261 not found: ID does not exist" containerID="1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261" Jul 28 12:35:56.730340 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730282 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261"} err="failed to get container status \"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261\": rpc error: code = NotFound desc = could not find container \"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261\": container with ID starting with 1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261 not found: ID does not exist" Jul 28 12:35:56.730340 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730305 2565 scope.go:117] "RemoveContainer" containerID="4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941" Jul 28 12:35:56.730524 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:56.730509 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941\": container with ID starting with 4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941 not found: ID does not exist" containerID="4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941" Jul 28 12:35:56.730562 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730530 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941"} err="failed to get container status \"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941\": rpc error: code = NotFound desc = could not find container \"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941\": container with ID starting with 4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941 not found: ID does not exist" Jul 28 12:35:56.730562 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730544 2565 scope.go:117] "RemoveContainer" containerID="c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da" Jul 28 12:35:56.730736 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:56.730717 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da\": container with ID starting with c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da not found: ID does not exist" containerID="c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da" Jul 28 12:35:56.730779 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730742 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da"} err="failed to get container status \"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da\": rpc error: code = NotFound desc = could not find container \"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da\": container with ID starting with c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da not found: ID does not exist" Jul 28 12:35:56.730779 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730757 2565 scope.go:117] "RemoveContainer" containerID="cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b" Jul 28 12:35:56.730992 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:56.730976 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b\": container with ID starting with cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b not found: ID does not exist" containerID="cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b" Jul 28 12:35:56.731058 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.730999 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b"} err="failed to get container status \"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b\": rpc error: code = NotFound desc = could not find container \"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b\": container with ID starting with cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b not found: ID does not exist" Jul 28 12:35:56.731058 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731017 2565 scope.go:117] "RemoveContainer" containerID="682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db" Jul 28 12:35:56.731268 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:35:56.731253 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db\": container with ID starting with 682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db not found: ID does not exist" containerID="682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db" Jul 28 12:35:56.731306 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731273 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db"} err="failed to get container status \"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db\": rpc error: code = NotFound desc = could not find container \"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db\": container with ID starting with 682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db not found: ID does not exist" Jul 28 12:35:56.731306 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731301 2565 scope.go:117] "RemoveContainer" containerID="ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca" Jul 28 12:35:56.731503 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731483 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca"} err="failed to get container status \"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca\": rpc error: code = NotFound desc = could not find container \"ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca\": container with ID starting with ca59c8c652c4caa9ce4b6ef27f8cfa4d0cbd1039b60d749c15320edd863650ca not found: ID does not exist" Jul 28 12:35:56.731553 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731504 2565 scope.go:117] "RemoveContainer" containerID="1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261" Jul 28 12:35:56.731759 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731739 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261"} err="failed to get container status \"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261\": rpc error: code = NotFound desc = could not find container \"1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261\": container with ID starting with 1fa8720d180ede8356ac8d81f2703cca3f31aca72d4eade5f924f13d4a935261 not found: ID does not exist" Jul 28 12:35:56.731830 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731760 2565 scope.go:117] "RemoveContainer" containerID="4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941" Jul 28 12:35:56.732004 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.731987 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941"} err="failed to get container status \"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941\": rpc error: code = NotFound desc = could not find container \"4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941\": container with ID starting with 4db58d9e7ad238862251eba65e99dd930eb03cb719bbb799c5f2cc0b93729941 not found: ID does not exist" Jul 28 12:35:56.732052 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.732006 2565 scope.go:117] "RemoveContainer" containerID="c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da" Jul 28 12:35:56.732205 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.732188 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da"} err="failed to get container status \"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da\": rpc error: code = NotFound desc = could not find container \"c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da\": container with ID starting with c99e8b1b42749e6cd9aa18d7c336917729a38ddd3f1ab01d7f75a3e69d8236da not found: ID does not exist" Jul 28 12:35:56.732253 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.732207 2565 scope.go:117] "RemoveContainer" containerID="cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b" Jul 28 12:35:56.732382 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.732366 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b"} err="failed to get container status \"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b\": rpc error: code = NotFound desc = could not find container \"cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b\": container with ID starting with cd2ecdcc04de4da668fcb31b5cfa4a3e7b096c577f0eaf0e5ee831eaa4a4d18b not found: ID does not exist" Jul 28 12:35:56.732422 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.732382 2565 scope.go:117] "RemoveContainer" containerID="682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db" Jul 28 12:35:56.732561 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.732544 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db"} err="failed to get container status \"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db\": rpc error: code = NotFound desc = could not find container \"682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db\": container with ID starting with 682ee610b255a574e7144efbf68aa99bba2cd0a714141f18e2e8a200569fa3db not found: ID does not exist" Jul 28 12:35:56.758960 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.758932 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-online-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:35:56.758960 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.758956 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vsn6\" (UniqueName: \"kubernetes.io/projected/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-kube-api-access-2vsn6\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:35:56.758960 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.758966 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:35:56.759143 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.758975 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-ui-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:35:56.759143 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.758983 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-offline-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:35:56.759143 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:56.758990 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a-feast-data\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:35:57.344046 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:35:57.344011 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" path="/var/lib/kubelet/pods/981a26aa-d6bc-4fb2-89fc-bd2debd7b88a/volumes" Jul 28 12:36:47.758805 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.758763 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c"] Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759137 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="registry" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759152 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="registry" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759163 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="offline" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759172 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="offline" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759190 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759200 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759210 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="feast-apply" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759218 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="feast-apply" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759229 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="feast-init" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759238 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="feast-init" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759256 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759264 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759321 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="ui" Jul 28 12:36:47.759325 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759332 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="online" Jul 28 12:36:47.759773 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759341 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="registry" Jul 28 12:36:47.759773 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.759350 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="981a26aa-d6bc-4fb2-89fc-bd2debd7b88a" containerName="offline" Jul 28 12:36:47.763011 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.762984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:47.766318 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766131 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 28 12:36:47.766318 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766157 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 28 12:36:47.766318 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766238 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 28 12:36:47.766318 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766249 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 28 12:36:47.766612 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766409 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-sq7x6\"" Jul 28 12:36:47.766721 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766682 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 28 12:36:47.766982 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.766966 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 28 12:36:47.775001 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.774975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c"] Jul 28 12:36:47.935588 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.935552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:47.935588 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.935600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d0a8309e-7853-45d9-b889-ce67007b71fb-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:47.935841 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.935639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8309e-7853-45d9-b889-ce67007b71fb-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:47.935841 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.935694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:47.935841 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.935742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:47.935841 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:47.935790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbnzf\" (UniqueName: \"kubernetes.io/projected/d0a8309e-7853-45d9-b889-ce67007b71fb-kube-api-access-tbnzf\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036368 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036368 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbnzf\" (UniqueName: \"kubernetes.io/projected/d0a8309e-7853-45d9-b889-ce67007b71fb-kube-api-access-tbnzf\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036368 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036687 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d0a8309e-7853-45d9-b889-ce67007b71fb-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036687 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036439 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8309e-7853-45d9-b889-ce67007b71fb-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036687 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:36:48.036449 2565 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 28 12:36:48.036687 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.036687 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:36:48.036576 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls podName:d0a8309e-7853-45d9-b889-ce67007b71fb nodeName:}" failed. No retries permitted until 2026-07-28 12:36:48.536553568 +0000 UTC m=+1831.752267101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-7mv5c" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 28 12:36:48.037017 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.036989 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8309e-7853-45d9-b889-ce67007b71fb-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.037465 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.037443 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d0a8309e-7853-45d9-b889-ce67007b71fb-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.039130 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.039102 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.039130 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.039127 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.048781 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.048758 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbnzf\" (UniqueName: \"kubernetes.io/projected/d0a8309e-7853-45d9-b889-ce67007b71fb-kube-api-access-tbnzf\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.539637 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.539604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.542144 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.542125 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-7mv5c\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.675409 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.675366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:36:48.809736 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.809685 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c"] Jul 28 12:36:48.811752 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:36:48.811724 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0a8309e_7853_45d9_b889_ce67007b71fb.slice/crio-9cc7ff763a151ec811c6861f7fbe756283c7fc916ebd86be4d176c755a04fc51 WatchSource:0}: Error finding container 9cc7ff763a151ec811c6861f7fbe756283c7fc916ebd86be4d176c755a04fc51: Status 404 returned error can't find the container with id 9cc7ff763a151ec811c6861f7fbe756283c7fc916ebd86be4d176c755a04fc51 Jul 28 12:36:48.865800 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:48.865757 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerStarted","Data":"9cc7ff763a151ec811c6861f7fbe756283c7fc916ebd86be4d176c755a04fc51"} Jul 28 12:36:49.871393 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:49.871347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerStarted","Data":"c285f04e3ff60b8a12c47c7baad257b4ed39708417de10b85c99c6cc6efeab26"} Jul 28 12:36:53.887265 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:53.887226 2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerID="c285f04e3ff60b8a12c47c7baad257b4ed39708417de10b85c99c6cc6efeab26" exitCode=0 Jul 28 12:36:53.887634 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:53.887268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerDied","Data":"c285f04e3ff60b8a12c47c7baad257b4ed39708417de10b85c99c6cc6efeab26"} Jul 28 12:36:54.891991 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:36:54.891959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerStarted","Data":"8fe4d2dffc2ff53a8f6b90b7cdce8ad0885c99ee437b3510fb6b3fa3f9a3fc6e"} Jul 28 12:37:00.913542 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:00.913501 2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerID="8fe4d2dffc2ff53a8f6b90b7cdce8ad0885c99ee437b3510fb6b3fa3f9a3fc6e" exitCode=0 Jul 28 12:37:00.913542 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:00.913542 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerDied","Data":"8fe4d2dffc2ff53a8f6b90b7cdce8ad0885c99ee437b3510fb6b3fa3f9a3fc6e"} Jul 28 12:37:01.920714 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:01.920648 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerStarted","Data":"013cdf3083cf3d49f512d9e55f9f1de383925533a0dbdcdcb3e622d85ea02f2d"} Jul 28 12:37:01.921135 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:01.920736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerStarted","Data":"bb607ae2b51c448f9c1a51817598d411fbeb115c4865297910d9995ff71d650f"} Jul 28 12:37:01.921135 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:01.920756 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerStarted","Data":"b4c6114d4ace0f3475ad462b60e250760b863084cc206735fbe22adc25cc5745"} Jul 28 12:37:01.958107 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:01.958035 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podStartSLOduration=14.95801266 podStartE2EDuration="14.95801266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:37:01.95689322 +0000 UTC m=+1845.172606785" watchObservedRunningTime="2026-07-28 12:37:01.95801266 +0000 UTC m=+1845.173726200" Jul 28 12:37:03.676321 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:03.676275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:03.676855 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:03.676350 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:03.676855 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:03.676370 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:03.677989 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:03.677956 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Jul 28 12:37:03.678084 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:03.677983 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused" Jul 28 12:37:03.678084 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:03.677996 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Jul 28 12:37:06.676799 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.676746 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Jul 28 12:37:06.677636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.677615 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:06.678084 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.678060 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:06.678541 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.678525 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:06.850324 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.850289 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:06.947523 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.947489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:06.952156 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:06.952127 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:08.676445 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:08.676410 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:09.676827 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:09.676797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:37:09.958372 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:37:09.958343 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:38:11.142958 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.142919 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c"] Jul 28 12:38:11.143545 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.143161 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" containerID="cri-o://b4c6114d4ace0f3475ad462b60e250760b863084cc206735fbe22adc25cc5745" gracePeriod=30 Jul 28 12:38:11.143545 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.143198 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" containerID="cri-o://013cdf3083cf3d49f512d9e55f9f1de383925533a0dbdcdcb3e622d85ea02f2d" gracePeriod=30 Jul 28 12:38:11.143545 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.143343 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="offline" containerID="cri-o://bb607ae2b51c448f9c1a51817598d411fbeb115c4865297910d9995ff71d650f" gracePeriod=30 Jul 28 12:38:11.344870 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.344840 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv"] Jul 28 12:38:11.345158 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.345129 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="registry" containerID="cri-o://623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849" gracePeriod=30 Jul 28 12:38:11.345391 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.345211 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="offline" containerID="cri-o://cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030" gracePeriod=30 Jul 28 12:38:11.345503 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.345253 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" containerID="cri-o://f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a" gracePeriod=30 Jul 28 12:38:11.345580 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:11.345228 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" containerID="cri-o://37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba" gracePeriod=30 Jul 28 12:38:12.186684 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.186636 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerID="37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba" exitCode=0 Jul 28 12:38:12.186684 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.186678 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerID="f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a" exitCode=0 Jul 28 12:38:12.187078 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.186711 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba"} Jul 28 12:38:12.187078 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.186754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a"} Jul 28 12:38:12.189339 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.189317 2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerID="013cdf3083cf3d49f512d9e55f9f1de383925533a0dbdcdcb3e622d85ea02f2d" exitCode=0 Jul 28 12:38:12.189339 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.189337 2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerID="b4c6114d4ace0f3475ad462b60e250760b863084cc206735fbe22adc25cc5745" exitCode=0 Jul 28 12:38:12.189467 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.189366 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerDied","Data":"013cdf3083cf3d49f512d9e55f9f1de383925533a0dbdcdcb3e622d85ea02f2d"} Jul 28 12:38:12.189467 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:12.189389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerDied","Data":"b4c6114d4ace0f3475ad462b60e250760b863084cc206735fbe22adc25cc5745"} Jul 28 12:38:15.201823 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:15.201774 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 28 12:38:15.643622 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:15.643531 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 28 12:38:16.948525 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:16.948480 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Jul 28 12:38:19.958842 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:19.958802 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Jul 28 12:38:25.201914 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:25.201854 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 28 12:38:25.643811 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:25.643717 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 28 12:38:26.948263 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:26.948225 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Jul 28 12:38:29.958758 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:29.958716 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Jul 28 12:38:35.201430 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:35.201376 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused" Jul 28 12:38:35.201906 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:35.201558 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:38:35.643995 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:35.643898 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Jul 28 12:38:35.644218 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:35.644040 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:38:36.947925 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:36.947883 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused" Jul 28 12:38:36.948333 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:36.948011 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:38:39.958060 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:39.958021 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused" Jul 28 12:38:39.958530 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:39.958135 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:38:41.289593 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.289563 2565 generic.go:356] "Generic (PLEG): container finished" podID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerID="bb607ae2b51c448f9c1a51817598d411fbeb115c4865297910d9995ff71d650f" exitCode=137 Jul 28 12:38:41.289966 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.289639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerDied","Data":"bb607ae2b51c448f9c1a51817598d411fbeb115c4865297910d9995ff71d650f"} Jul 28 12:38:41.798689 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.798646 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:38:41.923718 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.923690 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-online-tls\") pod \"d0a8309e-7853-45d9-b889-ce67007b71fb\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " Jul 28 12:38:41.923866 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.923746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls\") pod \"d0a8309e-7853-45d9-b889-ce67007b71fb\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " Jul 28 12:38:41.923866 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.923767 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbnzf\" (UniqueName: \"kubernetes.io/projected/d0a8309e-7853-45d9-b889-ce67007b71fb-kube-api-access-tbnzf\") pod \"d0a8309e-7853-45d9-b889-ce67007b71fb\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " Jul 28 12:38:41.923866 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.923795 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d0a8309e-7853-45d9-b889-ce67007b71fb-registry-tls\") pod \"d0a8309e-7853-45d9-b889-ce67007b71fb\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " Jul 28 12:38:41.924028 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.923905 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-offline-tls\") pod \"d0a8309e-7853-45d9-b889-ce67007b71fb\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " Jul 28 12:38:41.924028 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.923926 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8309e-7853-45d9-b889-ce67007b71fb-feast-data\") pod \"d0a8309e-7853-45d9-b889-ce67007b71fb\" (UID: \"d0a8309e-7853-45d9-b889-ce67007b71fb\") " Jul 28 12:38:41.924171 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.924132 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0a8309e-7853-45d9-b889-ce67007b71fb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d0a8309e-7853-45d9-b889-ce67007b71fb" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 12:38:41.924528 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.924510 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a8309e-7853-45d9-b889-ce67007b71fb-feast-data" (OuterVolumeSpecName: "feast-data") pod "d0a8309e-7853-45d9-b889-ce67007b71fb" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:38:41.928052 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.928018 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-online-tls" (OuterVolumeSpecName: "online-tls") pod "d0a8309e-7853-45d9-b889-ce67007b71fb" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:41.928052 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.928030 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d0a8309e-7853-45d9-b889-ce67007b71fb" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:41.928223 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.928057 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d0a8309e-7853-45d9-b889-ce67007b71fb" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:41.928223 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.928064 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a8309e-7853-45d9-b889-ce67007b71fb-kube-api-access-tbnzf" (OuterVolumeSpecName: "kube-api-access-tbnzf") pod "d0a8309e-7853-45d9-b889-ce67007b71fb" (UID: "d0a8309e-7853-45d9-b889-ce67007b71fb"). InnerVolumeSpecName "kube-api-access-tbnzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:38:41.987699 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:41.987645 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:38:42.024568 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-offline-tls\") pod \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " Jul 28 12:38:42.024784 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024576 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec32644-708d-4fe3-9393-91aeef4c3f0b-feast-data\") pod \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " Jul 28 12:38:42.024784 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024593 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-ui-tls\") pod \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " Jul 28 12:38:42.024784 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024621 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfcm8\" (UniqueName: \"kubernetes.io/projected/9ec32644-708d-4fe3-9393-91aeef4c3f0b-kube-api-access-qfcm8\") pod \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " Jul 28 12:38:42.024784 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024706 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-online-tls\") pod \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " Jul 28 12:38:42.024784 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024757 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls\") pod \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\" (UID: \"9ec32644-708d-4fe3-9393-91aeef4c3f0b\") " Jul 28 12:38:42.025057 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024925 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-ui-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.025057 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024943 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbnzf\" (UniqueName: \"kubernetes.io/projected/d0a8309e-7853-45d9-b889-ce67007b71fb-kube-api-access-tbnzf\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.025057 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024958 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d0a8309e-7853-45d9-b889-ce67007b71fb-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.025057 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024970 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-offline-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.025057 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024982 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d0a8309e-7853-45d9-b889-ce67007b71fb-feast-data\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.025057 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.024991 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d0a8309e-7853-45d9-b889-ce67007b71fb-online-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.025372 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.025141 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec32644-708d-4fe3-9393-91aeef4c3f0b-feast-data" (OuterVolumeSpecName: "feast-data") pod "9ec32644-708d-4fe3-9393-91aeef4c3f0b" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 12:38:42.026994 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.026961 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-online-tls" (OuterVolumeSpecName: "online-tls") pod "9ec32644-708d-4fe3-9393-91aeef4c3f0b" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:42.027105 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.027015 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9ec32644-708d-4fe3-9393-91aeef4c3f0b" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:42.027105 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.027050 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ec32644-708d-4fe3-9393-91aeef4c3f0b" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:42.027215 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.027188 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9ec32644-708d-4fe3-9393-91aeef4c3f0b" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 12:38:42.027296 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.027282 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec32644-708d-4fe3-9393-91aeef4c3f0b-kube-api-access-qfcm8" (OuterVolumeSpecName: "kube-api-access-qfcm8") pod "9ec32644-708d-4fe3-9393-91aeef4c3f0b" (UID: "9ec32644-708d-4fe3-9393-91aeef4c3f0b"). InnerVolumeSpecName "kube-api-access-qfcm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 12:38:42.126098 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.126070 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-ui-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.126098 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.126102 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfcm8\" (UniqueName: \"kubernetes.io/projected/9ec32644-708d-4fe3-9393-91aeef4c3f0b-kube-api-access-qfcm8\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.126256 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.126114 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-online-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.126256 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.126125 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-registry-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.126256 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.126132 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9ec32644-708d-4fe3-9393-91aeef4c3f0b-offline-tls\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.126256 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.126139 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec32644-708d-4fe3-9393-91aeef4c3f0b-feast-data\") on node \"ip-10-0-134-240.ec2.internal\" DevicePath \"\"" Jul 28 12:38:42.295322 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.295291 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" Jul 28 12:38:42.295801 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.295292 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c" event={"ID":"d0a8309e-7853-45d9-b889-ce67007b71fb","Type":"ContainerDied","Data":"9cc7ff763a151ec811c6861f7fbe756283c7fc916ebd86be4d176c755a04fc51"} Jul 28 12:38:42.295801 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.295413 2565 scope.go:117] "RemoveContainer" containerID="013cdf3083cf3d49f512d9e55f9f1de383925533a0dbdcdcb3e622d85ea02f2d" Jul 28 12:38:42.298333 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.298307 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerID="cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030" exitCode=137 Jul 28 12:38:42.298444 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.298334 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerID="623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849" exitCode=137 Jul 28 12:38:42.298444 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.298385 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" Jul 28 12:38:42.298529 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.298380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030"} Jul 28 12:38:42.298529 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.298497 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849"} Jul 28 12:38:42.298529 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.298512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv" event={"ID":"9ec32644-708d-4fe3-9393-91aeef4c3f0b","Type":"ContainerDied","Data":"1a9a00f790477a2c7c5d6ebc71b125d63a18ca341523bb46de6196018a149b6b"} Jul 28 12:38:42.304175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.304156 2565 scope.go:117] "RemoveContainer" containerID="bb607ae2b51c448f9c1a51817598d411fbeb115c4865297910d9995ff71d650f" Jul 28 12:38:42.312212 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.312198 2565 scope.go:117] "RemoveContainer" containerID="b4c6114d4ace0f3475ad462b60e250760b863084cc206735fbe22adc25cc5745" Jul 28 12:38:42.319451 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.319432 2565 scope.go:117] "RemoveContainer" containerID="8fe4d2dffc2ff53a8f6b90b7cdce8ad0885c99ee437b3510fb6b3fa3f9a3fc6e" Jul 28 12:38:42.320596 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.320575 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c"] Jul 28 12:38:42.324827 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.324809 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-7mv5c"] Jul 28 12:38:42.326863 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.326844 2565 scope.go:117] "RemoveContainer" containerID="c285f04e3ff60b8a12c47c7baad257b4ed39708417de10b85c99c6cc6efeab26" Jul 28 12:38:42.333438 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.333421 2565 scope.go:117] "RemoveContainer" containerID="37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba" Jul 28 12:38:42.339889 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.339869 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv"] Jul 28 12:38:42.340806 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.340790 2565 scope.go:117] "RemoveContainer" containerID="cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030" Jul 28 12:38:42.345750 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.345723 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-lfpjv"] Jul 28 12:38:42.348365 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.348346 2565 scope.go:117] "RemoveContainer" containerID="f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a" Jul 28 12:38:42.354912 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.354893 2565 scope.go:117] "RemoveContainer" containerID="623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849" Jul 28 12:38:42.361554 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.361539 2565 scope.go:117] "RemoveContainer" containerID="0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c" Jul 28 12:38:42.367979 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.367960 2565 scope.go:117] "RemoveContainer" containerID="9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370" Jul 28 12:38:42.374343 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.374325 2565 scope.go:117] "RemoveContainer" containerID="37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba" Jul 28 12:38:42.374578 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:38:42.374559 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba\": container with ID starting with 37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba not found: ID does not exist" containerID="37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba" Jul 28 12:38:42.374630 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.374586 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba"} err="failed to get container status \"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba\": rpc error: code = NotFound desc = could not find container \"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba\": container with ID starting with 37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba not found: ID does not exist" Jul 28 12:38:42.374630 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.374604 2565 scope.go:117] "RemoveContainer" containerID="cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030" Jul 28 12:38:42.374884 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:38:42.374867 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030\": container with ID starting with cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030 not found: ID does not exist" containerID="cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030" Jul 28 12:38:42.374928 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.374891 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030"} err="failed to get container status \"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030\": rpc error: code = NotFound desc = could not find container \"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030\": container with ID starting with cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030 not found: ID does not exist" Jul 28 12:38:42.374928 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.374908 2565 scope.go:117] "RemoveContainer" containerID="f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a" Jul 28 12:38:42.375136 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:38:42.375118 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a\": container with ID starting with f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a not found: ID does not exist" containerID="f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a" Jul 28 12:38:42.375176 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375141 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a"} err="failed to get container status \"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a\": rpc error: code = NotFound desc = could not find container \"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a\": container with ID starting with f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a not found: ID does not exist" Jul 28 12:38:42.375176 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375156 2565 scope.go:117] "RemoveContainer" containerID="623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849" Jul 28 12:38:42.375343 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:38:42.375329 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849\": container with ID starting with 623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849 not found: ID does not exist" containerID="623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849" Jul 28 12:38:42.375379 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375348 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849"} err="failed to get container status \"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849\": rpc error: code = NotFound desc = could not find container \"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849\": container with ID starting with 623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849 not found: ID does not exist" Jul 28 12:38:42.375379 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375360 2565 scope.go:117] "RemoveContainer" containerID="0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c" Jul 28 12:38:42.375562 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:38:42.375547 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c\": container with ID starting with 0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c not found: ID does not exist" containerID="0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c" Jul 28 12:38:42.375602 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375566 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c"} err="failed to get container status \"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c\": rpc error: code = NotFound desc = could not find container \"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c\": container with ID starting with 0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c not found: ID does not exist" Jul 28 12:38:42.375602 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375577 2565 scope.go:117] "RemoveContainer" containerID="9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370" Jul 28 12:38:42.375786 ip-10-0-134-240 kubenswrapper[2565]: E0728 12:38:42.375770 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370\": container with ID starting with 9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370 not found: ID does not exist" containerID="9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370" Jul 28 12:38:42.375836 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375790 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370"} err="failed to get container status \"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370\": rpc error: code = NotFound desc = could not find container \"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370\": container with ID starting with 9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370 not found: ID does not exist" Jul 28 12:38:42.375836 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375802 2565 scope.go:117] "RemoveContainer" containerID="37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba" Jul 28 12:38:42.375991 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375976 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba"} err="failed to get container status \"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba\": rpc error: code = NotFound desc = could not find container \"37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba\": container with ID starting with 37bdf1b73f3c2273b8f10efe0959f84f5e06aa064e78e812ad10109787a51aba not found: ID does not exist" Jul 28 12:38:42.376049 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.375991 2565 scope.go:117] "RemoveContainer" containerID="cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030" Jul 28 12:38:42.376194 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376178 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030"} err="failed to get container status \"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030\": rpc error: code = NotFound desc = could not find container \"cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030\": container with ID starting with cfbe31a051ef34f3f7e1961492be7a2d1a00cb6d28af1d7617a5039c051ef030 not found: ID does not exist" Jul 28 12:38:42.376238 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376195 2565 scope.go:117] "RemoveContainer" containerID="f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a" Jul 28 12:38:42.376403 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376387 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a"} err="failed to get container status \"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a\": rpc error: code = NotFound desc = could not find container \"f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a\": container with ID starting with f918863ec1e7dc06f82c78d2133216f18578bcd74c345f0da51445a13239a46a not found: ID does not exist" Jul 28 12:38:42.376446 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376402 2565 scope.go:117] "RemoveContainer" containerID="623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849" Jul 28 12:38:42.376565 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376551 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849"} err="failed to get container status \"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849\": rpc error: code = NotFound desc = could not find container \"623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849\": container with ID starting with 623766e3358c1a771ffb5bf88fe6a5f7b026d47ce7866739dbbb40a3d088a849 not found: ID does not exist" Jul 28 12:38:42.376611 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376565 2565 scope.go:117] "RemoveContainer" containerID="0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c" Jul 28 12:38:42.376806 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376787 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c"} err="failed to get container status \"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c\": rpc error: code = NotFound desc = could not find container \"0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c\": container with ID starting with 0037a8cbbf20ec6c54b4cd030ce8371fc71605dfd3264a504feb0c1c1e42180c not found: ID does not exist" Jul 28 12:38:42.376883 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.376808 2565 scope.go:117] "RemoveContainer" containerID="9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370" Jul 28 12:38:42.377037 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:42.377019 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370"} err="failed to get container status \"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370\": rpc error: code = NotFound desc = could not find container \"9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370\": container with ID starting with 9411a6e4368217c478cc75a57892126d176443efefc1ee2e5b422adf8cd9a370 not found: ID does not exist" Jul 28 12:38:43.342635 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:43.342603 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" path="/var/lib/kubelet/pods/9ec32644-708d-4fe3-9393-91aeef4c3f0b/volumes" Jul 28 12:38:43.343187 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:38:43.343173 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" path="/var/lib/kubelet/pods/d0a8309e-7853-45d9-b889-ce67007b71fb/volumes" Jul 28 12:39:18.596245 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596209 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8gzv9/must-gather-9gzg2"] Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596440 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="feast-init" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596450 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="feast-init" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596460 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="offline" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596465 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="offline" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596471 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596477 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596485 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="offline" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596489 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="offline" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596495 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596499 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596506 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596511 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596518 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="feast-init" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596523 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="feast-init" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596527 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="feast-apply" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596532 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="feast-apply" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596537 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="feast-apply" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596542 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="feast-apply" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596549 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="registry" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596554 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="registry" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596560 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596565 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596603 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="online" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596609 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="offline" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596615 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="offline" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596621 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="ui" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596628 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a8309e-7853-45d9-b889-ce67007b71fb" containerName="ui" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596633 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="online" Jul 28 12:39:18.596636 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.596638 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec32644-708d-4fe3-9393-91aeef4c3f0b" containerName="registry" Jul 28 12:39:18.600892 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.600871 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.603248 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.603222 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8gzv9\"/\"kube-root-ca.crt\"" Jul 28 12:39:18.603353 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.603264 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8gzv9\"/\"openshift-service-ca.crt\"" Jul 28 12:39:18.603353 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.603220 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8gzv9\"/\"default-dockercfg-xd5gj\"" Jul 28 12:39:18.608130 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.608107 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8gzv9/must-gather-9gzg2"] Jul 28 12:39:18.697178 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.697142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6d59862-9b4d-4ac2-ae76-b064e11b8efd-must-gather-output\") pod \"must-gather-9gzg2\" (UID: \"f6d59862-9b4d-4ac2-ae76-b064e11b8efd\") " pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.697329 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.697192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5sg9\" (UniqueName: \"kubernetes.io/projected/f6d59862-9b4d-4ac2-ae76-b064e11b8efd-kube-api-access-b5sg9\") pod \"must-gather-9gzg2\" (UID: \"f6d59862-9b4d-4ac2-ae76-b064e11b8efd\") " pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.797996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.797954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6d59862-9b4d-4ac2-ae76-b064e11b8efd-must-gather-output\") pod \"must-gather-9gzg2\" (UID: \"f6d59862-9b4d-4ac2-ae76-b064e11b8efd\") " pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.797996 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.798009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5sg9\" (UniqueName: \"kubernetes.io/projected/f6d59862-9b4d-4ac2-ae76-b064e11b8efd-kube-api-access-b5sg9\") pod \"must-gather-9gzg2\" (UID: \"f6d59862-9b4d-4ac2-ae76-b064e11b8efd\") " pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.798295 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.798276 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6d59862-9b4d-4ac2-ae76-b064e11b8efd-must-gather-output\") pod \"must-gather-9gzg2\" (UID: \"f6d59862-9b4d-4ac2-ae76-b064e11b8efd\") " pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.808382 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.808355 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5sg9\" (UniqueName: \"kubernetes.io/projected/f6d59862-9b4d-4ac2-ae76-b064e11b8efd-kube-api-access-b5sg9\") pod \"must-gather-9gzg2\" (UID: \"f6d59862-9b4d-4ac2-ae76-b064e11b8efd\") " pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:18.910132 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:18.910037 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8gzv9/must-gather-9gzg2" Jul 28 12:39:19.034052 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:19.034012 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8gzv9/must-gather-9gzg2"] Jul 28 12:39:19.037454 ip-10-0-134-240 kubenswrapper[2565]: W0728 12:39:19.037425 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6d59862_9b4d_4ac2_ae76_b064e11b8efd.slice/crio-8e99a3a1f62d76c1731d83eabe214b49b941f720d4f8da2d105e47ace81c78a3 WatchSource:0}: Error finding container 8e99a3a1f62d76c1731d83eabe214b49b941f720d4f8da2d105e47ace81c78a3: Status 404 returned error can't find the container with id 8e99a3a1f62d76c1731d83eabe214b49b941f720d4f8da2d105e47ace81c78a3 Jul 28 12:39:19.039153 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:19.039135 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 12:39:19.414989 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:19.414946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8gzv9/must-gather-9gzg2" event={"ID":"f6d59862-9b4d-4ac2-ae76-b064e11b8efd","Type":"ContainerStarted","Data":"8e99a3a1f62d76c1731d83eabe214b49b941f720d4f8da2d105e47ace81c78a3"} Jul 28 12:39:20.420493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:20.420461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8gzv9/must-gather-9gzg2" event={"ID":"f6d59862-9b4d-4ac2-ae76-b064e11b8efd","Type":"ContainerStarted","Data":"a6022e96f8d65faa6ecb12f770880ed08eec1d980d80652504d3b34ef47d8500"} Jul 28 12:39:20.420913 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:20.420514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8gzv9/must-gather-9gzg2" event={"ID":"f6d59862-9b4d-4ac2-ae76-b064e11b8efd","Type":"ContainerStarted","Data":"46938483c3901d2d528118061987e5c12a4893bf006344386ab790ce2fb44729"} Jul 28 12:39:20.454123 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:20.454071 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8gzv9/must-gather-9gzg2" podStartSLOduration=1.777702751 podStartE2EDuration="2.454054961s" totalImagesPullingTime="676.35221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:39:20.453244487 +0000 UTC m=+1983.668958027" watchObservedRunningTime="2026-07-28 12:39:20.454054961 +0000 UTC m=+1983.669768501" Jul 28 12:39:21.109041 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:21.109001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5b4gp_21f28e07-939d-4582-8596-26d60b09037f/global-pull-secret-syncer/0.log" Jul 28 12:39:21.230114 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:21.230082 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jnvzp_8abc18af-7ab0-40e5-b9a3-3bb6f4e232bd/konnectivity-agent/0.log" Jul 28 12:39:21.344643 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:21.344615 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-240.ec2.internal_b70634fadc0c17920af7cef2bc204f24/haproxy/0.log" Jul 28 12:39:25.660628 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:25.660596 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6jnvs_59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc/node-exporter/0.log" Jul 28 12:39:25.685939 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:25.685897 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6jnvs_59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc/kube-rbac-proxy/0.log" Jul 28 12:39:25.709291 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:25.709265 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6jnvs_59ac2176-29e4-4ce1-93eb-a0ef9abdc5dc/init-textfile/0.log" Jul 28 12:39:28.093071 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.093022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh"] Jul 28 12:39:28.097744 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.097714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.108764 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.108738 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh"] Jul 28 12:39:28.176731 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.176692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-podres\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.176901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.176746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-proc\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.176901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.176772 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-lib-modules\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.176901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.176849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-sys\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.176901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.176897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5864t\" (UniqueName: \"kubernetes.io/projected/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-kube-api-access-5864t\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.277931 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.277892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-lib-modules\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.277931 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.277934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-sys\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.277956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5864t\" (UniqueName: \"kubernetes.io/projected/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-kube-api-access-5864t\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.277980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-podres\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.278019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-proc\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.278051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-sys\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.278094 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-lib-modules\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.278110 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-proc\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.278175 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.278173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-podres\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.287837 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.287812 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5864t\" (UniqueName: \"kubernetes.io/projected/bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d-kube-api-access-5864t\") pod \"perf-node-gather-daemonset-n5dsh\" (UID: \"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d\") " pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.410130 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.410048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:28.562298 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.562263 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh"] Jul 28 12:39:28.604597 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:28.604562 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cb6459f8c-5dh5s_9c443788-4231-4604-94d8-623139e2b052/console/0.log" Jul 28 12:39:29.469493 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:29.469451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" event={"ID":"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d","Type":"ContainerStarted","Data":"af1a99c841c1f8b11d4513b9798c5a5f8a699f437a261f2b89865d6203a7d1c5"} Jul 28 12:39:29.469999 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:29.469545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" event={"ID":"bc2a7fc1-2b9c-4d6b-915b-21fb085dad8d","Type":"ContainerStarted","Data":"ab3305d0da18ccfc1b0ae9f4116ceedd5577eb06109797b932403c261c9cfd02"} Jul 28 12:39:29.469999 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:29.469578 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:29.488116 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:29.488053 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" podStartSLOduration=1.488032912 podStartE2EDuration="1.488032912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:39:29.486322426 +0000 UTC m=+1992.702035987" watchObservedRunningTime="2026-07-28 12:39:29.488032912 +0000 UTC m=+1992.703746453" Jul 28 12:39:29.894079 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:29.894002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95f9k_a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4/dns/0.log" Jul 28 12:39:29.915110 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:29.915089 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95f9k_a4e6a0ee-eb75-4ccb-a766-6c8b69d58aa4/kube-rbac-proxy/0.log" Jul 28 12:39:30.003357 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:30.003328 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4p26_7d6f68fb-32bf-494e-83b9-9f79f6115e71/dns-node-resolver/0.log" Jul 28 12:39:30.501527 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:30.501498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gx2nl_1541d440-2a02-4d0a-b5d0-11e508b08ecb/node-ca/0.log" Jul 28 12:39:31.516037 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:31.516005 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jf7w7_bfc1a281-3703-4af1-b929-fee27beb10f4/serve-healthcheck-canary/0.log" Jul 28 12:39:32.135328 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:32.135299 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qm68g_246ee6ab-73a2-4ee5-a4a3-0499593c6a6a/kube-rbac-proxy/0.log" Jul 28 12:39:32.158111 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:32.158085 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qm68g_246ee6ab-73a2-4ee5-a4a3-0499593c6a6a/exporter/0.log" Jul 28 12:39:32.183181 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:32.183159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qm68g_246ee6ab-73a2-4ee5-a4a3-0499593c6a6a/extractor/0.log" Jul 28 12:39:35.484941 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:35.484394 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8gzv9/perf-node-gather-daemonset-n5dsh" Jul 28 12:39:37.558151 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.558123 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/kube-multus-additional-cni-plugins/0.log" Jul 28 12:39:37.581566 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.581536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/egress-router-binary-copy/0.log" Jul 28 12:39:37.610539 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.610512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/cni-plugins/0.log" Jul 28 12:39:37.632711 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.632679 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/bond-cni-plugin/0.log" Jul 28 12:39:37.659851 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.659819 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/routeoverride-cni/0.log" Jul 28 12:39:37.686590 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.686563 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/whereabouts-cni-bincopy/0.log" Jul 28 12:39:37.709082 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:37.709053 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ngrlm_c1a172ba-8701-4c27-9c72-8d37dda47333/whereabouts-cni/0.log" Jul 28 12:39:38.070469 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:38.070430 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c27fg_0444982b-3cdd-48a2-bcf3-b181c07b7537/kube-multus/0.log" Jul 28 12:39:38.231215 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:38.231180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qd9sp_b33359e2-316a-4f52-9ec2-13cf860641bf/network-metrics-daemon/0.log" Jul 28 12:39:38.249701 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:38.249647 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qd9sp_b33359e2-316a-4f52-9ec2-13cf860641bf/kube-rbac-proxy/0.log" Jul 28 12:39:39.240177 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.240143 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/ovn-controller/0.log" Jul 28 12:39:39.257011 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.256974 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/ovn-acl-logging/0.log" Jul 28 12:39:39.282316 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.282290 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/kube-rbac-proxy-node/0.log" Jul 28 12:39:39.305011 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.304955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 12:39:39.328743 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.328718 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/northd/0.log" Jul 28 12:39:39.352291 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.352265 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/nbdb/0.log" Jul 28 12:39:39.372614 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.372588 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/sbdb/0.log" Jul 28 12:39:39.429716 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:39.429631 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksg7x_83541d93-1f2d-42d5-9a44-40e0fd8a1e60/ovnkube-controller/0.log" Jul 28 12:39:40.763795 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:40.763761 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-w2mr5_d3193f48-e403-40aa-88b7-b828fbd7b4c9/network-check-target-container/0.log" Jul 28 12:39:41.660901 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:41.660852 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8r2g5_706a5828-b3c1-4947-acae-f3daac313363/iptables-alerter/0.log" Jul 28 12:39:42.328798 ip-10-0-134-240 kubenswrapper[2565]: I0728 12:39:42.328767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8llhh_1ecc9a4e-2d4f-442b-92fd-1f5c692ca308/tuned/0.log"