Sep 15 07:24:49.559852 ip-10-0-139-67 systemd[1]: Starting Kubernetes Kubelet... Sep 15 07:24:50.008376 ip-10-0-139-67 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 07:24:50.008376 ip-10-0-139-67 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 07:24:50.008376 ip-10-0-139-67 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 07:24:50.008376 ip-10-0-139-67 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 07:24:50.008376 ip-10-0-139-67 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 07:24:50.009097 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.008428 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 07:24:50.015441 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015423 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 07:24:50.015441 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015440 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015444 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015449 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015452 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015455 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015464 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015467 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015470 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015472 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015475 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015478 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015481 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015483 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015486 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015489 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015492 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015494 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015497 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015500 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015503 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 07:24:50.015512 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015505 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015509 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015511 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015514 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015517 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015520 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015522 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015534 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015538 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015541 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015544 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015547 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015553 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015556 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015558 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015561 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015564 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015566 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015569 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015571 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 07:24:50.016002 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015574 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015577 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015579 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015582 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015584 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015587 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015590 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015592 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015595 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015597 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015600 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015603 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015605 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015608 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015612 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015615 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015618 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015621 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015623 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015628 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 07:24:50.016541 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015632 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015635 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015638 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015641 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015643 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015646 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015649 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015652 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015655 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015658 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015661 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015664 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015668 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015671 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015674 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015678 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015681 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015683 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015686 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 07:24:50.017043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015690 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015694 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015697 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015699 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015702 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015705 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015707 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015711 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015714 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015716 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015719 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015722 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015724 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015727 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015730 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015732 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015735 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015738 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.015740 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 07:24:50.017503 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016455 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016462 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016465 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016468 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016471 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016474 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016476 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016479 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016482 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016484 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016487 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016490 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016492 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016495 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016497 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016500 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016503 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016505 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016510 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016514 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 07:24:50.017987 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016517 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016520 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016523 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016540 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016544 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016547 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016550 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016553 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016557 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016560 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016563 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016565 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016568 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016571 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016574 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016577 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016580 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016582 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016585 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016588 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 07:24:50.018485 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016591 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016593 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016596 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016599 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016601 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016604 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016607 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016610 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016613 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016617 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016621 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016624 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016627 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016630 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016633 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016636 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016639 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016642 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016645 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016647 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 07:24:50.019028 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016650 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016653 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016655 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016658 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016660 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016666 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016669 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016672 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016674 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016678 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016681 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016685 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016689 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016692 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016694 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016697 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016700 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016702 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 07:24:50.019813 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016704 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016707 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016710 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016712 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016715 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016717 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016720 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016723 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016726 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016729 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016731 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016734 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016737 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016740 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016742 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016745 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016747 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016750 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016752 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016757 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 07:24:50.020317 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.016759 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017179 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017194 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017198 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017201 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017204 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017207 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017210 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017213 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017216 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017219 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017222 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017225 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017229 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017232 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017235 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017238 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017241 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017245 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017248 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 07:24:50.020861 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017250 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017253 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017255 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017258 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017261 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017264 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017266 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017269 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017272 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017274 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017277 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017280 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017284 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017288 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017292 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017295 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017298 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017301 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017303 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 07:24:50.021345 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017306 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017309 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017312 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017314 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017317 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017320 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017322 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017325 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017328 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017331 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017333 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017336 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017338 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017341 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017343 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017346 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017348 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017351 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017353 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017356 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017358 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 07:24:50.021822 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017361 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017365 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017368 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017371 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017374 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017378 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017381 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017384 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017387 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017389 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017392 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017395 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017397 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017400 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017402 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017405 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017407 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017410 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017412 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017415 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 07:24:50.022354 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017418 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017420 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017423 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017425 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017428 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017431 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017437 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017440 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017443 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017446 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017448 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017451 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017453 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017456 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017459 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017461 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017464 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017467 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 07:24:50.022882 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017471 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.017475 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017569 2582 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017606 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017613 2582 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017618 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017623 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017626 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017631 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017638 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017641 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017644 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017648 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017651 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017655 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017658 2582 flags.go:64] FLAG: --cgroup-root="" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017661 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017664 2582 flags.go:64] FLAG: --client-ca-file="" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017666 2582 flags.go:64] FLAG: --cloud-provider="external" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017669 2582 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017673 2582 flags.go:64] FLAG: --cluster-domain="" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017676 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017680 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017683 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 07:24:50.023334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017686 2582 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017690 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017693 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017697 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017700 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017703 2582 flags.go:64] FLAG: --contention-profiling="false" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017706 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017709 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017712 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017716 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017720 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017724 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017727 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017730 2582 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017733 2582 flags.go:64] FLAG: --enable-server="true" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017736 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017740 2582 flags.go:64] FLAG: --event-burst="100" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017744 2582 flags.go:64] FLAG: --event-qps="50" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017746 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017750 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017753 2582 flags.go:64] FLAG: --eviction-hard="" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017756 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017759 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017762 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017765 2582 flags.go:64] FLAG: --eviction-soft="" Sep 15 07:24:50.024062 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017768 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017771 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017774 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017777 2582 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017780 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017782 2582 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017785 2582 flags.go:64] FLAG: --feature-gates="" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017789 2582 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017792 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017795 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017798 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017801 2582 flags.go:64] FLAG: --healthz-port="10248" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017804 2582 flags.go:64] FLAG: --help="false" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017806 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017810 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017813 2582 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017816 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017819 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017822 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017826 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017829 2582 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017831 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017834 2582 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 07:24:50.024683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017837 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017840 2582 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017843 2582 flags.go:64] FLAG: --kube-reserved="" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017845 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017848 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017851 2582 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017854 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017857 2582 flags.go:64] FLAG: --lock-file="" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017859 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017862 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017865 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017871 2582 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017873 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017879 2582 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017882 2582 flags.go:64] FLAG: --logging-format="text" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017885 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017888 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017891 2582 flags.go:64] FLAG: --manifest-url="" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017894 2582 flags.go:64] FLAG: --manifest-url-header="" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017898 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017901 2582 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017905 2582 flags.go:64] FLAG: --max-pods="110" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017908 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017911 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017914 2582 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 07:24:50.025271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017917 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017920 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017939 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017943 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017951 2582 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017955 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017958 2582 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017961 2582 flags.go:64] FLAG: --pod-cidr="" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017964 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017969 2582 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017972 2582 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017975 2582 flags.go:64] FLAG: --pods-per-core="0" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017978 2582 flags.go:64] FLAG: --port="10250" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017981 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017985 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-035a2a60bc47a6036" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017988 2582 flags.go:64] FLAG: --qos-reserved="" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017991 2582 flags.go:64] FLAG: --read-only-port="10255" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017994 2582 flags.go:64] FLAG: --register-node="true" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.017997 2582 flags.go:64] FLAG: --register-with-taints="" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018001 2582 flags.go:64] FLAG: --registry-burst="10" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018006 2582 flags.go:64] FLAG: --registry-qps="5" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018009 2582 flags.go:64] FLAG: --reserved-cpus="" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018012 2582 flags.go:64] FLAG: --reserved-memory="" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018016 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018019 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 07:24:50.025916 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018022 2582 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018025 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018028 2582 flags.go:64] FLAG: --runonce="false" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018031 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018034 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018037 2582 flags.go:64] FLAG: --seccomp-default="false" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018040 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018043 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018046 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018049 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018053 2582 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018056 2582 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018059 2582 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018062 2582 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018065 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018068 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018070 2582 flags.go:64] FLAG: --system-cgroups="" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018073 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018079 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018082 2582 flags.go:64] FLAG: --tls-cert-file="" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018085 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018088 2582 flags.go:64] FLAG: --tls-min-version="" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018091 2582 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018094 2582 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018096 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 07:24:50.026559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018099 2582 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018103 2582 flags.go:64] FLAG: --v="2" Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018108 2582 flags.go:64] FLAG: --version="false" Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018112 2582 flags.go:64] FLAG: --vmodule="" Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018116 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.018119 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019444 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019467 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019474 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019479 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019489 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019494 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019498 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019502 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019506 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019511 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019515 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019519 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019523 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019543 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019548 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 07:24:50.027222 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019553 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019557 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019566 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019570 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019574 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019578 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019582 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019586 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019590 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019594 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019598 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019602 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019606 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019611 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019620 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019624 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019628 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019632 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019638 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019642 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 07:24:50.027817 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019646 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019651 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019655 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019659 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019663 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019667 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019671 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019680 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019687 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019693 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019698 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019702 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019706 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019711 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019715 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019737 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019750 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019756 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019760 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 07:24:50.028305 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019769 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019774 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019816 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019823 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019830 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019835 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019842 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019847 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019852 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019857 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019862 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019866 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019871 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019882 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019893 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019907 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019915 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019920 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019924 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 07:24:50.028800 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019928 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.019937 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020029 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020033 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020037 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020039 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020042 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020045 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020047 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020050 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020057 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020060 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020063 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020065 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020068 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020071 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020075 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020079 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020082 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020085 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 07:24:50.029261 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020087 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020092 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020095 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020098 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020100 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.020103 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.020896 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.028716 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.028732 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.028746 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.028752 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028805 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028810 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028814 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 07:24:50.029776 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028817 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028820 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028823 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028826 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028828 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028831 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028834 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028838 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028840 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028843 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028846 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028849 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028851 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028854 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028857 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028859 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028862 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028865 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028867 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028870 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 07:24:50.030127 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028873 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028876 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028879 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028882 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028884 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028888 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028891 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028894 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028896 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028899 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028903 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028907 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028910 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028913 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028916 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028918 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028921 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028924 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028927 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028929 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 07:24:50.030657 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028932 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028935 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028937 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028941 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028945 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028948 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028950 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028953 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028956 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028959 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028961 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028964 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028967 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028969 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028972 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028975 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028977 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028980 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028983 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 07:24:50.031175 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028986 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028988 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028991 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028994 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028996 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.028999 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029002 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029004 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029007 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029010 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029012 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029015 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029017 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029020 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029023 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029025 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029027 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029030 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029033 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 07:24:50.031722 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029035 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029038 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029040 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029043 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029047 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029050 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029053 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029056 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029059 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029061 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029064 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029067 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029070 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029072 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029075 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029078 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029080 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 07:24:50.032172 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029083 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.029089 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029200 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029205 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029209 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029212 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029215 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029219 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029222 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029225 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029228 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029231 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029234 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029237 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 07:24:50.032599 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029239 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029242 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029244 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029247 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029250 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029252 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029255 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029257 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029260 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029263 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029266 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029268 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029271 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029274 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029277 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029280 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029282 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029285 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029287 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 07:24:50.032955 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029290 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029293 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029295 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029298 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029300 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029303 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029305 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029309 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029311 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029314 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029316 2582 feature_gate.go:328] unrecognized feature gate: Example Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029319 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029322 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029324 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029326 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029329 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029332 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029334 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029337 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029340 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 07:24:50.033415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029342 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029345 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029347 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029350 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029353 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029355 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029358 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029361 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029363 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029366 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029368 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029372 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029376 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029378 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029382 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029386 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029388 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029392 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029394 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 07:24:50.033913 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029397 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029400 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029404 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029406 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029409 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029411 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029414 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029416 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029419 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029422 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029425 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029427 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029430 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029432 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029435 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029438 2582 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029440 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029443 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029445 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029448 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 07:24:50.034370 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029451 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029454 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029457 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029459 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029462 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029465 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029468 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029470 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:50.029473 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.029477 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.029606 2582 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 07:24:50.034909 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.034701 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 07:24:50.035779 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.035768 2582 server.go:1019] "Starting client certificate rotation" Sep 15 07:24:50.035887 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.035869 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 07:24:50.035950 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.035921 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 07:24:50.038637 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.038620 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 07:24:50.039763 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.039739 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 07:24:50.055701 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.055683 2582 log.go:25] "Validated CRI v1 runtime API" Sep 15 07:24:50.059522 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.059506 2582 log.go:25] "Validated CRI v1 image API" Sep 15 07:24:50.060950 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.060926 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 07:24:50.066302 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.066284 2582 fs.go:135] Filesystem UUIDs: map[657c9cfa-2214-438f-ba22-dc7b1c08c65f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 af35f2e3-2d9e-4e06-ad34-7bbbd154a589:/dev/nvme0n1p4] Sep 15 07:24:50.066385 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.066301 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 07:24:50.071264 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.071150 2582 manager.go:216] Machine: {Timestamp:2026-09-15 07:24:50.069924655 +0000 UTC m=+0.382011263 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100337 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f2aa81bf2c4e0b600240ea47eb38 SystemUUID:ec26f2aa-81bf-2c4e-0b60-0240ea47eb38 BootID:2eaca4b5-549f-4a5f-8585-2e8e7c41ceef Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:f3:eb:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:f3:eb:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:1a:76:c3:9b:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 07:24:50.071264 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.071256 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 07:24:50.071420 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.071336 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 07:24:50.071946 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.071927 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 07:24:50.072607 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.072581 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 07:24:50.072766 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.072612 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 07:24:50.073548 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.073521 2582 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 07:24:50.073615 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.073556 2582 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 07:24:50.073615 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.073568 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 07:24:50.073615 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.073587 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 07:24:50.074868 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.074854 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 07:24:50.079555 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079541 2582 state_mem.go:36] "Initialized new in-memory state store" Sep 15 07:24:50.079691 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079680 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 07:24:50.079748 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079718 2582 kubelet.go:486] "Attempting to sync node with API server" Sep 15 07:24:50.079748 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079733 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 07:24:50.079748 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079748 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 07:24:50.079872 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079764 2582 kubelet.go:398] "Adding apiserver pod source" Sep 15 07:24:50.079872 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.079787 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 07:24:50.080153 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.080139 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 07:24:50.080224 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.080162 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 07:24:50.082394 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.082374 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 07:24:50.084574 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.084559 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 07:24:50.084624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.084598 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 07:24:50.086736 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086724 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086740 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086746 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086751 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086760 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086767 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086780 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 07:24:50.086784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086785 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 07:24:50.086981 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086792 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 07:24:50.086981 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086798 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 07:24:50.086981 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086812 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 07:24:50.086981 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.086818 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 07:24:50.087795 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.087783 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 07:24:50.087833 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.087798 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 07:24:50.091699 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.091680 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 07:24:50.091787 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.091700 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 07:24:50.091787 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.091720 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 07:24:50.091961 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.091948 2582 server.go:1268] "Started kubelet" Sep 15 07:24:50.092017 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.091994 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 07:24:50.092141 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.092103 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 07:24:50.092178 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.092166 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 07:24:50.093698 ip-10-0-139-67 systemd[1]: Started Kubernetes Kubelet. Sep 15 07:24:50.099235 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.099211 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 07:24:50.101029 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.099519 2582 server.go:310] "Adding debug handlers to kubelet server" Sep 15 07:24:50.101029 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.100413 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 07:24:50.103070 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.101949 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-67.ec2.internal.18d56dbe13bba75b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-67.ec2.internal,UID:ip-10-0-139-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-67.ec2.internal,},FirstTimestamp:2026-09-15 07:24:50.091919195 +0000 UTC m=+0.404005803,LastTimestamp:2026-09-15 07:24:50.091919195 +0000 UTC m=+0.404005803,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-67.ec2.internal,}" Sep 15 07:24:50.105096 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105075 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 07:24:50.105200 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105096 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 07:24:50.105255 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.105205 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.105921 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105897 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 07:24:50.105921 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105914 2582 factory.go:55] Registering systemd factory Sep 15 07:24:50.105921 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105923 2582 factory.go:223] Registration of the systemd container factory successfully Sep 15 07:24:50.106072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105927 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 07:24:50.106072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105927 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 07:24:50.106072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.105959 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 07:24:50.106072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106022 2582 reconstruct.go:97] "Volume reconstruction finished" Sep 15 07:24:50.106072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106031 2582 reconciler.go:29] "Reconciler: start to sync state" Sep 15 07:24:50.106294 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106154 2582 factory.go:153] Registering CRI-O factory Sep 15 07:24:50.106294 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106169 2582 factory.go:223] Registration of the crio container factory successfully Sep 15 07:24:50.106294 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106197 2582 factory.go:103] Registering Raw factory Sep 15 07:24:50.106294 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106237 2582 manager.go:1196] Started watching for new ooms in manager Sep 15 07:24:50.106616 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.106603 2582 manager.go:349] Starting recovery of all containers Sep 15 07:24:50.111609 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.111587 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 15 07:24:50.111707 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.111676 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 15 07:24:50.116301 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.116146 2582 manager.go:354] Recovery completed Sep 15 07:24:50.122496 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.122482 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.124070 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124049 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.124139 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124084 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.124139 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124098 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.124328 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124308 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g2kdd" Sep 15 07:24:50.124711 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124696 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 07:24:50.124711 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124704 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.124711 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124711 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 07:24:50.124888 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.124725 2582 state_mem.go:36] "Initialized new in-memory state store" Sep 15 07:24:50.125377 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.125359 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.125440 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.125390 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.125440 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.125404 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.126496 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.126407 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-67.ec2.internal.18d56dbe15a636ae default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-67.ec2.internal,UID:ip-10-0-139-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-67.ec2.internal,},FirstTimestamp:2026-09-15 07:24:50.124068526 +0000 UTC m=+0.436155134,LastTimestamp:2026-09-15 07:24:50.124068526 +0000 UTC m=+0.436155134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-67.ec2.internal,}" Sep 15 07:24:50.126878 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.126865 2582 policy_none.go:49] "None policy: Start" Sep 15 07:24:50.126949 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.126886 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 07:24:50.126949 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.126900 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 07:24:50.128885 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.128871 2582 policy_none.go:47] "Start" Sep 15 07:24:50.130503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.130483 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g2kdd" Sep 15 07:24:50.135208 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.135143 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-67.ec2.internal.18d56dbe15a68b53 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-67.ec2.internal,UID:ip-10-0-139-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-67.ec2.internal,},FirstTimestamp:2026-09-15 07:24:50.124090195 +0000 UTC m=+0.436176805,LastTimestamp:2026-09-15 07:24:50.124090195 +0000 UTC m=+0.436176805,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-67.ec2.internal,}" Sep 15 07:24:50.160135 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.160118 2582 manager.go:337] "Starting Device Plugin manager" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.160165 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.160179 2582 server.go:87] "Starting device plugin registration server" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.160705 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.160725 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.161029 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.161110 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.161128 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.163811 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.163886 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.170659 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.171747 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.171797 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.171816 2582 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.171903 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 07:24:50.181617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.174094 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 07:24:50.260974 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.260873 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.261957 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.261940 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.262056 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.261971 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.262056 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.261981 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.262056 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.262008 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.271741 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.271725 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.271814 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.271750 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-67.ec2.internal\": node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.272952 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.272927 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal"] Sep 15 07:24:50.273007 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.272998 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.274494 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.274473 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.274617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.274502 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.274617 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.274512 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.276853 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.276838 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.276952 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.276940 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.276999 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.276971 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.277543 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.277515 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.277642 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.277554 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.277642 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.277564 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.277642 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.277580 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.277642 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.277603 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.277642 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.277617 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.279959 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.279939 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.280051 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.279979 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:50.280746 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.280730 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:50.280847 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.280755 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:50.280847 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.280767 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:50.299651 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.299631 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.303298 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.303280 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-67.ec2.internal\" not found" node="ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.307584 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.307566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c11dc1bc1d357127868a041cc6f1d45b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"c11dc1bc1d357127868a041cc6f1d45b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.307658 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.307591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0416777f4ade93d73bec1fcbd4b5ca9b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-67.ec2.internal\" (UID: \"0416777f4ade93d73bec1fcbd4b5ca9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.307658 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.307599 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-67.ec2.internal\" not found" node="ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.307658 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.307607 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c11dc1bc1d357127868a041cc6f1d45b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"c11dc1bc1d357127868a041cc6f1d45b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.400524 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.400493 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.407884 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.407866 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c11dc1bc1d357127868a041cc6f1d45b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"c11dc1bc1d357127868a041cc6f1d45b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.407941 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.407901 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c11dc1bc1d357127868a041cc6f1d45b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"c11dc1bc1d357127868a041cc6f1d45b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.407974 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.407936 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c11dc1bc1d357127868a041cc6f1d45b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"c11dc1bc1d357127868a041cc6f1d45b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.407974 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.407959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0416777f4ade93d73bec1fcbd4b5ca9b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-67.ec2.internal\" (UID: \"0416777f4ade93d73bec1fcbd4b5ca9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.408041 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.407989 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0416777f4ade93d73bec1fcbd4b5ca9b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-67.ec2.internal\" (UID: \"0416777f4ade93d73bec1fcbd4b5ca9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.408041 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.408023 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c11dc1bc1d357127868a041cc6f1d45b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal\" (UID: \"c11dc1bc1d357127868a041cc6f1d45b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.501045 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.501002 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.601800 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.601737 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.606992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.606976 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.612340 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:50.612323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Sep 15 07:24:50.702692 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.702654 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.803295 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.803270 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:50.904881 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:50.904845 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.008342 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:51.008291 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.035964 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.035929 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 07:24:51.036418 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.036097 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 07:24:51.108855 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:51.108828 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.110029 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.110004 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 07:24:51.136904 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.136867 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 07:19:50 +0000 UTC" deadline="2028-06-19 14:41:44.009513482 +0000 UTC" Sep 15 07:24:51.136904 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.136898 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15439h16m52.872618743s" Sep 15 07:24:51.209026 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:51.208950 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.247768 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.247734 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 07:24:51.255454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.255420 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 07:24:51.256569 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.256553 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientMemory" Sep 15 07:24:51.256685 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.256584 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 07:24:51.256685 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.256594 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeHasSufficientPID" Sep 15 07:24:51.275728 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:51.275689 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0416777f4ade93d73bec1fcbd4b5ca9b.slice/crio-1bdb01d01bed9d8c695ffe89fe6e26fe3778ac744fda400b2102ef6413f21d8d WatchSource:0}: Error finding container 1bdb01d01bed9d8c695ffe89fe6e26fe3778ac744fda400b2102ef6413f21d8d: Status 404 returned error can't find the container with id 1bdb01d01bed9d8c695ffe89fe6e26fe3778ac744fda400b2102ef6413f21d8d Sep 15 07:24:51.279175 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.279159 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 07:24:51.309184 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:51.309154 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.410982 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:51.410943 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.512081 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:51.511999 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-67.ec2.internal\" not found" Sep 15 07:24:51.607297 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.607262 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 07:24:51.711503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.711446 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" Sep 15 07:24:51.723111 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.723084 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 07:24:51.724370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.724354 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" Sep 15 07:24:51.740583 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.740563 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 07:24:51.923316 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:51.923289 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 07:24:52.080269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.080232 2582 apiserver.go:52] "Watching apiserver" Sep 15 07:24:52.087858 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.087829 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 07:24:52.089293 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.089264 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal","openshift-multus/multus-lwwwm","openshift-multus/network-metrics-daemon-m2m5h","openshift-ovn-kubernetes/ovnkube-node-zjk5k","kube-system/global-pull-secret-syncer-nknkw","kube-system/konnectivity-agent-tsj97","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv","openshift-cluster-node-tuning-operator/tuned-zgxs9","openshift-dns/node-resolver-hxspg","openshift-multus/multus-additional-cni-plugins-jrjjc","openshift-network-diagnostics/network-check-target-xq7k7","openshift-network-operator/iptables-alerter-m57gx","kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal","openshift-image-registry/node-ca-cbtnf"] Sep 15 07:24:52.092043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.092018 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.094434 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.094414 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.095500 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.095287 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.095500 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.095338 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 07:24:52.095500 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.095392 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.095500 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.095293 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 07:24:52.095768 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.095562 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 07:24:52.097008 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.096980 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2x725\"" Sep 15 07:24:52.097216 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.097193 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:52.097508 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.097466 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:24:52.099502 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.098652 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.099502 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.098727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.099502 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.099029 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zkkwx\"" Sep 15 07:24:52.101486 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.101464 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.104011 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.103988 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.104302 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.103996 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 07:24:52.105106 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.105088 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bn44g\"" Sep 15 07:24:52.105558 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.105532 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 07:24:52.106382 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.106362 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.106479 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.106444 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:24:52.107158 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.106937 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.107158 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.107010 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.107158 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.107090 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zvsds\"" Sep 15 07:24:52.107310 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.107219 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 07:24:52.108907 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.108887 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.111510 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.111492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.112277 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.112257 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 07:24:52.112374 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.112350 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ls7zq\"" Sep 15 07:24:52.112472 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.112456 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 07:24:52.114100 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.114079 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.114194 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.114172 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:24:52.115309 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115288 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 07:24:52.115461 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115326 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 07:24:52.115461 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115338 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.115461 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115409 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.115643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115469 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 07:24:52.115643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115327 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-85b4z\"" Sep 15 07:24:52.115822 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.115806 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 07:24:52.116830 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-cnibin\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.116936 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116845 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-system-cni-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.116936 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-cni-multus\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.116936 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116901 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-socket-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.116936 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e419fef2-f661-402e-995e-284a565c061f-dbus\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.117088 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116953 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.117088 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.116982 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.117088 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/978eb2dd-421d-48f8-bd57-0796552681c6-hosts-file\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.117088 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-conf-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117088 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-multus-certs\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117102 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117126 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-cnibin\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117164 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-cni-bin\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-daemon-config\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117215 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978eb2dd-421d-48f8-bd57-0796552681c6-tmp-dir\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117240 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4k8v\" (UniqueName: \"kubernetes.io/projected/978eb2dd-421d-48f8-bd57-0796552681c6-kube-api-access-r4k8v\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117263 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-cni-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117295 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-netns\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-hostroot\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117362 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f27tn\" (UniqueName: \"kubernetes.io/projected/84fb872a-2638-4a08-acc0-ffcd38d64979-kube-api-access-f27tn\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dsqh\" (UniqueName: \"kubernetes.io/projected/22e7418c-dd5c-4380-9847-b675ff57f53a-kube-api-access-5dsqh\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-socket-dir-parent\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-etc-selinux\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-sys-fs\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9v6t\" (UniqueName: \"kubernetes.io/projected/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-kube-api-access-w9v6t\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e419fef2-f661-402e-995e-284a565c061f-kubelet-config\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-system-cni-dir\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84fb872a-2638-4a08-acc0-ffcd38d64979-cni-binary-copy\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117712 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-k8s-cni-cncf-io\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-kubelet\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117823 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-etc-kubernetes\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.117882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117874 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-registration-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.118696 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117902 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-device-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.118696 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.118696 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117963 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.118696 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.117992 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:52.119459 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.119440 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.121960 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.121931 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.122074 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.122030 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.122139 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.122119 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 07:24:52.124602 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.124562 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 07:24:52.125396 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.125292 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.125396 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.125327 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.125679 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.125659 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.126023 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.126002 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-79mhx\"" Sep 15 07:24:52.127038 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.127018 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v24rt\"" Sep 15 07:24:52.127227 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.127208 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 07:24:52.128089 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.128068 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6j7t\"" Sep 15 07:24:52.128242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.128219 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 07:24:52.128511 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.128492 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 07:24:52.146659 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.145465 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-khww7" Sep 15 07:24:52.156478 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.156453 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-khww7" Sep 15 07:24:52.176811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.176719 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" event={"ID":"0416777f4ade93d73bec1fcbd4b5ca9b","Type":"ContainerStarted","Data":"1bdb01d01bed9d8c695ffe89fe6e26fe3778ac744fda400b2102ef6413f21d8d"} Sep 15 07:24:52.207476 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.207441 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 07:24:52.218656 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218669 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218698 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovn-node-metrics-cert\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmbqt\" (UniqueName: \"kubernetes.io/projected/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-kube-api-access-dmbqt\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-system-cni-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218787 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysctl-d\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-run\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-tuned\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.218850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f019d3d-0435-4d08-8161-d3bd5dc437f7-tmp\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-host\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-system-cni-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218957 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.218999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/978eb2dd-421d-48f8-bd57-0796552681c6-hosts-file\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-env-overrides\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219064 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovnkube-script-lib\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219089 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-conf-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219136 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-conf-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/978eb2dd-421d-48f8-bd57-0796552681c6-hosts-file\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219190 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-multus-certs\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-multus-certs\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219242 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-kubelet\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-var-lib-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-kubernetes\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219315 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-cnibin\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219342 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-log-socket\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219350 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-cni-binary-copy\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-cni-netd\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6efa5091-b46e-47cd-8a5d-9a52420398c4-host-slash\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-slash\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-etc-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219476 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-cnibin\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219512 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978eb2dd-421d-48f8-bd57-0796552681c6-tmp-dir\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4k8v\" (UniqueName: \"kubernetes.io/projected/978eb2dd-421d-48f8-bd57-0796552681c6-kube-api-access-r4k8v\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219590 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-cni-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-host\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219616 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219643 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dsqh\" (UniqueName: \"kubernetes.io/projected/22e7418c-dd5c-4380-9847-b675ff57f53a-kube-api-access-5dsqh\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.219814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219687 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-socket-dir-parent\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219696 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-cni-dir\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219762 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-socket-dir-parent\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e419fef2-f661-402e-995e-284a565c061f-kubelet-config\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219803 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfnc\" (UniqueName: \"kubernetes.io/projected/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-kube-api-access-5pfnc\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e419fef2-f661-402e-995e-284a565c061f-kubelet-config\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978eb2dd-421d-48f8-bd57-0796552681c6-tmp-dir\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-modprobe-d\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td2ns\" (UniqueName: \"kubernetes.io/projected/8f019d3d-0435-4d08-8161-d3bd5dc437f7-kube-api-access-td2ns\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.219984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhkj\" (UniqueName: \"kubernetes.io/projected/5d209bf2-2892-4cac-8930-be58fc4fef6e-kube-api-access-jvhkj\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220015 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-system-cni-dir\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220042 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-etc-kubernetes\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-system-cni-dir\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220095 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-etc-kubernetes\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220109 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-registration-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-device-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-run-netns\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.220688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220224 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-systemd\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220171 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-registration-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220264 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-device-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220374 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-node-log\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220402 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-cnibin\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-cni-multus\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-socket-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220483 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e419fef2-f661-402e-995e-284a565c061f-dbus\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220485 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-cnibin\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220515 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220590 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e419fef2-f661-402e-995e-284a565c061f-dbus\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysconfig\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.220631 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220649 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.221527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220677 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-socket-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.220719 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:24:52.720681313 +0000 UTC m=+3.032767924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-serviceca\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220718 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-cni-multus\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17f9cd36-7b93-4b1b-ad11-0c668bb49d78-agent-certs\") pod \"konnectivity-agent-tsj97\" (UID: \"17f9cd36-7b93-4b1b-ad11-0c668bb49d78\") " pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220789 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22e7418c-dd5c-4380-9847-b675ff57f53a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-ovn\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220875 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-cni-bin\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-systemd-units\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220949 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysctl-conf\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220976 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-etc-selinux\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-daemon-config\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.220977 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-cni-bin\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221026 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22e7418c-dd5c-4380-9847-b675ff57f53a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221028 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-netns\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221073 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-netns\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221094 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-etc-selinux\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221074 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-hostroot\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221131 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-hostroot\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221134 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f27tn\" (UniqueName: \"kubernetes.io/projected/84fb872a-2638-4a08-acc0-ffcd38d64979-kube-api-access-f27tn\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221169 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221207 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6efa5091-b46e-47cd-8a5d-9a52420398c4-iptables-alerter-script\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221235 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-sys\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221261 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-sys-fs\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9v6t\" (UniqueName: \"kubernetes.io/projected/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-kube-api-access-w9v6t\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221328 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-sys-fs\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovnkube-config\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltf5c\" (UniqueName: \"kubernetes.io/projected/6efa5091-b46e-47cd-8a5d-9a52420398c4-kube-api-access-ltf5c\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-lib-modules\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221524 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-var-lib-kubelet\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.222963 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221562 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84fb872a-2638-4a08-acc0-ffcd38d64979-cni-binary-copy\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-k8s-cni-cncf-io\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-kubelet\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17f9cd36-7b93-4b1b-ad11-0c668bb49d78-konnectivity-ca\") pod \"konnectivity-agent-tsj97\" (UID: \"17f9cd36-7b93-4b1b-ad11-0c668bb49d78\") " pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221670 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-cni-bin\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221687 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-var-lib-kubelet\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221697 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-systemd\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221667 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84fb872a-2638-4a08-acc0-ffcd38d64979-host-run-k8s-cni-cncf-io\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.221672 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84fb872a-2638-4a08-acc0-ffcd38d64979-multus-daemon-config\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.223546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.222161 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84fb872a-2638-4a08-acc0-ffcd38d64979-cni-binary-copy\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.228334 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.228307 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:24:52.228334 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.228334 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:24:52.228487 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.228346 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:52.228487 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.228400 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:24:52.728387527 +0000 UTC m=+3.040474127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:52.229497 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.229455 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 07:24:52.234140 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.233890 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dsqh\" (UniqueName: \"kubernetes.io/projected/22e7418c-dd5c-4380-9847-b675ff57f53a-kube-api-access-5dsqh\") pod \"multus-additional-cni-plugins-jrjjc\" (UID: \"22e7418c-dd5c-4380-9847-b675ff57f53a\") " pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.234140 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.233942 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9v6t\" (UniqueName: \"kubernetes.io/projected/a7ada9b7-90b8-4c79-ac4c-d3488ee50af7-kube-api-access-w9v6t\") pod \"aws-ebs-csi-driver-node-f6pzv\" (UID: \"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.234140 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.233952 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f27tn\" (UniqueName: \"kubernetes.io/projected/84fb872a-2638-4a08-acc0-ffcd38d64979-kube-api-access-f27tn\") pod \"multus-lwwwm\" (UID: \"84fb872a-2638-4a08-acc0-ffcd38d64979\") " pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.234140 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.234054 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4k8v\" (UniqueName: \"kubernetes.io/projected/978eb2dd-421d-48f8-bd57-0796552681c6-kube-api-access-r4k8v\") pod \"node-resolver-hxspg\" (UID: \"978eb2dd-421d-48f8-bd57-0796552681c6\") " pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.322015 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.321981 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfnc\" (UniqueName: \"kubernetes.io/projected/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-kube-api-access-5pfnc\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322015 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322017 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-modprobe-d\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.322269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322046 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td2ns\" (UniqueName: \"kubernetes.io/projected/8f019d3d-0435-4d08-8161-d3bd5dc437f7-kube-api-access-td2ns\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.322269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhkj\" (UniqueName: \"kubernetes.io/projected/5d209bf2-2892-4cac-8930-be58fc4fef6e-kube-api-access-jvhkj\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.322269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322240 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-modprobe-d\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.322269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-run-netns\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322287 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-systemd\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322379 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-node-log\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322418 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-run-netns\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322434 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysconfig\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322461 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-node-log\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.322489 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-systemd\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322484 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysconfig\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322511 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-serviceca\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17f9cd36-7b93-4b1b-ad11-0c668bb49d78-agent-certs\") pod \"konnectivity-agent-tsj97\" (UID: \"17f9cd36-7b93-4b1b-ad11-0c668bb49d78\") " pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322563 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-ovn\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-systemd-units\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322651 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-ovn\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322652 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-systemd-units\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.322579 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.322828 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:24:52.822787233 +0000 UTC m=+3.134874068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:52.323013 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.322447 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysctl-conf\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323159 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-serviceca\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6efa5091-b46e-47cd-8a5d-9a52420398c4-iptables-alerter-script\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323237 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-sys\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovnkube-config\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323316 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysctl-conf\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323323 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltf5c\" (UniqueName: \"kubernetes.io/projected/6efa5091-b46e-47cd-8a5d-9a52420398c4-kube-api-access-ltf5c\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323358 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-lib-modules\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323385 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-var-lib-kubelet\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17f9cd36-7b93-4b1b-ad11-0c668bb49d78-konnectivity-ca\") pod \"konnectivity-agent-tsj97\" (UID: \"17f9cd36-7b93-4b1b-ad11-0c668bb49d78\") " pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323447 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-cni-bin\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.323516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-systemd\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323561 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovn-node-metrics-cert\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323553 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-lib-modules\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323591 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmbqt\" (UniqueName: \"kubernetes.io/projected/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-kube-api-access-dmbqt\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysctl-d\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323666 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-run\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323670 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-run-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-tuned\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323716 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f019d3d-0435-4d08-8161-d3bd5dc437f7-tmp\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323731 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-sys\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-host\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323752 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323797 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-cni-bin\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323869 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-systemd\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323924 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-var-lib-kubelet\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.323978 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-run\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.324241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324096 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-sysctl-d\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-env-overrides\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324491 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovnkube-script-lib\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-kubelet\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324569 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-var-lib-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-kubernetes\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-log-socket\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-cni-netd\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324698 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6efa5091-b46e-47cd-8a5d-9a52420398c4-host-slash\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324729 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-slash\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-etc-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324827 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovnkube-config\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-host\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.325003 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.324913 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-host\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.325624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6efa5091-b46e-47cd-8a5d-9a52420398c4-iptables-alerter-script\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.325624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/17f9cd36-7b93-4b1b-ad11-0c668bb49d78-konnectivity-ca\") pod \"konnectivity-agent-tsj97\" (UID: \"17f9cd36-7b93-4b1b-ad11-0c668bb49d78\") " pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.325624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325327 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-env-overrides\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325499 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-host\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.325624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325574 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-var-lib-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325894 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325689 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-kubelet\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.325955 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.325937 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovnkube-script-lib\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.326033 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-etc-openvswitch\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.326095 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-slash\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.326153 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326128 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6efa5091-b46e-47cd-8a5d-9a52420398c4-host-slash\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.326213 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326186 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-host-cni-netd\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.326269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326251 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-kubernetes\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.326333 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-log-socket\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.329107 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.326933 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-ovn-node-metrics-cert\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.329107 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.328169 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f019d3d-0435-4d08-8161-d3bd5dc437f7-etc-tuned\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.329307 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.329202 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/17f9cd36-7b93-4b1b-ad11-0c668bb49d78-agent-certs\") pod \"konnectivity-agent-tsj97\" (UID: \"17f9cd36-7b93-4b1b-ad11-0c668bb49d78\") " pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.330022 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.329997 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f019d3d-0435-4d08-8161-d3bd5dc437f7-tmp\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.333700 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.333673 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmbqt\" (UniqueName: \"kubernetes.io/projected/810e9712-e1cf-4c1f-872c-c2e8a75c5a7e-kube-api-access-dmbqt\") pod \"node-ca-cbtnf\" (UID: \"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e\") " pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.333822 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.333680 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td2ns\" (UniqueName: \"kubernetes.io/projected/8f019d3d-0435-4d08-8161-d3bd5dc437f7-kube-api-access-td2ns\") pod \"tuned-zgxs9\" (UID: \"8f019d3d-0435-4d08-8161-d3bd5dc437f7\") " pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.334029 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.334010 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltf5c\" (UniqueName: \"kubernetes.io/projected/6efa5091-b46e-47cd-8a5d-9a52420398c4-kube-api-access-ltf5c\") pod \"iptables-alerter-m57gx\" (UID: \"6efa5091-b46e-47cd-8a5d-9a52420398c4\") " pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.334313 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.334290 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhkj\" (UniqueName: \"kubernetes.io/projected/5d209bf2-2892-4cac-8930-be58fc4fef6e-kube-api-access-jvhkj\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.334394 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.334376 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfnc\" (UniqueName: \"kubernetes.io/projected/bfa0ff87-e79c-4363-81dc-8ad6a48304a5-kube-api-access-5pfnc\") pod \"ovnkube-node-zjk5k\" (UID: \"bfa0ff87-e79c-4363-81dc-8ad6a48304a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.406707 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.406665 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" Sep 15 07:24:52.413629 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.413607 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hxspg" Sep 15 07:24:52.423424 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.423403 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lwwwm" Sep 15 07:24:52.429304 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.429253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" Sep 15 07:24:52.435612 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.435592 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cbtnf" Sep 15 07:24:52.442527 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.442506 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:24:52.450435 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.450414 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:24:52.457246 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.457217 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m57gx" Sep 15 07:24:52.460974 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.460952 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" Sep 15 07:24:52.727779 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.727676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:52.727948 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.727805 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:52.727948 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.727866 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:24:53.727847213 +0000 UTC m=+4.039933810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:52.828449 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.828409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:52.828674 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:52.828480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:52.828674 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.828632 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:24:52.828674 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.828680 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:24:52.828856 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.828695 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:52.828856 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.828650 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:52.828856 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.828759 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:24:53.828738578 +0000 UTC m=+4.140825198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:52.828856 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:52.828844 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:24:53.828822302 +0000 UTC m=+4.140908902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:52.921048 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.921019 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efa5091_b46e_47cd_8a5d_9a52420398c4.slice/crio-446ca542c8b1e45d34e7cd4f606f78d0388285e83699b0e030ec6d2f67d95b98 WatchSource:0}: Error finding container 446ca542c8b1e45d34e7cd4f606f78d0388285e83699b0e030ec6d2f67d95b98: Status 404 returned error can't find the container with id 446ca542c8b1e45d34e7cd4f606f78d0388285e83699b0e030ec6d2f67d95b98 Sep 15 07:24:52.921821 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.921788 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f019d3d_0435_4d08_8161_d3bd5dc437f7.slice/crio-b70ffb56d81486c54332b7bd452d61d77825199a61ff467a08e87bdde410f37e WatchSource:0}: Error finding container b70ffb56d81486c54332b7bd452d61d77825199a61ff467a08e87bdde410f37e: Status 404 returned error can't find the container with id b70ffb56d81486c54332b7bd452d61d77825199a61ff467a08e87bdde410f37e Sep 15 07:24:52.923250 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.923228 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fb872a_2638_4a08_acc0_ffcd38d64979.slice/crio-d0382150c81211143fa8a55e02470fe840569744dfee21259f8b5d6a42deb8a7 WatchSource:0}: Error finding container d0382150c81211143fa8a55e02470fe840569744dfee21259f8b5d6a42deb8a7: Status 404 returned error can't find the container with id d0382150c81211143fa8a55e02470fe840569744dfee21259f8b5d6a42deb8a7 Sep 15 07:24:52.927588 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.927562 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ada9b7_90b8_4c79_ac4c_d3488ee50af7.slice/crio-2da9f39a0fe88014ea740af3e4d6787db47795ad378b6ba109218799de91c809 WatchSource:0}: Error finding container 2da9f39a0fe88014ea740af3e4d6787db47795ad378b6ba109218799de91c809: Status 404 returned error can't find the container with id 2da9f39a0fe88014ea740af3e4d6787db47795ad378b6ba109218799de91c809 Sep 15 07:24:52.929653 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.929571 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e7418c_dd5c_4380_9847_b675ff57f53a.slice/crio-1d9858f67c2c12342d104b3e490245f4bf352ec80f479d8676ca5efa108e1b33 WatchSource:0}: Error finding container 1d9858f67c2c12342d104b3e490245f4bf352ec80f479d8676ca5efa108e1b33: Status 404 returned error can't find the container with id 1d9858f67c2c12342d104b3e490245f4bf352ec80f479d8676ca5efa108e1b33 Sep 15 07:24:52.929860 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.929843 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978eb2dd_421d_48f8_bd57_0796552681c6.slice/crio-6a2b5d714bddd3c48e9ae8dec7cada309cdeae3a2d3f3cd1b38e60b55d397d42 WatchSource:0}: Error finding container 6a2b5d714bddd3c48e9ae8dec7cada309cdeae3a2d3f3cd1b38e60b55d397d42: Status 404 returned error can't find the container with id 6a2b5d714bddd3c48e9ae8dec7cada309cdeae3a2d3f3cd1b38e60b55d397d42 Sep 15 07:24:52.931065 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.931041 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f9cd36_7b93_4b1b_ad11_0c668bb49d78.slice/crio-a257d86a72cdb5a5ff5f1ee62a00817358c1678e4633520979f719728b998a88 WatchSource:0}: Error finding container a257d86a72cdb5a5ff5f1ee62a00817358c1678e4633520979f719728b998a88: Status 404 returned error can't find the container with id a257d86a72cdb5a5ff5f1ee62a00817358c1678e4633520979f719728b998a88 Sep 15 07:24:52.932373 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.932222 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810e9712_e1cf_4c1f_872c_c2e8a75c5a7e.slice/crio-60af06b88b89d7473a4f5863e57ffcd13adc2c8889377e596bbda4dcbf0bb20b WatchSource:0}: Error finding container 60af06b88b89d7473a4f5863e57ffcd13adc2c8889377e596bbda4dcbf0bb20b: Status 404 returned error can't find the container with id 60af06b88b89d7473a4f5863e57ffcd13adc2c8889377e596bbda4dcbf0bb20b Sep 15 07:24:52.956032 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:52.956003 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa0ff87_e79c_4363_81dc_8ad6a48304a5.slice/crio-48c8b4815e879e01d8a20db4e5b20a69596c1dd42cc4a328a92e994458bc9e94 WatchSource:0}: Error finding container 48c8b4815e879e01d8a20db4e5b20a69596c1dd42cc4a328a92e994458bc9e94: Status 404 returned error can't find the container with id 48c8b4815e879e01d8a20db4e5b20a69596c1dd42cc4a328a92e994458bc9e94 Sep 15 07:24:53.159804 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.159760 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 07:19:52 +0000 UTC" deadline="2028-06-21 01:11:39.041734054 +0000 UTC" Sep 15 07:24:53.159804 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.159812 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15473h46m45.881937665s" Sep 15 07:24:53.179492 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.179459 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lwwwm" event={"ID":"84fb872a-2638-4a08-acc0-ffcd38d64979","Type":"ContainerStarted","Data":"d0382150c81211143fa8a55e02470fe840569744dfee21259f8b5d6a42deb8a7"} Sep 15 07:24:53.180610 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.180591 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"48c8b4815e879e01d8a20db4e5b20a69596c1dd42cc4a328a92e994458bc9e94"} Sep 15 07:24:53.181634 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.181614 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hxspg" event={"ID":"978eb2dd-421d-48f8-bd57-0796552681c6","Type":"ContainerStarted","Data":"6a2b5d714bddd3c48e9ae8dec7cada309cdeae3a2d3f3cd1b38e60b55d397d42"} Sep 15 07:24:53.182702 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.182683 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerStarted","Data":"1d9858f67c2c12342d104b3e490245f4bf352ec80f479d8676ca5efa108e1b33"} Sep 15 07:24:53.183707 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.183689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" event={"ID":"8f019d3d-0435-4d08-8161-d3bd5dc437f7","Type":"ContainerStarted","Data":"b70ffb56d81486c54332b7bd452d61d77825199a61ff467a08e87bdde410f37e"} Sep 15 07:24:53.184792 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.184774 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m57gx" event={"ID":"6efa5091-b46e-47cd-8a5d-9a52420398c4","Type":"ContainerStarted","Data":"446ca542c8b1e45d34e7cd4f606f78d0388285e83699b0e030ec6d2f67d95b98"} Sep 15 07:24:53.186814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.186792 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" event={"ID":"0416777f4ade93d73bec1fcbd4b5ca9b","Type":"ContainerStarted","Data":"0e56647c68d00e6e89737700fed0117cb4fbd40cfb8d2a273c1110e816ffae31"} Sep 15 07:24:53.187932 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.187913 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cbtnf" event={"ID":"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e","Type":"ContainerStarted","Data":"60af06b88b89d7473a4f5863e57ffcd13adc2c8889377e596bbda4dcbf0bb20b"} Sep 15 07:24:53.189006 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.188984 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsj97" event={"ID":"17f9cd36-7b93-4b1b-ad11-0c668bb49d78","Type":"ContainerStarted","Data":"a257d86a72cdb5a5ff5f1ee62a00817358c1678e4633520979f719728b998a88"} Sep 15 07:24:53.190163 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.190142 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" event={"ID":"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7","Type":"ContainerStarted","Data":"2da9f39a0fe88014ea740af3e4d6787db47795ad378b6ba109218799de91c809"} Sep 15 07:24:53.205560 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.205506 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-67.ec2.internal" podStartSLOduration=1.205492669 podStartE2EDuration="1.205492669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:24:53.205147639 +0000 UTC m=+3.517234261" watchObservedRunningTime="2026-09-15 07:24:53.205492669 +0000 UTC m=+3.517579286" Sep 15 07:24:53.737222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.736621 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:53.737222 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.736779 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:53.737222 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.736850 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:24:55.736828869 +0000 UTC m=+6.048915468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:53.838001 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.837959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:53.838179 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:53.838027 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:53.838179 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.838173 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:53.838306 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.838243 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:24:55.838221065 +0000 UTC m=+6.150307687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:53.838758 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.838736 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:24:53.838758 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.838763 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:24:53.838916 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.838793 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:53.838916 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:53.838839 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:24:55.838823872 +0000 UTC m=+6.150910475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:53.948729 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:24:53.948682 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11dc1bc1d357127868a041cc6f1d45b.slice/crio-07554d7c0aa5d322843115194614861e3e5b5605ccdd5440b2b5719ea9185a85 WatchSource:0}: Error finding container 07554d7c0aa5d322843115194614861e3e5b5605ccdd5440b2b5719ea9185a85: Status 404 returned error can't find the container with id 07554d7c0aa5d322843115194614861e3e5b5605ccdd5440b2b5719ea9185a85 Sep 15 07:24:54.160782 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:54.160714 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 07:19:52 +0000 UTC" deadline="2028-02-18 22:42:12.365980344 +0000 UTC" Sep 15 07:24:54.160782 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:54.160782 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12519h17m18.205203621s" Sep 15 07:24:54.173080 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:54.173040 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:54.173218 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:54.173187 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:24:54.173674 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:54.173655 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:54.173794 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:54.173773 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:24:54.173844 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:54.173831 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:54.173948 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:54.173911 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:24:54.197118 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:54.197082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" event={"ID":"c11dc1bc1d357127868a041cc6f1d45b","Type":"ContainerStarted","Data":"07554d7c0aa5d322843115194614861e3e5b5605ccdd5440b2b5719ea9185a85"} Sep 15 07:24:55.755649 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:55.755611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:55.756256 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.755786 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:55.756256 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.755851 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:24:59.755831423 +0000 UTC m=+10.067918040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:55.856615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:55.856705 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.856842 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.856873 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.856880 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.856889 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.856946 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:24:59.856926167 +0000 UTC m=+10.169012771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:55.857384 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:55.856967 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:24:59.856956188 +0000 UTC m=+10.169042786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:56.173743 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:56.173710 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:56.173939 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:56.173849 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:24:56.174254 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:56.174236 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:56.174367 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:56.174339 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:24:56.174435 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:56.174400 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:56.174509 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:56.174490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:24:58.172323 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:58.172274 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:58.172864 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:58.172421 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:24:58.172864 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:58.172625 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:58.172864 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:58.172793 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:24:58.172864 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:58.172856 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:58.173101 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:58.172942 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:24:59.789298 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:59.789256 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:24:59.789756 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.789437 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:59.789756 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.789508 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:25:07.789488023 +0000 UTC m=+18.101574631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:24:59.889932 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:59.889892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:24:59.890098 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:24:59.889955 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:24:59.890098 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.890082 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:59.890214 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.890145 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:07.890126238 +0000 UTC m=+18.202212840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:24:59.890280 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.890234 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:24:59.890280 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.890251 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:24:59.890280 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.890263 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:24:59.890424 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:24:59.890298 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:07.890287635 +0000 UTC m=+18.202374233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:25:00.172805 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:00.172773 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:00.172975 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:00.172874 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:00.172975 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:00.172884 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:00.173087 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:00.172991 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:00.173087 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:00.173063 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:00.173189 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:00.173155 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:02.173101 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:02.173068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:02.173661 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:02.173068 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:02.173661 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:02.173192 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:02.173661 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:02.173211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:02.173661 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:02.173327 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:02.173661 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:02.173413 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:04.172546 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:04.172492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:04.173004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:04.172566 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:04.173004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:04.172506 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:04.173004 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:04.172643 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:04.173004 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:04.172715 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:04.173004 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:04.172786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:06.172142 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:06.172107 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:06.172142 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:06.172145 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:06.172691 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:06.172108 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:06.172691 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:06.172242 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:06.172691 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:06.172321 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:06.172691 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:06.172406 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:07.843841 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:07.843803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:07.844275 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.843944 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:25:07.844275 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.844006 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:25:23.843990881 +0000 UTC m=+34.156077490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:25:07.944792 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:07.944753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:07.944966 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:07.944806 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:07.944966 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.944932 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:25:07.944966 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.944938 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:25:07.944966 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.944963 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:25:07.945771 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.944977 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:25:07.945771 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.944997 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:23.944982434 +0000 UTC m=+34.257069029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:25:07.945771 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:07.945018 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:23.94500717 +0000 UTC m=+34.257093769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:25:08.172820 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:08.172789 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:08.173012 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:08.172835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:08.173012 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:08.172932 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:08.173122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:08.173012 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:08.173122 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:08.173094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:08.173223 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:08.173173 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:10.173992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:10.173548 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:10.173992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:10.173637 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:10.173992 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:10.173657 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:10.173992 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:10.173706 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:10.173992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:10.173745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:10.173992 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:10.173816 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:12.172477 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.172135 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:12.173147 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.172137 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:12.173147 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:12.172588 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:12.173147 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.172135 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:12.173147 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:12.172671 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:12.173147 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:12.172751 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:12.236177 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.236141 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e7418c-dd5c-4380-9847-b675ff57f53a" containerID="234ccd19ca8b0daac30160ce3b7f6a30982efe8d19c7b2b9772c858d5d3b088e" exitCode=0 Sep 15 07:25:12.236353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.236179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerDied","Data":"234ccd19ca8b0daac30160ce3b7f6a30982efe8d19c7b2b9772c858d5d3b088e"} Sep 15 07:25:12.237728 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.237708 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" event={"ID":"8f019d3d-0435-4d08-8161-d3bd5dc437f7","Type":"ContainerStarted","Data":"fc86151720486abd94bfafb58c208b02d6fc761f31b7b381b35c49f5042a7de4"} Sep 15 07:25:12.239390 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.239370 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cbtnf" event={"ID":"810e9712-e1cf-4c1f-872c-c2e8a75c5a7e","Type":"ContainerStarted","Data":"2173f965686a2691ab76138931c8bc7a265e2b7e59ef07d1e68650fb632aad14"} Sep 15 07:25:12.240885 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.240859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsj97" event={"ID":"17f9cd36-7b93-4b1b-ad11-0c668bb49d78","Type":"ContainerStarted","Data":"c6a9dab94545df594a2956fe73194605cb4bac268398e21c2dbf002635cad785"} Sep 15 07:25:12.242409 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.242391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" event={"ID":"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7","Type":"ContainerStarted","Data":"f13153af742deb03909454e934e47c51816190deecfed296970fd2d976bacc94"} Sep 15 07:25:12.243738 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.243718 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lwwwm" event={"ID":"84fb872a-2638-4a08-acc0-ffcd38d64979","Type":"ContainerStarted","Data":"0339de199e863d8e0a203140819b1c18fb801565b4153eb51d9eb40edd332252"} Sep 15 07:25:12.245127 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.245110 2582 generic.go:356] "Generic (PLEG): container finished" podID="c11dc1bc1d357127868a041cc6f1d45b" containerID="2ed343431971a491dcbb707edac8e636414867b8f81f7fd5a41e3fa72c8347c1" exitCode=0 Sep 15 07:25:12.245224 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.245160 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" event={"ID":"c11dc1bc1d357127868a041cc6f1d45b","Type":"ContainerDied","Data":"2ed343431971a491dcbb707edac8e636414867b8f81f7fd5a41e3fa72c8347c1"} Sep 15 07:25:12.248163 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.248141 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"5301ac6472faaabe08c1020e491c942370e666c0e526a1da93b64d3430aa964f"} Sep 15 07:25:12.248270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.248203 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"95e72fefa4306ab869a746243d12182772250d4befaeaece4ca76dcf4c96b255"} Sep 15 07:25:12.248270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.248243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"2a7ad85eb4898528b4f5f4659b541e8a02053f4c035d310f6b8cffbdff6d6133"} Sep 15 07:25:12.248362 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.248284 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"fd3737ae8692d7cba347c533e8bc004acc564c23edc66acd4735aaef4c30d83a"} Sep 15 07:25:12.248362 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.248312 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"805ad38c597471ef98b163fd1dc32150cdde270bd7ffe941f44fb5b550720ea7"} Sep 15 07:25:12.248362 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.248343 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"e6f295835c25c62739595affe1d83f04b106fd99385469a676beba0ca99f4dc5"} Sep 15 07:25:12.249418 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.249399 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hxspg" event={"ID":"978eb2dd-421d-48f8-bd57-0796552681c6","Type":"ContainerStarted","Data":"e0156db96cab498877923d4b11013b4b47e2ce560daad4d2487ebe950d1c1849"} Sep 15 07:25:12.272058 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.272014 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cbtnf" podStartSLOduration=8.358790103 podStartE2EDuration="21.27199929s" totalImagesPullingTime="12.913209187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:12.271854366 +0000 UTC m=+22.583940983" watchObservedRunningTime="2026-09-15 07:25:12.27199929 +0000 UTC m=+22.584085935" Sep 15 07:25:12.304142 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.304088 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tsj97" podStartSLOduration=2.993656964 podStartE2EDuration="21.304069622s" totalImagesPullingTime="18.310412658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:12.30375071 +0000 UTC m=+22.615837328" watchObservedRunningTime="2026-09-15 07:25:12.304069622 +0000 UTC m=+22.616156245" Sep 15 07:25:12.304344 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.304314 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hxspg" podStartSLOduration=3.993610293 podStartE2EDuration="22.304307294s" totalImagesPullingTime="18.310697001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:12.286783099 +0000 UTC m=+22.598869718" watchObservedRunningTime="2026-09-15 07:25:12.304307294 +0000 UTC m=+22.616393950" Sep 15 07:25:12.338729 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.338681 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zgxs9" podStartSLOduration=2.987703624 podStartE2EDuration="21.338664477s" totalImagesPullingTime="18.350960853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:12.323391795 +0000 UTC m=+22.635478413" watchObservedRunningTime="2026-09-15 07:25:12.338664477 +0000 UTC m=+22.650751092" Sep 15 07:25:12.366425 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:12.366370 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lwwwm" podStartSLOduration=3.964187538 podStartE2EDuration="22.366349151s" totalImagesPullingTime="18.402161613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:12.365486156 +0000 UTC m=+22.677572773" watchObservedRunningTime="2026-09-15 07:25:12.366349151 +0000 UTC m=+22.678435769" Sep 15 07:25:13.076994 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.076961 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:25:13.077619 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.077603 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:25:13.253906 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.253873 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m57gx" event={"ID":"6efa5091-b46e-47cd-8a5d-9a52420398c4","Type":"ContainerStarted","Data":"8a95050618ad46a32dbbfefb7a66acfca1b1cf189bb038a3626070d9fa1dacd5"} Sep 15 07:25:13.256047 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.256015 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" event={"ID":"c11dc1bc1d357127868a041cc6f1d45b","Type":"ContainerStarted","Data":"f1e65b786a91eea7917ab002b2a65323944cf601e69f0504573348b66e01174f"} Sep 15 07:25:13.271122 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.271073 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m57gx" podStartSLOduration=3.929493628 podStartE2EDuration="22.271052921s" totalImagesPullingTime="18.341559293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:13.27016696 +0000 UTC m=+23.582253577" watchObservedRunningTime="2026-09-15 07:25:13.271052921 +0000 UTC m=+23.583139539" Sep 15 07:25:13.286280 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.286234 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-67.ec2.internal" podStartSLOduration=21.286218131 podStartE2EDuration="21.286218131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:13.285990492 +0000 UTC m=+23.598077111" watchObservedRunningTime="2026-09-15 07:25:13.286218131 +0000 UTC m=+23.598304747" Sep 15 07:25:13.329086 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:13.329032 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 07:25:14.173094 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.172835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:14.173094 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.172835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:14.173094 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.172890 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:14.173321 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:14.173144 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:14.173321 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:14.173264 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:14.173404 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:14.173332 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:14.174739 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.174655 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T07:25:13.329049539Z","UUID":"2eeaf95e-5f31-47a0-8d13-a2f301d2abaf","Handler":null,"Name":"","Endpoint":""} Sep 15 07:25:14.176269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.176246 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 07:25:14.176384 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.176280 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 07:25:14.261494 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.261461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"181345df183ba28a0d07a5dc4b84708fa28c31389e335197504bf72c8e72e7cc"} Sep 15 07:25:14.263258 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.263241 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 15 07:25:14.263370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:14.263259 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" event={"ID":"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7","Type":"ContainerStarted","Data":"84d80dd8480a44d7f65b5f3004f7f7d606ec2f813ba1a0baf974e9e0c91425ca"} Sep 15 07:25:15.267521 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:15.267484 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" event={"ID":"a7ada9b7-90b8-4c79-ac4c-d3488ee50af7","Type":"ContainerStarted","Data":"e48695c51383fba300d4bae5d13d076c034ad4797e27cb5274c5d3c0fd6364c4"} Sep 15 07:25:15.288701 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:15.288653 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f6pzv" podStartSLOduration=4.033603074 podStartE2EDuration="25.288637781s" totalImagesPullingTime="21.255034707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:15.288163665 +0000 UTC m=+25.600250283" watchObservedRunningTime="2026-09-15 07:25:15.288637781 +0000 UTC m=+25.600724398" Sep 15 07:25:16.172862 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:16.172832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:16.173046 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:16.172832 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:16.173046 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:16.172967 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:16.173046 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:16.172833 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:16.173203 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:16.173058 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:16.173203 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:16.173096 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:17.276594 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:17.276254 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" event={"ID":"bfa0ff87-e79c-4363-81dc-8ad6a48304a5","Type":"ContainerStarted","Data":"a12e5223910068d6e21bab35a9b3ce0040f48c57a4e1d1cd2b1c23dd6458a91e"} Sep 15 07:25:17.276594 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:17.276585 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:25:17.278205 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:17.278180 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerStarted","Data":"5686b649d855774ca652c2bca0d7311ca4dfb695a2c7646e467c7139845a4a90"} Sep 15 07:25:17.291902 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:17.291881 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:25:17.306120 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:17.306082 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" podStartSLOduration=7.943218706 podStartE2EDuration="26.306070812s" totalImagesPullingTime="18.362852106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:17.305357031 +0000 UTC m=+27.617443648" watchObservedRunningTime="2026-09-15 07:25:17.306070812 +0000 UTC m=+27.618157459" Sep 15 07:25:18.172284 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.172247 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:18.172468 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.172247 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:18.172468 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:18.172349 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:18.172468 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:18.172446 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:18.172645 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.172251 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:18.172645 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:18.172593 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:18.283361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.283323 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e7418c-dd5c-4380-9847-b675ff57f53a" containerID="5686b649d855774ca652c2bca0d7311ca4dfb695a2c7646e467c7139845a4a90" exitCode=0 Sep 15 07:25:18.283818 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.283558 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerDied","Data":"5686b649d855774ca652c2bca0d7311ca4dfb695a2c7646e467c7139845a4a90"} Sep 15 07:25:18.284235 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.284196 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:25:18.284354 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.284279 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:25:18.301978 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.301954 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:25:18.612033 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.611939 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:25:18.612181 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.612124 2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 15 07:25:18.612602 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:18.612575 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tsj97" Sep 15 07:25:19.157333 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.157289 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2m5h"] Sep 15 07:25:19.157540 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.157422 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:19.157589 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:19.157560 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:19.160486 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.160465 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xq7k7"] Sep 15 07:25:19.160623 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.160581 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:19.160683 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:19.160659 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:19.161311 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.161285 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nknkw"] Sep 15 07:25:19.161458 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.161391 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:19.161520 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:19.161473 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:19.287720 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.287686 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e7418c-dd5c-4380-9847-b675ff57f53a" containerID="c27e1e118bbe74fdf23993e672f61061109c064f8790fea4168867ee7ed93e4d" exitCode=0 Sep 15 07:25:19.288509 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:19.287768 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerDied","Data":"c27e1e118bbe74fdf23993e672f61061109c064f8790fea4168867ee7ed93e4d"} Sep 15 07:25:20.292264 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:20.292071 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e7418c-dd5c-4380-9847-b675ff57f53a" containerID="f4b6f963df836b36e43f4d1b21f84d26744e19ee45a4110c3361ce09cd64bda9" exitCode=0 Sep 15 07:25:20.292811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:20.292158 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerDied","Data":"f4b6f963df836b36e43f4d1b21f84d26744e19ee45a4110c3361ce09cd64bda9"} Sep 15 07:25:21.173234 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:21.173199 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:21.173387 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:21.173235 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:21.173387 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:21.173235 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:21.173387 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:21.173316 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:21.173571 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:21.173430 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:21.173571 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:21.173524 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:23.172882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:23.172850 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:23.173255 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:23.172850 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:23.173255 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.172957 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq7k7" podUID="c0483747-ec7d-4b7c-9121-4c766485e1d2" Sep 15 07:25:23.173255 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:23.172850 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:23.173255 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.173025 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nknkw" podUID="e419fef2-f661-402e-995e-284a565c061f" Sep 15 07:25:23.173255 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.173119 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m2m5h" podUID="5d209bf2-2892-4cac-8930-be58fc4fef6e" Sep 15 07:25:23.860592 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:23.860553 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:23.860772 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.860706 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 07:25:23.860818 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.860788 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret podName:e419fef2-f661-402e-995e-284a565c061f nodeName:}" failed. No retries permitted until 2026-09-15 07:25:55.860769661 +0000 UTC m=+66.172856270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret") pod "global-pull-secret-syncer-nknkw" (UID: "e419fef2-f661-402e-995e-284a565c061f") : object "kube-system"/"original-pull-secret" not registered Sep 15 07:25:23.961719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:23.961676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:23.961896 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:23.961742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:23.961896 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.961868 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 07:25:23.962002 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.961903 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 07:25:23.962002 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.961916 2582 projected.go:196] Error preparing data for projected volume kube-api-access-zjlf4 for pod openshift-network-diagnostics/network-check-target-xq7k7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:25:23.962002 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.961874 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:25:23.962002 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.961971 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4 podName:c0483747-ec7d-4b7c-9121-4c766485e1d2 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:55.961951859 +0000 UTC m=+66.274038477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zjlf4" (UniqueName: "kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4") pod "network-check-target-xq7k7" (UID: "c0483747-ec7d-4b7c-9121-4c766485e1d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 07:25:23.962128 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:23.962006 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs podName:5d209bf2-2892-4cac-8930-be58fc4fef6e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:55.961992942 +0000 UTC m=+66.274079541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs") pod "network-metrics-daemon-m2m5h" (UID: "5d209bf2-2892-4cac-8930-be58fc4fef6e") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 07:25:24.032387 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.032352 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-67.ec2.internal" event="NodeReady" Sep 15 07:25:24.032571 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.032504 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 07:25:24.068743 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.068667 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl"] Sep 15 07:25:24.098694 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.098591 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6689ff4699-g87zb"] Sep 15 07:25:24.098869 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.098731 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.101492 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.101468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 15 07:25:24.101650 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.101514 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hh9rl\"" Sep 15 07:25:24.101650 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.101631 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.101951 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.101915 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 15 07:25:24.102076 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.101968 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.112522 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.112499 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg"] Sep 15 07:25:24.112643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.112596 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.117202 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.117111 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 15 07:25:24.117652 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.117630 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b2mnr\"" Sep 15 07:25:24.117871 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.117854 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 15 07:25:24.118114 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.118095 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 15 07:25:24.123444 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.123427 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 15 07:25:24.132641 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.132617 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr"] Sep 15 07:25:24.132779 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.132763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.135674 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.135655 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 15 07:25:24.135784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.135735 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4n6x7\"" Sep 15 07:25:24.135876 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.135859 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 15 07:25:24.150662 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.150642 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-pq7qx"] Sep 15 07:25:24.150790 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.150763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.154247 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.154219 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 15 07:25:24.155687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.155013 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.155687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.155049 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.155687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.155369 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fvg4z\"" Sep 15 07:25:24.156185 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.156154 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 15 07:25:24.163009 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.162989 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89358f35-b2bb-4e0d-9091-fdb1497c54c5-serving-cert\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.163114 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.163015 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89358f35-b2bb-4e0d-9091-fdb1497c54c5-config\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.163114 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.163042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clqfs\" (UniqueName: \"kubernetes.io/projected/89358f35-b2bb-4e0d-9091-fdb1497c54c5-kube-api-access-clqfs\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.172920 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.172899 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58"] Sep 15 07:25:24.173272 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.173028 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.175844 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.175823 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.175960 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.175851 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mvsmv\"" Sep 15 07:25:24.175960 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.175825 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 15 07:25:24.176120 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.176104 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.176268 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.176191 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 15 07:25:24.181845 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.181820 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 15 07:25:24.186863 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.186841 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.190211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.190194 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.190575 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.190193 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lx9pz\"" Sep 15 07:25:24.190853 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.190222 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.190943 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.190325 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 15 07:25:24.191866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.191848 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-776vd"] Sep 15 07:25:24.210811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.210784 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg"] Sep 15 07:25:24.210954 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.210822 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795"] Sep 15 07:25:24.210954 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.210922 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.213408 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.213386 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 07:25:24.213544 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.213407 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pfvn\"" Sep 15 07:25:24.213544 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.213413 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 07:25:24.228501 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.228480 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-ffbfb48c4-bx7kt"] Sep 15 07:25:24.228651 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.228627 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.231298 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.231265 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-29nmm\"" Sep 15 07:25:24.231298 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.231277 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 15 07:25:24.231474 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.231403 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.231667 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.231652 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.231869 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.231852 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 15 07:25:24.254607 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.254578 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl"] Sep 15 07:25:24.254761 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.254715 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.258089 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.258067 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 15 07:25:24.258260 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.258092 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.258809 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.258784 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l8t25\"" Sep 15 07:25:24.262341 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.262318 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 15 07:25:24.262482 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.262340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 15 07:25:24.262482 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.262405 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.262482 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.262455 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 15 07:25:24.263556 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-certificates\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.263651 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-installation-pull-secrets\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.263651 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263601 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df8db835-dfab-4801-983d-b81d7f57e09d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.263651 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f40e5368-9f86-42ca-8127-c50b308b74da-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.263819 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f40e5368-9f86-42ca-8127-c50b308b74da-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.263819 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89358f35-b2bb-4e0d-9091-fdb1497c54c5-serving-cert\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.263819 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263794 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.263965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-ca-trust-extracted\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.263965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263841 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-serving-cert\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.263965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263867 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89358f35-b2bb-4e0d-9091-fdb1497c54c5-config\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.263965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgb76\" (UniqueName: \"kubernetes.io/projected/f40e5368-9f86-42ca-8127-c50b308b74da-kube-api-access-tgb76\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.263965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.263952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.264410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clqfs\" (UniqueName: \"kubernetes.io/projected/89358f35-b2bb-4e0d-9091-fdb1497c54c5-kube-api-access-clqfs\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.264410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264271 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-bound-sa-token\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.264410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-config\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.264410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwp8n\" (UniqueName: \"kubernetes.io/projected/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-kube-api-access-wwp8n\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.264410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264354 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.264410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-trusted-ca\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.264849 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264419 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftpjb\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-kube-api-access-ftpjb\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.264849 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-image-registry-private-configuration\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.264849 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-trusted-ca\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.264849 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt975\" (UniqueName: \"kubernetes.io/projected/d9891b26-ef68-45fc-a8d4-a41e4674c14c-kube-api-access-jt975\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.264849 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.264611 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89358f35-b2bb-4e0d-9091-fdb1497c54c5-config\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.269311 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.269281 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89358f35-b2bb-4e0d-9091-fdb1497c54c5-serving-cert\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.272621 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.272596 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr"] Sep 15 07:25:24.272724 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.272636 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zhz57"] Sep 15 07:25:24.272724 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.272691 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" Sep 15 07:25:24.273153 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.273103 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clqfs\" (UniqueName: \"kubernetes.io/projected/89358f35-b2bb-4e0d-9091-fdb1497c54c5-kube-api-access-clqfs\") pod \"service-ca-operator-cf7c776b7-4fzjl\" (UID: \"89358f35-b2bb-4e0d-9091-fdb1497c54c5\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.275338 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.275318 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.275338 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.275331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7vcqp\"" Sep 15 07:25:24.275491 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.275318 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.294886 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.294867 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58"] Sep 15 07:25:24.294992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.294902 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x"] Sep 15 07:25:24.295054 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.294988 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.297811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.297600 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-smbg8\"" Sep 15 07:25:24.297811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.297652 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 07:25:24.297811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.297697 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.298010 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.297895 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.316491 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.316464 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-5mlms"] Sep 15 07:25:24.316623 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.316569 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" Sep 15 07:25:24.319695 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.319646 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.319800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.319739 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.320034 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.319954 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7b6jx\"" Sep 15 07:25:24.338582 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338554 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl"] Sep 15 07:25:24.338709 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338594 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6689ff4699-g87zb"] Sep 15 07:25:24.338709 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338675 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.338818 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338683 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-pq7qx"] Sep 15 07:25:24.338870 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338820 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zhz57"] Sep 15 07:25:24.338870 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338850 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-776vd"] Sep 15 07:25:24.338967 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338882 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x"] Sep 15 07:25:24.338967 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338906 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-5mlms"] Sep 15 07:25:24.338967 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338929 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795"] Sep 15 07:25:24.338967 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338952 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ffbfb48c4-bx7kt"] Sep 15 07:25:24.339144 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.338980 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl"] Sep 15 07:25:24.341902 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.341837 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k4xdj\"" Sep 15 07:25:24.341902 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.341855 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 15 07:25:24.341902 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.341877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 07:25:24.342118 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.341913 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 07:25:24.342195 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.342179 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 15 07:25:24.346760 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.346740 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 15 07:25:24.365237 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rfsb\" (UniqueName: \"kubernetes.io/projected/f1ff0b49-45a2-41eb-a0f5-6ef9213473a2-kube-api-access-4rfsb\") pod \"volume-data-source-validator-86695b7cc7-6sbsl\" (UID: \"f1ff0b49-45a2-41eb-a0f5-6ef9213473a2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" Sep 15 07:25:24.365383 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.365383 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-default-certificate\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.365383 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365328 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-ca-trust-extracted\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.365541 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.365383 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 07:25:24.365541 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.365396 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689ff4699-g87zb: secret "image-registry-tls" not found Sep 15 07:25:24.365541 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365429 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgb76\" (UniqueName: \"kubernetes.io/projected/f40e5368-9f86-42ca-8127-c50b308b74da-kube-api-access-tgb76\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.365541 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.365447 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls podName:f2ffe6c8-463a-4faf-b81c-abf31879d9d3 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.865428642 +0000 UTC m=+35.177515242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls") pod "image-registry-6689ff4699-g87zb" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3") : secret "image-registry-tls" not found Sep 15 07:25:24.365541 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.365541 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-config\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftpjb\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-kube-api-access-ftpjb\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt975\" (UniqueName: \"kubernetes.io/projected/d9891b26-ef68-45fc-a8d4-a41e4674c14c-kube-api-access-jt975\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-image-registry-private-configuration\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjrvr\" (UniqueName: \"kubernetes.io/projected/2199cd3e-575f-49ba-81ec-bb7085383b1a-kube-api-access-kjrvr\") pod \"ingress-canary-zhz57\" (UID: \"2199cd3e-575f-49ba-81ec-bb7085383b1a\") " pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88mgw\" (UniqueName: \"kubernetes.io/projected/a300c8b2-2756-4435-9669-d71f2344876c-kube-api-access-88mgw\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-certificates\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f40e5368-9f86-42ca-8127-c50b308b74da-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.365755 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365765 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-ca-trust-extracted\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.365831 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.365809 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert podName:df8db835-dfab-4801-983d-b81d7f57e09d nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.865796242 +0000 UTC m=+35.177882849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-52gbg" (UID: "df8db835-dfab-4801-983d-b81d7f57e09d") : secret "networking-console-plugin-cert" not found Sep 15 07:25:24.366439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.365846 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f40e5368-9f86-42ca-8127-c50b308b74da-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.366439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366168 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a300c8b2-2756-4435-9669-d71f2344876c-tmp-dir\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.366439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366289 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-serving-cert\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.366439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366366 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-certificates\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366441 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwp8n\" (UniqueName: \"kubernetes.io/projected/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-kube-api-access-wwp8n\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2199cd3e-575f-49ba-81ec-bb7085383b1a-cert\") pod \"ingress-canary-zhz57\" (UID: \"2199cd3e-575f-49ba-81ec-bb7085383b1a\") " pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7s7l\" (UniqueName: \"kubernetes.io/projected/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-kube-api-access-q7s7l\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df8db835-dfab-4801-983d-b81d7f57e09d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-bound-sa-token\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.366663 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366661 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-stats-auth\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366710 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-config\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366783 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f40e5368-9f86-42ca-8127-c50b308b74da-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-trusted-ca\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.366849 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366854 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-trusted-ca\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbcjd\" (UniqueName: \"kubernetes.io/projected/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-kube-api-access-dbcjd\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.366894 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls podName:d9891b26-ef68-45fc-a8d4-a41e4674c14c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.866879157 +0000 UTC m=+35.178965754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x6v58" (UID: "d9891b26-ef68-45fc-a8d4-a41e4674c14c") : secret "samples-operator-tls" not found Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366928 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-installation-pull-secrets\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366956 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.367043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.366994 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a300c8b2-2756-4435-9669-d71f2344876c-config-volume\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.367608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.367350 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/df8db835-dfab-4801-983d-b81d7f57e09d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.367608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.367602 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-trusted-ca\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.367795 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.367772 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-trusted-ca\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.369120 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.369090 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-serving-cert\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.369430 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.369406 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f40e5368-9f86-42ca-8127-c50b308b74da-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.369655 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.369631 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-image-registry-private-configuration\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.369912 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.369893 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-installation-pull-secrets\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.377188 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.377144 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftpjb\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-kube-api-access-ftpjb\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.377935 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.377832 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-bound-sa-token\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.378021 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.377940 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgb76\" (UniqueName: \"kubernetes.io/projected/f40e5368-9f86-42ca-8127-c50b308b74da-kube-api-access-tgb76\") pod \"kube-storage-version-migrator-operator-6c8f84f897-jpkvr\" (UID: \"f40e5368-9f86-42ca-8127-c50b308b74da\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.378211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.378187 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt975\" (UniqueName: \"kubernetes.io/projected/d9891b26-ef68-45fc-a8d4-a41e4674c14c-kube-api-access-jt975\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.378690 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.378674 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwp8n\" (UniqueName: \"kubernetes.io/projected/8c4db370-fbbc-42b0-852d-9b33bae6bfbf-kube-api-access-wwp8n\") pod \"console-operator-696884fb9c-pq7qx\" (UID: \"8c4db370-fbbc-42b0-852d-9b33bae6bfbf\") " pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.410635 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.410600 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" Sep 15 07:25:24.464221 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.464191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" Sep 15 07:25:24.467454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467426 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbcjd\" (UniqueName: \"kubernetes.io/projected/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-kube-api-access-dbcjd\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.467596 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.467596 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf9beb80-892c-43b0-92df-8685f8c7f567-tmp\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.467596 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467512 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9beb80-892c-43b0-92df-8685f8c7f567-service-ca-bundle\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.467756 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a300c8b2-2756-4435-9669-d71f2344876c-config-volume\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.467756 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.467624 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:24.467756 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9beb80-892c-43b0-92df-8685f8c7f567-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.467756 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rfsb\" (UniqueName: \"kubernetes.io/projected/f1ff0b49-45a2-41eb-a0f5-6ef9213473a2-kube-api-access-4rfsb\") pod \"volume-data-source-validator-86695b7cc7-6sbsl\" (UID: \"f1ff0b49-45a2-41eb-a0f5-6ef9213473a2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" Sep 15 07:25:24.467756 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.467700 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls podName:5f8a6ea6-2f70-431a-8cb1-3f910555b5f9 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.967679478 +0000 UTC m=+35.279766080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4795" (UID: "5f8a6ea6-2f70-431a-8cb1-3f910555b5f9") : secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467761 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-default-certificate\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467819 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjrvr\" (UniqueName: \"kubernetes.io/projected/2199cd3e-575f-49ba-81ec-bb7085383b1a-kube-api-access-kjrvr\") pod \"ingress-canary-zhz57\" (UID: \"2199cd3e-575f-49ba-81ec-bb7085383b1a\") " pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88mgw\" (UniqueName: \"kubernetes.io/projected/a300c8b2-2756-4435-9669-d71f2344876c-kube-api-access-88mgw\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467866 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467894 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7t78\" (UniqueName: \"kubernetes.io/projected/7c6fd379-3cbd-4daa-a53e-cafeb557377c-kube-api-access-x7t78\") pod \"network-check-source-6f8b768455-kjq4x\" (UID: \"7c6fd379-3cbd-4daa-a53e-cafeb557377c\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467924 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467950 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.467965 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.467975 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9beb80-892c-43b0-92df-8685f8c7f567-serving-cert\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.468001 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls podName:a300c8b2-2756-4435-9669-d71f2344876c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.967990511 +0000 UTC m=+35.280077111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls") pod "dns-default-776vd" (UID: "a300c8b2-2756-4435-9669-d71f2344876c") : secret "dns-default-metrics-tls" not found Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468024 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a300c8b2-2756-4435-9669-d71f2344876c-tmp-dir\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.468036 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 07:25:24.468042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2199cd3e-575f-49ba-81ec-bb7085383b1a-cert\") pod \"ingress-canary-zhz57\" (UID: \"2199cd3e-575f-49ba-81ec-bb7085383b1a\") " pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468082 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7s7l\" (UniqueName: \"kubernetes.io/projected/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-kube-api-access-q7s7l\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.468099 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.968083195 +0000 UTC m=+35.280169806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : configmap references non-existent config key: service-ca.crt Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.468127 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:24.968117805 +0000 UTC m=+35.280204399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : secret "router-metrics-certs-default" not found Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468142 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a300c8b2-2756-4435-9669-d71f2344876c-config-volume\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468156 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cf9beb80-892c-43b0-92df-8685f8c7f567-snapshots\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468217 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26jjm\" (UniqueName: \"kubernetes.io/projected/cf9beb80-892c-43b0-92df-8685f8c7f567-kube-api-access-26jjm\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468276 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-stats-auth\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.468716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.468434 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a300c8b2-2756-4435-9669-d71f2344876c-tmp-dir\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.469118 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.469025 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.470800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.470781 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-stats-auth\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.470881 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.470825 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-default-certificate\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.470881 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.470844 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2199cd3e-575f-49ba-81ec-bb7085383b1a-cert\") pod \"ingress-canary-zhz57\" (UID: \"2199cd3e-575f-49ba-81ec-bb7085383b1a\") " pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.476919 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.476896 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88mgw\" (UniqueName: \"kubernetes.io/projected/a300c8b2-2756-4435-9669-d71f2344876c-kube-api-access-88mgw\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.477196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.477176 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbcjd\" (UniqueName: \"kubernetes.io/projected/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-kube-api-access-dbcjd\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.477358 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.477337 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rfsb\" (UniqueName: \"kubernetes.io/projected/f1ff0b49-45a2-41eb-a0f5-6ef9213473a2-kube-api-access-4rfsb\") pod \"volume-data-source-validator-86695b7cc7-6sbsl\" (UID: \"f1ff0b49-45a2-41eb-a0f5-6ef9213473a2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" Sep 15 07:25:24.477431 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.477409 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7s7l\" (UniqueName: \"kubernetes.io/projected/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-kube-api-access-q7s7l\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.477431 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.477425 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjrvr\" (UniqueName: \"kubernetes.io/projected/2199cd3e-575f-49ba-81ec-bb7085383b1a-kube-api-access-kjrvr\") pod \"ingress-canary-zhz57\" (UID: \"2199cd3e-575f-49ba-81ec-bb7085383b1a\") " pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.482815 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.482770 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:24.569116 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569073 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9beb80-892c-43b0-92df-8685f8c7f567-serving-cert\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.569289 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cf9beb80-892c-43b0-92df-8685f8c7f567-snapshots\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.569289 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569201 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26jjm\" (UniqueName: \"kubernetes.io/projected/cf9beb80-892c-43b0-92df-8685f8c7f567-kube-api-access-26jjm\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.569289 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569247 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf9beb80-892c-43b0-92df-8685f8c7f567-tmp\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.569289 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9beb80-892c-43b0-92df-8685f8c7f567-service-ca-bundle\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.569483 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9beb80-892c-43b0-92df-8685f8c7f567-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.569483 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569397 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7t78\" (UniqueName: \"kubernetes.io/projected/7c6fd379-3cbd-4daa-a53e-cafeb557377c-kube-api-access-x7t78\") pod \"network-check-source-6f8b768455-kjq4x\" (UID: \"7c6fd379-3cbd-4daa-a53e-cafeb557377c\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" Sep 15 07:25:24.570017 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569920 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cf9beb80-892c-43b0-92df-8685f8c7f567-snapshots\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.570017 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.569982 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf9beb80-892c-43b0-92df-8685f8c7f567-tmp\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.570212 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.570071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9beb80-892c-43b0-92df-8685f8c7f567-service-ca-bundle\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.570459 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.570432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9beb80-892c-43b0-92df-8685f8c7f567-trusted-ca-bundle\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.571702 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.571680 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9beb80-892c-43b0-92df-8685f8c7f567-serving-cert\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.577742 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.577723 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7t78\" (UniqueName: \"kubernetes.io/projected/7c6fd379-3cbd-4daa-a53e-cafeb557377c-kube-api-access-x7t78\") pod \"network-check-source-6f8b768455-kjq4x\" (UID: \"7c6fd379-3cbd-4daa-a53e-cafeb557377c\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" Sep 15 07:25:24.577827 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.577763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26jjm\" (UniqueName: \"kubernetes.io/projected/cf9beb80-892c-43b0-92df-8685f8c7f567-kube-api-access-26jjm\") pod \"insights-operator-5844b856db-5mlms\" (UID: \"cf9beb80-892c-43b0-92df-8685f8c7f567\") " pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.586545 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.586512 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" Sep 15 07:25:24.604679 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.604661 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zhz57" Sep 15 07:25:24.627201 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.627183 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" Sep 15 07:25:24.648649 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.648626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-5mlms" Sep 15 07:25:24.872818 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.872736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:24.872973 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.872826 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:24.872973 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.872852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:24.872973 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.872897 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 07:25:24.873122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.872974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls podName:d9891b26-ef68-45fc-a8d4-a41e4674c14c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.872951994 +0000 UTC m=+36.185038612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x6v58" (UID: "d9891b26-ef68-45fc-a8d4-a41e4674c14c") : secret "samples-operator-tls" not found Sep 15 07:25:24.873122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.872976 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 07:25:24.873122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.872986 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 07:25:24.873122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.873006 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689ff4699-g87zb: secret "image-registry-tls" not found Sep 15 07:25:24.873122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.873023 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert podName:df8db835-dfab-4801-983d-b81d7f57e09d nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.873012269 +0000 UTC m=+36.185098864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-52gbg" (UID: "df8db835-dfab-4801-983d-b81d7f57e09d") : secret "networking-console-plugin-cert" not found Sep 15 07:25:24.873122 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.873049 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls podName:f2ffe6c8-463a-4faf-b81c-abf31879d9d3 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.873034817 +0000 UTC m=+36.185121418 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls") pod "image-registry-6689ff4699-g87zb" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3") : secret "image-registry-tls" not found Sep 15 07:25:24.973675 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.973633 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:24.973855 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.973820 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:24.973855 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.973838 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:24.973944 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.973882 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.973944 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.973900 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls podName:5f8a6ea6-2f70-431a-8cb1-3f910555b5f9 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.973879387 +0000 UTC m=+36.285966003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4795" (UID: "5f8a6ea6-2f70-431a-8cb1-3f910555b5f9") : secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:24.973944 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.973932 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 07:25:24.974089 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:24.973944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:24.974089 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.973965 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 07:25:24.974089 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.973974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls podName:a300c8b2-2756-4435-9669-d71f2344876c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.973962344 +0000 UTC m=+36.286048954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls") pod "dns-default-776vd" (UID: "a300c8b2-2756-4435-9669-d71f2344876c") : secret "dns-default-metrics-tls" not found Sep 15 07:25:24.974089 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.974014 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.973999992 +0000 UTC m=+36.286086594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : secret "router-metrics-certs-default" not found Sep 15 07:25:24.974089 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:24.974027 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:25.974020961 +0000 UTC m=+36.286107556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : configmap references non-existent config key: service-ca.crt Sep 15 07:25:25.172347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.172308 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:25.172554 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.172523 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:25.172648 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.172584 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:25.175848 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.175621 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 07:25:25.175848 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.175665 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4f6cz\"" Sep 15 07:25:25.175848 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.175803 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vrc7c\"" Sep 15 07:25:25.176287 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.175879 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 07:25:25.446002 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.445832 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zhz57"] Sep 15 07:25:25.449879 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.449836 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2199cd3e_575f_49ba_81ec_bb7085383b1a.slice/crio-727f1cec732001fe223e027b4d457b1e44bb7b8aedceb19177d970f383a18f2e WatchSource:0}: Error finding container 727f1cec732001fe223e027b4d457b1e44bb7b8aedceb19177d970f383a18f2e: Status 404 returned error can't find the container with id 727f1cec732001fe223e027b4d457b1e44bb7b8aedceb19177d970f383a18f2e Sep 15 07:25:25.451804 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.451782 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl"] Sep 15 07:25:25.452762 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.452695 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x"] Sep 15 07:25:25.454907 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.454728 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl"] Sep 15 07:25:25.456162 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.456142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr"] Sep 15 07:25:25.456642 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.456619 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40e5368_9f86_42ca_8127_c50b308b74da.slice/crio-f14956a5ab2ca2ae4b7574d2d8f44e72a25c6eb015fbc28693e713f0fdcdce7b WatchSource:0}: Error finding container f14956a5ab2ca2ae4b7574d2d8f44e72a25c6eb015fbc28693e713f0fdcdce7b: Status 404 returned error can't find the container with id f14956a5ab2ca2ae4b7574d2d8f44e72a25c6eb015fbc28693e713f0fdcdce7b Sep 15 07:25:25.457374 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.457355 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-pq7qx"] Sep 15 07:25:25.458027 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.457991 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ff0b49_45a2_41eb_a0f5_6ef9213473a2.slice/crio-526934efa1ea39265e1bd0f57e34c6a77817ab74ff28e680c5ed8e140a693c10 WatchSource:0}: Error finding container 526934efa1ea39265e1bd0f57e34c6a77817ab74ff28e680c5ed8e140a693c10: Status 404 returned error can't find the container with id 526934efa1ea39265e1bd0f57e34c6a77817ab74ff28e680c5ed8e140a693c10 Sep 15 07:25:25.458605 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.458577 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-5mlms"] Sep 15 07:25:25.458771 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.458745 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9beb80_892c_43b0_92df_8685f8c7f567.slice/crio-3db6846e48aea4d7d6a58c5f7581684276dc973c7633e7eee41f68231b3226c4 WatchSource:0}: Error finding container 3db6846e48aea4d7d6a58c5f7581684276dc973c7633e7eee41f68231b3226c4: Status 404 returned error can't find the container with id 3db6846e48aea4d7d6a58c5f7581684276dc973c7633e7eee41f68231b3226c4 Sep 15 07:25:25.462332 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.461920 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4db370_fbbc_42b0_852d_9b33bae6bfbf.slice/crio-4815cb9e4b01b460cc1897c0aa5f26cf0441ba1928ff768be850f0ddf44c56f7 WatchSource:0}: Error finding container 4815cb9e4b01b460cc1897c0aa5f26cf0441ba1928ff768be850f0ddf44c56f7: Status 404 returned error can't find the container with id 4815cb9e4b01b460cc1897c0aa5f26cf0441ba1928ff768be850f0ddf44c56f7 Sep 15 07:25:25.463126 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.463044 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89358f35_b2bb_4e0d_9091_fdb1497c54c5.slice/crio-8a6447722aacb5ddb2148e8b95e98765c69374e568ad3ee83f15781aadac28e6 WatchSource:0}: Error finding container 8a6447722aacb5ddb2148e8b95e98765c69374e568ad3ee83f15781aadac28e6: Status 404 returned error can't find the container with id 8a6447722aacb5ddb2148e8b95e98765c69374e568ad3ee83f15781aadac28e6 Sep 15 07:25:25.464043 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:25.463854 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6fd379_3cbd_4daa_a53e_cafeb557377c.slice/crio-46136b0e5dbeab693dbb5640e285f50068ab1f7483cc29b48776be4cb77f1bf2 WatchSource:0}: Error finding container 46136b0e5dbeab693dbb5640e285f50068ab1f7483cc29b48776be4cb77f1bf2: Status 404 returned error can't find the container with id 46136b0e5dbeab693dbb5640e285f50068ab1f7483cc29b48776be4cb77f1bf2 Sep 15 07:25:25.882618 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.882584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:25.882618 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.882622 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:25.882833 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.882728 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 07:25:25.882833 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.882736 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 07:25:25.882833 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.882755 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689ff4699-g87zb: secret "image-registry-tls" not found Sep 15 07:25:25.882833 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.882776 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert podName:df8db835-dfab-4801-983d-b81d7f57e09d nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.882763309 +0000 UTC m=+38.194849904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-52gbg" (UID: "df8db835-dfab-4801-983d-b81d7f57e09d") : secret "networking-console-plugin-cert" not found Sep 15 07:25:25.882833 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.882797 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls podName:f2ffe6c8-463a-4faf-b81c-abf31879d9d3 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.882784082 +0000 UTC m=+38.194870678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls") pod "image-registry-6689ff4699-g87zb" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3") : secret "image-registry-tls" not found Sep 15 07:25:25.883035 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.882892 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:25.883035 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.883018 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 07:25:25.883099 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.883068 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls podName:d9891b26-ef68-45fc-a8d4-a41e4674c14c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.883057309 +0000 UTC m=+38.195143921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x6v58" (UID: "d9891b26-ef68-45fc-a8d4-a41e4674c14c") : secret "samples-operator-tls" not found Sep 15 07:25:25.984643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.984395 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:25.984643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.984453 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:25.984643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.984489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:25.984643 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984569 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 07:25:25.984643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:25.984595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:25.984643 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls podName:a300c8b2-2756-4435-9669-d71f2344876c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.984622323 +0000 UTC m=+38.296708931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls") pod "dns-default-776vd" (UID: "a300c8b2-2756-4435-9669-d71f2344876c") : secret "dns-default-metrics-tls" not found Sep 15 07:25:25.985127 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984569 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 07:25:25.985127 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984690 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.98467165 +0000 UTC m=+38.296758252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : configmap references non-existent config key: service-ca.crt Sep 15 07:25:25.985127 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984698 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:25.985127 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984724 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.984713795 +0000 UTC m=+38.296800391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : secret "router-metrics-certs-default" not found Sep 15 07:25:25.985127 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:25.984745 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls podName:5f8a6ea6-2f70-431a-8cb1-3f910555b5f9 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:27.98473293 +0000 UTC m=+38.296819558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4795" (UID: "5f8a6ea6-2f70-431a-8cb1-3f910555b5f9") : secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:26.312096 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.312014 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" event={"ID":"89358f35-b2bb-4e0d-9091-fdb1497c54c5","Type":"ContainerStarted","Data":"8a6447722aacb5ddb2148e8b95e98765c69374e568ad3ee83f15781aadac28e6"} Sep 15 07:25:26.314117 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.314089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" event={"ID":"f1ff0b49-45a2-41eb-a0f5-6ef9213473a2","Type":"ContainerStarted","Data":"526934efa1ea39265e1bd0f57e34c6a77817ab74ff28e680c5ed8e140a693c10"} Sep 15 07:25:26.320035 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.320009 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e7418c-dd5c-4380-9847-b675ff57f53a" containerID="7ecc3b64360bf3564eef0a78cfb8d6b7a492b1c13a506d48d8f11d37aeedfd19" exitCode=0 Sep 15 07:25:26.320172 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.320069 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerDied","Data":"7ecc3b64360bf3564eef0a78cfb8d6b7a492b1c13a506d48d8f11d37aeedfd19"} Sep 15 07:25:26.322727 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.322659 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" event={"ID":"7c6fd379-3cbd-4daa-a53e-cafeb557377c","Type":"ContainerStarted","Data":"46136b0e5dbeab693dbb5640e285f50068ab1f7483cc29b48776be4cb77f1bf2"} Sep 15 07:25:26.325026 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.325005 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" event={"ID":"f40e5368-9f86-42ca-8127-c50b308b74da","Type":"ContainerStarted","Data":"f14956a5ab2ca2ae4b7574d2d8f44e72a25c6eb015fbc28693e713f0fdcdce7b"} Sep 15 07:25:26.327964 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.327937 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zhz57" event={"ID":"2199cd3e-575f-49ba-81ec-bb7085383b1a","Type":"ContainerStarted","Data":"727f1cec732001fe223e027b4d457b1e44bb7b8aedceb19177d970f383a18f2e"} Sep 15 07:25:26.330761 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.330706 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" event={"ID":"8c4db370-fbbc-42b0-852d-9b33bae6bfbf","Type":"ContainerStarted","Data":"4815cb9e4b01b460cc1897c0aa5f26cf0441ba1928ff768be850f0ddf44c56f7"} Sep 15 07:25:26.333036 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:26.332989 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5mlms" event={"ID":"cf9beb80-892c-43b0-92df-8685f8c7f567","Type":"ContainerStarted","Data":"3db6846e48aea4d7d6a58c5f7581684276dc973c7633e7eee41f68231b3226c4"} Sep 15 07:25:27.341866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:27.341088 2582 generic.go:356] "Generic (PLEG): container finished" podID="22e7418c-dd5c-4380-9847-b675ff57f53a" containerID="9e31f0bb6ae7301943848183cff4f84297cdc37a021159aa390669eaba611829" exitCode=0 Sep 15 07:25:27.341866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:27.341167 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerDied","Data":"9e31f0bb6ae7301943848183cff4f84297cdc37a021159aa390669eaba611829"} Sep 15 07:25:27.917057 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:27.917017 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:27.917238 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:27.917125 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:27.917238 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:27.917164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:27.917238 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917198 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 07:25:27.917403 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917261 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 07:25:27.917403 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917270 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 07:25:27.917403 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917282 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689ff4699-g87zb: secret "image-registry-tls" not found Sep 15 07:25:27.917403 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917270 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls podName:d9891b26-ef68-45fc-a8d4-a41e4674c14c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:31.917250926 +0000 UTC m=+42.229337528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x6v58" (UID: "d9891b26-ef68-45fc-a8d4-a41e4674c14c") : secret "samples-operator-tls" not found Sep 15 07:25:27.917403 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917341 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert podName:df8db835-dfab-4801-983d-b81d7f57e09d nodeName:}" failed. No retries permitted until 2026-09-15 07:25:31.917323483 +0000 UTC m=+42.229410087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-52gbg" (UID: "df8db835-dfab-4801-983d-b81d7f57e09d") : secret "networking-console-plugin-cert" not found Sep 15 07:25:27.917403 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:27.917357 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls podName:f2ffe6c8-463a-4faf-b81c-abf31879d9d3 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:31.917347313 +0000 UTC m=+42.229433914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls") pod "image-registry-6689ff4699-g87zb" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3") : secret "image-registry-tls" not found Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:28.018947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:28.019072 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:28.019107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:28.019136 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019311 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:32.019290608 +0000 UTC m=+42.331377229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : configmap references non-existent config key: service-ca.crt Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019730 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019784 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls podName:5f8a6ea6-2f70-431a-8cb1-3f910555b5f9 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:32.019768595 +0000 UTC m=+42.331855195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4795" (UID: "5f8a6ea6-2f70-431a-8cb1-3f910555b5f9") : secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019843 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019875 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls podName:a300c8b2-2756-4435-9669-d71f2344876c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:32.019862766 +0000 UTC m=+42.331949377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls") pod "dns-default-776vd" (UID: "a300c8b2-2756-4435-9669-d71f2344876c") : secret "dns-default-metrics-tls" not found Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019926 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 07:25:28.019993 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:28.019959 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:32.01994859 +0000 UTC m=+42.332035187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : secret "router-metrics-certs-default" not found Sep 15 07:25:31.954857 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:31.954817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:31.954887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:31.954910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.954971 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.954994 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.955035 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.955055 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689ff4699-g87zb: secret "image-registry-tls" not found Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.955041 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls podName:d9891b26-ef68-45fc-a8d4-a41e4674c14c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:39.955025012 +0000 UTC m=+50.267111606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x6v58" (UID: "d9891b26-ef68-45fc-a8d4-a41e4674c14c") : secret "samples-operator-tls" not found Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.955110 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert podName:df8db835-dfab-4801-983d-b81d7f57e09d nodeName:}" failed. No retries permitted until 2026-09-15 07:25:39.955097042 +0000 UTC m=+50.267183638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-52gbg" (UID: "df8db835-dfab-4801-983d-b81d7f57e09d") : secret "networking-console-plugin-cert" not found Sep 15 07:25:31.955319 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:31.955126 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls podName:f2ffe6c8-463a-4faf-b81c-abf31879d9d3 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:39.955120012 +0000 UTC m=+50.267206607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls") pod "image-registry-6689ff4699-g87zb" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3") : secret "image-registry-tls" not found Sep 15 07:25:32.055545 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:32.055504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:32.055723 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:32.055565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:32.055723 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:32.055587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:32.055723 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055683 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 07:25:32.055723 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055714 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 07:25:32.055869 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055697 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:40.055683646 +0000 UTC m=+50.367770255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : configmap references non-existent config key: service-ca.crt Sep 15 07:25:32.055869 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:32.055807 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:32.055869 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055820 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls podName:a300c8b2-2756-4435-9669-d71f2344876c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:40.055800779 +0000 UTC m=+50.367887387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls") pod "dns-default-776vd" (UID: "a300c8b2-2756-4435-9669-d71f2344876c") : secret "dns-default-metrics-tls" not found Sep 15 07:25:32.055869 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055843 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:40.055833411 +0000 UTC m=+50.367920021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : secret "router-metrics-certs-default" not found Sep 15 07:25:32.055994 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055872 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:32.055994 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:32.055912 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls podName:5f8a6ea6-2f70-431a-8cb1-3f910555b5f9 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:40.055902501 +0000 UTC m=+50.367989097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4795" (UID: "5f8a6ea6-2f70-431a-8cb1-3f910555b5f9") : secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:33.358193 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.358163 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" event={"ID":"f1ff0b49-45a2-41eb-a0f5-6ef9213473a2","Type":"ContainerStarted","Data":"4434396f06f4fab09d755454589fd33a37aa61b723c99ef28cbf8dcb124ff2dd"} Sep 15 07:25:33.361709 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.361682 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" event={"ID":"22e7418c-dd5c-4380-9847-b675ff57f53a","Type":"ContainerStarted","Data":"8599dfe594ddae95e5bde1e5a2a4a61af101225c6f9362c10b391c462fb5e678"} Sep 15 07:25:33.363395 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.363368 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" event={"ID":"7c6fd379-3cbd-4daa-a53e-cafeb557377c","Type":"ContainerStarted","Data":"a2336500b84cbb2052adeaf8d48267d70b22f5cf2d5d419aff7c20e84685316f"} Sep 15 07:25:33.365110 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.365086 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zhz57" event={"ID":"2199cd3e-575f-49ba-81ec-bb7085383b1a","Type":"ContainerStarted","Data":"88a5cfed5222fc485b8e39b4262d2f2d85a9d0b0985409db44aa42f13a751768"} Sep 15 07:25:33.366868 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.366849 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/0.log" Sep 15 07:25:33.366953 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.366890 2582 generic.go:356] "Generic (PLEG): container finished" podID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" containerID="548c830f2d9f80aafd70dd74f3ff172b4287d3e070245b97efc7644caaeff3a0" exitCode=255 Sep 15 07:25:33.367017 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.366958 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" event={"ID":"8c4db370-fbbc-42b0-852d-9b33bae6bfbf","Type":"ContainerDied","Data":"548c830f2d9f80aafd70dd74f3ff172b4287d3e070245b97efc7644caaeff3a0"} Sep 15 07:25:33.367240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.367222 2582 scope.go:117] "RemoveContainer" containerID="548c830f2d9f80aafd70dd74f3ff172b4287d3e070245b97efc7644caaeff3a0" Sep 15 07:25:33.368608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.368587 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5mlms" event={"ID":"cf9beb80-892c-43b0-92df-8685f8c7f567","Type":"ContainerStarted","Data":"11d4310cb75bea77eeb7f885074d5aa6e9e602dc91d7044a6e124ed61f355751"} Sep 15 07:25:33.406825 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.406772 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-6sbsl" podStartSLOduration=12.664369298 podStartE2EDuration="19.406755748s" totalImagesPullingTime="6.74238645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:33.405300358 +0000 UTC m=+43.717386975" watchObservedRunningTime="2026-09-15 07:25:33.406755748 +0000 UTC m=+43.718842359" Sep 15 07:25:33.431512 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.431459 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jrjjc" podStartSLOduration=13.78097043 podStartE2EDuration="43.431439623s" totalImagesPullingTime="29.650469193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:33.429146034 +0000 UTC m=+43.741232655" watchObservedRunningTime="2026-09-15 07:25:33.431439623 +0000 UTC m=+43.743526242" Sep 15 07:25:33.451831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.451783 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zhz57" podStartSLOduration=1.951799082 podStartE2EDuration="9.451766686s" totalImagesPullingTime="7.499967604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:33.450520665 +0000 UTC m=+43.762607281" watchObservedRunningTime="2026-09-15 07:25:33.451766686 +0000 UTC m=+43.763853303" Sep 15 07:25:33.475581 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.474089 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-5mlms" podStartSLOduration=11.979258642 podStartE2EDuration="19.474066921s" totalImagesPullingTime="7.494808279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:33.474055086 +0000 UTC m=+43.786141704" watchObservedRunningTime="2026-09-15 07:25:33.474066921 +0000 UTC m=+43.786153537" Sep 15 07:25:33.499405 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:33.498499 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-kjq4x" podStartSLOduration=12.010238372 podStartE2EDuration="19.498475172s" totalImagesPullingTime="7.4882368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:33.496786532 +0000 UTC m=+43.808873148" watchObservedRunningTime="2026-09-15 07:25:33.498475172 +0000 UTC m=+43.810561792" Sep 15 07:25:34.376075 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.375986 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" event={"ID":"89358f35-b2bb-4e0d-9091-fdb1497c54c5","Type":"ContainerStarted","Data":"c929f5c33ef8eb76c0a6db5a524c46cd4800ea845576244310c9c597b322d479"} Sep 15 07:25:34.378595 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.378564 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" event={"ID":"f40e5368-9f86-42ca-8127-c50b308b74da","Type":"ContainerStarted","Data":"44950e9a114ba48663a3374df0b554580d5f1e511f4f5d34c9ad322d962f9423"} Sep 15 07:25:34.380409 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.380385 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/1.log" Sep 15 07:25:34.380985 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.380966 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/0.log" Sep 15 07:25:34.381160 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.381142 2582 generic.go:356] "Generic (PLEG): container finished" podID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" containerID="1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844" exitCode=255 Sep 15 07:25:34.381307 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.381292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" event={"ID":"8c4db370-fbbc-42b0-852d-9b33bae6bfbf","Type":"ContainerDied","Data":"1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844"} Sep 15 07:25:34.382109 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.381488 2582 scope.go:117] "RemoveContainer" containerID="1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844" Sep 15 07:25:34.382109 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:34.381675 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-pq7qx_openshift-console-operator(8c4db370-fbbc-42b0-852d-9b33bae6bfbf)\"" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" podUID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" Sep 15 07:25:34.382350 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.382326 2582 scope.go:117] "RemoveContainer" containerID="548c830f2d9f80aafd70dd74f3ff172b4287d3e070245b97efc7644caaeff3a0" Sep 15 07:25:34.419549 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.419487 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" podStartSLOduration=12.532405521 podStartE2EDuration="20.419465892s" totalImagesPullingTime="7.887060371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:34.396962989 +0000 UTC m=+44.709049603" watchObservedRunningTime="2026-09-15 07:25:34.419465892 +0000 UTC m=+44.731552528" Sep 15 07:25:34.419683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.419585 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" podStartSLOduration=12.918420425 podStartE2EDuration="20.419577818s" totalImagesPullingTime="7.501157393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:34.418889295 +0000 UTC m=+44.730975946" watchObservedRunningTime="2026-09-15 07:25:34.419577818 +0000 UTC m=+44.731664436" Sep 15 07:25:34.425065 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.425039 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x95qw"] Sep 15 07:25:34.450889 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.450857 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x95qw"] Sep 15 07:25:34.451255 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.451168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.454200 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.454176 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 07:25:34.454320 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.454239 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 07:25:34.454684 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.454662 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wpwdh\"" Sep 15 07:25:34.483208 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.483148 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:34.483361 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.483235 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:34.577052 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.577013 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.577245 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.577175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a147f55f-988b-42f8-adbc-28b3b5a66e73-data-volume\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.577245 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.577215 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.577499 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.577479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqzbn\" (UniqueName: \"kubernetes.io/projected/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-api-access-lqzbn\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.580572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.578552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a147f55f-988b-42f8-adbc-28b3b5a66e73-crio-socket\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.679602 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.679564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqzbn\" (UniqueName: \"kubernetes.io/projected/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-api-access-lqzbn\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.679854 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.679653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a147f55f-988b-42f8-adbc-28b3b5a66e73-crio-socket\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.679854 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.679699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.679854 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.679735 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a147f55f-988b-42f8-adbc-28b3b5a66e73-data-volume\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.679854 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.679753 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.680073 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:34.679865 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 07:25:34.680073 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:34.679871 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 07:25:34.680073 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:34.679946 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:35.179924592 +0000 UTC m=+45.492011203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : secret "insights-runtime-extractor-tls" not found Sep 15 07:25:34.680073 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.679929 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a147f55f-988b-42f8-adbc-28b3b5a66e73-crio-socket\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.680073 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:34.679982 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:35.179967176 +0000 UTC m=+45.492053800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : configmap "kube-rbac-proxy" not found Sep 15 07:25:34.680287 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.680105 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a147f55f-988b-42f8-adbc-28b3b5a66e73-data-volume\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:34.689414 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:34.689381 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqzbn\" (UniqueName: \"kubernetes.io/projected/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-api-access-lqzbn\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:35.184522 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:35.184484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:35.184721 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:35.184590 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 07:25:35.184721 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:35.184641 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:35.184721 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:35.184654 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:36.184639918 +0000 UTC m=+46.496726512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : configmap "kube-rbac-proxy" not found Sep 15 07:25:35.184721 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:35.184710 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 07:25:35.184864 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:35.184752 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:36.184741118 +0000 UTC m=+46.496827719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : secret "insights-runtime-extractor-tls" not found Sep 15 07:25:35.386245 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:35.386213 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/1.log" Sep 15 07:25:35.386709 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:35.386564 2582 scope.go:117] "RemoveContainer" containerID="1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844" Sep 15 07:25:35.386778 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:35.386753 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-pq7qx_openshift-console-operator(8c4db370-fbbc-42b0-852d-9b33bae6bfbf)\"" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" podUID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" Sep 15 07:25:36.192658 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:36.192624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:36.192800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:36.192676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:36.192800 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:36.192762 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 07:25:36.192867 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:36.192836 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:38.192819933 +0000 UTC m=+48.504906533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : secret "insights-runtime-extractor-tls" not found Sep 15 07:25:36.192867 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:36.192768 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 07:25:36.192938 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:36.192905 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:38.192889781 +0000 UTC m=+48.504976381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : configmap "kube-rbac-proxy" not found Sep 15 07:25:36.198699 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:36.198678 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hxspg_978eb2dd-421d-48f8-bd57-0796552681c6/dns-node-resolver/0.log" Sep 15 07:25:36.389872 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:36.389839 2582 scope.go:117] "RemoveContainer" containerID="1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844" Sep 15 07:25:36.390297 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:36.390070 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-pq7qx_openshift-console-operator(8c4db370-fbbc-42b0-852d-9b33bae6bfbf)\"" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" podUID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" Sep 15 07:25:36.798940 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:36.798911 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cbtnf_810e9712-e1cf-4c1f-872c-c2e8a75c5a7e/node-ca/0.log" Sep 15 07:25:37.799126 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:37.799098 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zhz57_2199cd3e-575f-49ba-81ec-bb7085383b1a/serve-healthcheck-canary/0.log" Sep 15 07:25:38.209736 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:38.209705 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:38.209912 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:38.209827 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 07:25:38.209912 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:38.209844 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:38.209912 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:38.209894 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:42.209878608 +0000 UTC m=+52.521965219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : configmap "kube-rbac-proxy" not found Sep 15 07:25:38.210053 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:38.209938 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 07:25:38.210053 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:38.209981 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:42.209969642 +0000 UTC m=+52.522056250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : secret "insights-runtime-extractor-tls" not found Sep 15 07:25:40.029079 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.029038 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029183 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.029230 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029246 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls podName:d9891b26-ef68-45fc-a8d4-a41e4674c14c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.029230683 +0000 UTC m=+66.341317294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-x6v58" (UID: "d9891b26-ef68-45fc-a8d4-a41e4674c14c") : secret "samples-operator-tls" not found Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.029278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029309 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029321 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6689ff4699-g87zb: secret "image-registry-tls" not found Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029362 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls podName:f2ffe6c8-463a-4faf-b81c-abf31879d9d3 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.02935006 +0000 UTC m=+66.341436669 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls") pod "image-registry-6689ff4699-g87zb" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3") : secret "image-registry-tls" not found Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029385 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 07:25:40.029514 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.029413 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert podName:df8db835-dfab-4801-983d-b81d7f57e09d nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.02940626 +0000 UTC m=+66.341492855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-52gbg" (UID: "df8db835-dfab-4801-983d-b81d7f57e09d") : secret "networking-console-plugin-cert" not found Sep 15 07:25:40.130435 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.130396 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:40.130608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.130478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:40.130608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.130499 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:40.130608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:40.130519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:40.130608 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130555 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:40.130776 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130616 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 07:25:40.130776 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130630 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls podName:5f8a6ea6-2f70-431a-8cb1-3f910555b5f9 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.130610107 +0000 UTC m=+66.442696723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g4795" (UID: "5f8a6ea6-2f70-431a-8cb1-3f910555b5f9") : secret "cluster-monitoring-operator-tls" not found Sep 15 07:25:40.130776 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130648 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 07:25:40.130776 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130663 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls podName:a300c8b2-2756-4435-9669-d71f2344876c nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.130652463 +0000 UTC m=+66.442739058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls") pod "dns-default-776vd" (UID: "a300c8b2-2756-4435-9669-d71f2344876c") : secret "dns-default-metrics-tls" not found Sep 15 07:25:40.130776 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130702 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.130692282 +0000 UTC m=+66.442778883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : secret "router-metrics-certs-default" not found Sep 15 07:25:40.130776 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:40.130720 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle podName:5e800b6b-327a-4c28-bfb3-45e4ec352d3e nodeName:}" failed. No retries permitted until 2026-09-15 07:25:56.130710894 +0000 UTC m=+66.442797495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle") pod "router-default-ffbfb48c4-bx7kt" (UID: "5e800b6b-327a-4c28-bfb3-45e4ec352d3e") : configmap references non-existent config key: service-ca.crt Sep 15 07:25:42.247904 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:42.247852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:42.248332 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:42.247939 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:42.248332 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:42.248018 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 07:25:42.248332 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:42.248090 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls podName:a147f55f-988b-42f8-adbc-28b3b5a66e73 nodeName:}" failed. No retries permitted until 2026-09-15 07:25:50.248072494 +0000 UTC m=+60.560159090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x95qw" (UID: "a147f55f-988b-42f8-adbc-28b3b5a66e73") : secret "insights-runtime-extractor-tls" not found Sep 15 07:25:42.248493 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:42.248473 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a147f55f-988b-42f8-adbc-28b3b5a66e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:47.173217 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.173183 2582 scope.go:117] "RemoveContainer" containerID="1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844" Sep 15 07:25:47.423786 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.423719 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:25:47.424155 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.424141 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/1.log" Sep 15 07:25:47.424217 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.424174 2582 generic.go:356] "Generic (PLEG): container finished" podID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" containerID="0b9e62327dee91a6ee54a12a9ec21f354eef2fdb05e80cfaf7498e28c1670e9b" exitCode=255 Sep 15 07:25:47.424264 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.424215 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" event={"ID":"8c4db370-fbbc-42b0-852d-9b33bae6bfbf","Type":"ContainerDied","Data":"0b9e62327dee91a6ee54a12a9ec21f354eef2fdb05e80cfaf7498e28c1670e9b"} Sep 15 07:25:47.424264 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.424254 2582 scope.go:117] "RemoveContainer" containerID="1db57ca202c4ffca5b19c138a7c282ae1dcdd845285cf7c27cfcecf7572b9844" Sep 15 07:25:47.424700 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:47.424673 2582 scope.go:117] "RemoveContainer" containerID="0b9e62327dee91a6ee54a12a9ec21f354eef2fdb05e80cfaf7498e28c1670e9b" Sep 15 07:25:47.424874 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:47.424854 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-pq7qx_openshift-console-operator(8c4db370-fbbc-42b0-852d-9b33bae6bfbf)\"" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" podUID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" Sep 15 07:25:48.428106 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:48.428078 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:25:50.302469 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:50.302434 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zjk5k" Sep 15 07:25:50.320224 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:50.320188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:50.322259 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:50.322238 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a147f55f-988b-42f8-adbc-28b3b5a66e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x95qw\" (UID: \"a147f55f-988b-42f8-adbc-28b3b5a66e73\") " pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:50.363882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:50.363855 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wpwdh\"" Sep 15 07:25:50.371632 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:50.371612 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x95qw" Sep 15 07:25:50.647431 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:50.647403 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x95qw"] Sep 15 07:25:50.650363 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:50.650337 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda147f55f_988b_42f8_adbc_28b3b5a66e73.slice/crio-1a05e7ff7a6b65062253c5733b6f0508e4885cfb67ac03b40bbf3365b18c92e7 WatchSource:0}: Error finding container 1a05e7ff7a6b65062253c5733b6f0508e4885cfb67ac03b40bbf3365b18c92e7: Status 404 returned error can't find the container with id 1a05e7ff7a6b65062253c5733b6f0508e4885cfb67ac03b40bbf3365b18c92e7 Sep 15 07:25:51.439628 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:51.439598 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x95qw" event={"ID":"a147f55f-988b-42f8-adbc-28b3b5a66e73","Type":"ContainerStarted","Data":"b43265cf7ab79d0002534e95df765c63d54f246f3577dceaa19f48655cbaa533"} Sep 15 07:25:51.439987 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:51.439648 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x95qw" event={"ID":"a147f55f-988b-42f8-adbc-28b3b5a66e73","Type":"ContainerStarted","Data":"1a05e7ff7a6b65062253c5733b6f0508e4885cfb67ac03b40bbf3365b18c92e7"} Sep 15 07:25:54.482889 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:54.482856 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:54.483397 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:54.482921 2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:25:54.483397 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:54.483285 2582 scope.go:117] "RemoveContainer" containerID="0b9e62327dee91a6ee54a12a9ec21f354eef2fdb05e80cfaf7498e28c1670e9b" Sep 15 07:25:54.483518 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:25:54.483490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-pq7qx_openshift-console-operator(8c4db370-fbbc-42b0-852d-9b33bae6bfbf)\"" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" podUID="8c4db370-fbbc-42b0-852d-9b33bae6bfbf" Sep 15 07:25:55.458385 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.458351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x95qw" event={"ID":"a147f55f-988b-42f8-adbc-28b3b5a66e73","Type":"ContainerStarted","Data":"98cb51a8f0261a373c246c6c29d56804c7c21e945d5b947d1810ca18561b7fc6"} Sep 15 07:25:55.870380 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.870309 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:55.873349 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.873327 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 07:25:55.883244 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.883224 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e419fef2-f661-402e-995e-284a565c061f-original-pull-secret\") pod \"global-pull-secret-syncer-nknkw\" (UID: \"e419fef2-f661-402e-995e-284a565c061f\") " pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:55.971271 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.971235 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:55.971472 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.971336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:55.974393 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.974367 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjlf4\" (UniqueName: \"kubernetes.io/projected/c0483747-ec7d-4b7c-9121-4c766485e1d2-kube-api-access-zjlf4\") pod \"network-check-target-xq7k7\" (UID: \"c0483747-ec7d-4b7c-9121-4c766485e1d2\") " pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:55.974521 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.974476 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 07:25:55.984755 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:55.984729 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d209bf2-2892-4cac-8930-be58fc4fef6e-metrics-certs\") pod \"network-metrics-daemon-m2m5h\" (UID: \"5d209bf2-2892-4cac-8930-be58fc4fef6e\") " pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:56.072780 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.072739 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:56.072978 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.072874 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:56.072978 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.072930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:56.075667 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.075642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"image-registry-6689ff4699-g87zb\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:56.075667 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.075661 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9891b26-ef68-45fc-a8d4-a41e4674c14c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-x6v58\" (UID: \"d9891b26-ef68-45fc-a8d4-a41e4674c14c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:56.075852 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.075642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/df8db835-dfab-4801-983d-b81d7f57e09d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-52gbg\" (UID: \"df8db835-dfab-4801-983d-b81d7f57e09d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:56.087069 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.087043 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nknkw" Sep 15 07:25:56.113835 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.113808 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vrc7c\"" Sep 15 07:25:56.122313 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.122263 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:56.128228 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.128210 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4f6cz\"" Sep 15 07:25:56.135991 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.135973 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m2m5h" Sep 15 07:25:56.173674 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.173650 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:56.173784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.173703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:56.173784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.173726 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:56.173784 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.173751 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:56.174380 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.174358 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-service-ca-bundle\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:56.176272 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.176251 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f8a6ea6-2f70-431a-8cb1-3f910555b5f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g4795\" (UID: \"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:56.176417 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.176393 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e800b6b-327a-4c28-bfb3-45e4ec352d3e-metrics-certs\") pod \"router-default-ffbfb48c4-bx7kt\" (UID: \"5e800b6b-327a-4c28-bfb3-45e4ec352d3e\") " pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:56.176479 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.176424 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a300c8b2-2756-4435-9669-d71f2344876c-metrics-tls\") pod \"dns-default-776vd\" (UID: \"a300c8b2-2756-4435-9669-d71f2344876c\") " pod="openshift-dns/dns-default-776vd" Sep 15 07:25:56.228155 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.227899 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b2mnr\"" Sep 15 07:25:56.235682 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.235635 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:56.246601 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.246513 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4n6x7\"" Sep 15 07:25:56.254954 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.254875 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" Sep 15 07:25:56.300877 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.300816 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lx9pz\"" Sep 15 07:25:56.309231 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.309197 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" Sep 15 07:25:56.323317 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.323265 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8pfvn\"" Sep 15 07:25:56.331146 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.331109 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-776vd" Sep 15 07:25:56.341152 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.341128 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-29nmm\"" Sep 15 07:25:56.348804 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.348781 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" Sep 15 07:25:56.371194 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.371160 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l8t25\"" Sep 15 07:25:56.378837 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.378778 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:56.456928 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.456869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nknkw"] Sep 15 07:25:56.461683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.461466 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m2m5h"] Sep 15 07:25:56.461996 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.461956 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xq7k7"] Sep 15 07:25:56.464757 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:56.464356 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode419fef2_f661_402e_995e_284a565c061f.slice/crio-b5983fedc2b15069c6ba36d38cbb08a29e279c064d7916bce2560e524f574510 WatchSource:0}: Error finding container b5983fedc2b15069c6ba36d38cbb08a29e279c064d7916bce2560e524f574510: Status 404 returned error can't find the container with id b5983fedc2b15069c6ba36d38cbb08a29e279c064d7916bce2560e524f574510 Sep 15 07:25:56.532825 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.532801 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6689ff4699-g87zb"] Sep 15 07:25:56.540398 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:56.540374 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ffe6c8_463a_4faf_b81c_abf31879d9d3.slice/crio-b0a6867b1bf2027afd48a268594845d94b29fa5785af20d829fde9c90477dde4 WatchSource:0}: Error finding container b0a6867b1bf2027afd48a268594845d94b29fa5785af20d829fde9c90477dde4: Status 404 returned error can't find the container with id b0a6867b1bf2027afd48a268594845d94b29fa5785af20d829fde9c90477dde4 Sep 15 07:25:56.555639 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.555615 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg"] Sep 15 07:25:56.558251 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:56.558226 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8db835_dfab_4801_983d_b81d7f57e09d.slice/crio-19793875f73d85a8b99b8bf19d8ac4551746f6ddb72cabf063b814376716ae35 WatchSource:0}: Error finding container 19793875f73d85a8b99b8bf19d8ac4551746f6ddb72cabf063b814376716ae35: Status 404 returned error can't find the container with id 19793875f73d85a8b99b8bf19d8ac4551746f6ddb72cabf063b814376716ae35 Sep 15 07:25:56.605350 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.605322 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58"] Sep 15 07:25:56.679733 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.679701 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-776vd"] Sep 15 07:25:56.685152 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:56.685126 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda300c8b2_2756_4435_9669_d71f2344876c.slice/crio-e68a466d1c4443bb5e97396c6636cb81826c04c459954487abead45e19c3f226 WatchSource:0}: Error finding container e68a466d1c4443bb5e97396c6636cb81826c04c459954487abead45e19c3f226: Status 404 returned error can't find the container with id e68a466d1c4443bb5e97396c6636cb81826c04c459954487abead45e19c3f226 Sep 15 07:25:56.697386 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.697364 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795"] Sep 15 07:25:56.700030 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:56.700010 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-ffbfb48c4-bx7kt"] Sep 15 07:25:56.700740 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:56.700455 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8a6ea6_2f70_431a_8cb1_3f910555b5f9.slice/crio-b4d726d6f06c54a6afec6649e9f84a098833a2aefdd29e8452a2f260ca1897aa WatchSource:0}: Error finding container b4d726d6f06c54a6afec6649e9f84a098833a2aefdd29e8452a2f260ca1897aa: Status 404 returned error can't find the container with id b4d726d6f06c54a6afec6649e9f84a098833a2aefdd29e8452a2f260ca1897aa Sep 15 07:25:56.702714 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:25:56.702690 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e800b6b_327a_4c28_bfb3_45e4ec352d3e.slice/crio-c3d029e43f4495a08e2cc1c9e19d459560f7fdda7328ee3b29d125053290b42b WatchSource:0}: Error finding container c3d029e43f4495a08e2cc1c9e19d459560f7fdda7328ee3b29d125053290b42b: Status 404 returned error can't find the container with id c3d029e43f4495a08e2cc1c9e19d459560f7fdda7328ee3b29d125053290b42b Sep 15 07:25:57.474161 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.474122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x95qw" event={"ID":"a147f55f-988b-42f8-adbc-28b3b5a66e73","Type":"ContainerStarted","Data":"d119d4225d0550bf94ea7855f0ba48f78fe75fcafc3fc3828fb133ade1b658e1"} Sep 15 07:25:57.476280 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.476196 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" event={"ID":"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9","Type":"ContainerStarted","Data":"b4d726d6f06c54a6afec6649e9f84a098833a2aefdd29e8452a2f260ca1897aa"} Sep 15 07:25:57.478034 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.477963 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" event={"ID":"d9891b26-ef68-45fc-a8d4-a41e4674c14c","Type":"ContainerStarted","Data":"957381f901ddca925c54594e0b5eb4126631273114864b180a7e75f26f2172bd"} Sep 15 07:25:57.479917 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.479846 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" event={"ID":"df8db835-dfab-4801-983d-b81d7f57e09d","Type":"ContainerStarted","Data":"19793875f73d85a8b99b8bf19d8ac4551746f6ddb72cabf063b814376716ae35"} Sep 15 07:25:57.482675 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.482651 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nknkw" event={"ID":"e419fef2-f661-402e-995e-284a565c061f","Type":"ContainerStarted","Data":"b5983fedc2b15069c6ba36d38cbb08a29e279c064d7916bce2560e524f574510"} Sep 15 07:25:57.486656 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.486632 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xq7k7" event={"ID":"c0483747-ec7d-4b7c-9121-4c766485e1d2","Type":"ContainerStarted","Data":"8ca643bb86fce6190f496cf95c8256259d04118c1c4e3b7ae0ad9fdf074f8e06"} Sep 15 07:25:57.486774 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.486673 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xq7k7" event={"ID":"c0483747-ec7d-4b7c-9121-4c766485e1d2","Type":"ContainerStarted","Data":"ca1d14b40e2d782f11c0c59f71903c43902447d99ac66ef4356cb8d483950e70"} Sep 15 07:25:57.487154 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.487136 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:25:57.490198 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.489575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" event={"ID":"5e800b6b-327a-4c28-bfb3-45e4ec352d3e","Type":"ContainerStarted","Data":"b3453a33d4308d12bd8163b5972b2bb5a5ba19f94304afac0ced969fa4b2ce91"} Sep 15 07:25:57.490198 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.489613 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" event={"ID":"5e800b6b-327a-4c28-bfb3-45e4ec352d3e","Type":"ContainerStarted","Data":"c3d029e43f4495a08e2cc1c9e19d459560f7fdda7328ee3b29d125053290b42b"} Sep 15 07:25:57.492179 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.492114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-776vd" event={"ID":"a300c8b2-2756-4435-9669-d71f2344876c","Type":"ContainerStarted","Data":"e68a466d1c4443bb5e97396c6636cb81826c04c459954487abead45e19c3f226"} Sep 15 07:25:57.495248 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.495225 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" event={"ID":"f2ffe6c8-463a-4faf-b81c-abf31879d9d3","Type":"ContainerStarted","Data":"e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5"} Sep 15 07:25:57.495347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.495268 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" event={"ID":"f2ffe6c8-463a-4faf-b81c-abf31879d9d3","Type":"ContainerStarted","Data":"b0a6867b1bf2027afd48a268594845d94b29fa5785af20d829fde9c90477dde4"} Sep 15 07:25:57.495757 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.495738 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:25:57.498980 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.498957 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2m5h" event={"ID":"5d209bf2-2892-4cac-8930-be58fc4fef6e","Type":"ContainerStarted","Data":"8bc8fd251163ed19e5f41fa53c10b2d880b3ee5062e58381fb4fe8dda21ca573"} Sep 15 07:25:57.503910 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.503738 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x95qw" podStartSLOduration=17.873789628 podStartE2EDuration="23.50372086s" totalImagesPullingTime="5.629931232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:25:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:57.502374668 +0000 UTC m=+67.814461325" watchObservedRunningTime="2026-09-15 07:25:57.50372086 +0000 UTC m=+67.815807476" Sep 15 07:25:57.547057 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.546521 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" podStartSLOduration=43.546502298 podStartE2EDuration="43.546502298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:57.545813888 +0000 UTC m=+67.857900506" watchObservedRunningTime="2026-09-15 07:25:57.546502298 +0000 UTC m=+67.858588913" Sep 15 07:25:57.547057 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:57.546902 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" podStartSLOduration=66.546889528 podStartE2EDuration="1m6.546889528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:57.525877232 +0000 UTC m=+67.837963853" watchObservedRunningTime="2026-09-15 07:25:57.546889528 +0000 UTC m=+67.858976147" Sep 15 07:25:58.379491 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:58.379415 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:58.382717 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:58.382693 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:58.407610 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:58.407548 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xq7k7" podStartSLOduration=68.407507925 podStartE2EDuration="1m8.407507925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:25:57.564842327 +0000 UTC m=+67.876928946" watchObservedRunningTime="2026-09-15 07:25:58.407507925 +0000 UTC m=+68.719594543" Sep 15 07:25:58.504119 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:58.504024 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:25:58.505439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:25:58.505353 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-ffbfb48c4-bx7kt" Sep 15 07:26:00.512499 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.512455 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2m5h" event={"ID":"5d209bf2-2892-4cac-8930-be58fc4fef6e","Type":"ContainerStarted","Data":"284b3adf45e26f77b04b18bf4ccad939be5d45c68aa6378af04e38dd92881d57"} Sep 15 07:26:00.601018 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.600988 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22"] Sep 15 07:26:00.604383 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.604357 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.611061 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.610894 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 15 07:26:00.611061 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.610937 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 15 07:26:00.611259 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.611068 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 15 07:26:00.611259 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.611185 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 15 07:26:00.615515 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.615489 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22"] Sep 15 07:26:00.711752 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.711713 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.711752 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.711758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-tmp\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.711965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.711784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6g4\" (UniqueName: \"kubernetes.io/projected/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-kube-api-access-db6g4\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.812608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.812510 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.812608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.812575 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-tmp\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.812608 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.812603 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6g4\" (UniqueName: \"kubernetes.io/projected/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-kube-api-access-db6g4\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.813218 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.813187 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-tmp\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.815410 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.815386 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-klusterlet-config\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.829541 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.829493 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6g4\" (UniqueName: \"kubernetes.io/projected/53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb-kube-api-access-db6g4\") pod \"klusterlet-addon-workmgr-5569887d4c-4hz22\" (UID: \"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:00.922054 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:00.921998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:01.531276 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.531187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" event={"ID":"d9891b26-ef68-45fc-a8d4-a41e4674c14c","Type":"ContainerStarted","Data":"4dd2cae5013121fc482f6eef76db65954ba31e11950571f2320bcb95f646f64c"} Sep 15 07:26:01.541335 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.540435 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" event={"ID":"df8db835-dfab-4801-983d-b81d7f57e09d","Type":"ContainerStarted","Data":"31295dd2f7973961ca584bd704c082343d482fc19a988e98f1b16637b0b0b9d9"} Sep 15 07:26:01.542790 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.542710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-776vd" event={"ID":"a300c8b2-2756-4435-9669-d71f2344876c","Type":"ContainerStarted","Data":"40524b0482d28fd52330bc73b6be96614db5f6e87c34606c2c2f4a7bb877199b"} Sep 15 07:26:01.547230 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.547165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m2m5h" event={"ID":"5d209bf2-2892-4cac-8930-be58fc4fef6e","Type":"ContainerStarted","Data":"2e48a7061f6c853f511a0eec8b152c426772609f8e0bc38a7f7961cafff2d9bd"} Sep 15 07:26:01.550836 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.550345 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" event={"ID":"5f8a6ea6-2f70-431a-8cb1-3f910555b5f9","Type":"ContainerStarted","Data":"28661a52270012b0a0be24ff192baa0ca8c71cad7ff7c62ddb2284f26e528077"} Sep 15 07:26:01.566869 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.566738 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-52gbg" podStartSLOduration=44.220632192 podStartE2EDuration="47.566717831s" totalImagesPullingTime="3.346085639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:01.564951273 +0000 UTC m=+71.877037891" watchObservedRunningTime="2026-09-15 07:26:01.566717831 +0000 UTC m=+71.878804657" Sep 15 07:26:01.590333 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.590201 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m2m5h" podStartSLOduration=67.173598969 podStartE2EDuration="1m10.590184697s" totalImagesPullingTime="3.416585728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:01.588720451 +0000 UTC m=+71.900807069" watchObservedRunningTime="2026-09-15 07:26:01.590184697 +0000 UTC m=+71.902271315" Sep 15 07:26:01.622767 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.622125 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g4795" podStartSLOduration=44.416430138 podStartE2EDuration="47.622106524s" totalImagesPullingTime="3.205676386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:01.621609205 +0000 UTC m=+71.933695826" watchObservedRunningTime="2026-09-15 07:26:01.622106524 +0000 UTC m=+71.934193144" Sep 15 07:26:01.628116 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:01.627153 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22"] Sep 15 07:26:02.556923 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.556882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" event={"ID":"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb","Type":"ContainerStarted","Data":"ecea7699a72eb5b41f41b367a8af78985d3d1b792859b9a67b2523e8a6b20cc5"} Sep 15 07:26:02.559265 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.559190 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nknkw" event={"ID":"e419fef2-f661-402e-995e-284a565c061f","Type":"ContainerStarted","Data":"281d93f7bde2ce74ea090ee4fbef16ec46110dad9d40e92521b24470fa7ec882"} Sep 15 07:26:02.561601 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.561571 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-776vd" event={"ID":"a300c8b2-2756-4435-9669-d71f2344876c","Type":"ContainerStarted","Data":"64f24fab55ccc0892e5c8c0cdb83ff49d98a43aa7623e76f7a3dec99b693ed75"} Sep 15 07:26:02.561845 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.561815 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-776vd" Sep 15 07:26:02.564233 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.564188 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" event={"ID":"d9891b26-ef68-45fc-a8d4-a41e4674c14c","Type":"ContainerStarted","Data":"9eeca7dc7caa78bed7a4042f0593853bf2c11ac9a5e1a13d1949df3e8d75134c"} Sep 15 07:26:02.579441 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.579371 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nknkw" podStartSLOduration=66.601169577 podStartE2EDuration="1m11.579353186s" totalImagesPullingTime="4.978183609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 07:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:02.578614311 +0000 UTC m=+72.890700931" watchObservedRunningTime="2026-09-15 07:26:02.579353186 +0000 UTC m=+72.891439806" Sep 15 07:26:02.625579 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.625489 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-776vd" podStartSLOduration=35.399729125 podStartE2EDuration="38.625463933s" totalImagesPullingTime="3.225734808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:02.624656917 +0000 UTC m=+72.936743534" watchObservedRunningTime="2026-09-15 07:26:02.625463933 +0000 UTC m=+72.937550552" Sep 15 07:26:02.626465 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:02.626414 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-x6v58" podStartSLOduration=45.371612596 podStartE2EDuration="48.626397215s" totalImagesPullingTime="3.254784619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:02.601115407 +0000 UTC m=+72.913202027" watchObservedRunningTime="2026-09-15 07:26:02.626397215 +0000 UTC m=+72.938483831" Sep 15 07:26:06.588640 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:06.588604 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" event={"ID":"53fa29ba-3f50-49fe-b4a1-1c20fc8e7aeb","Type":"ContainerStarted","Data":"1889bfd6324489b15cd8f485d20fdd09b28a327897985647cb02b21ef06e65d2"} Sep 15 07:26:06.589026 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:06.588815 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:06.590373 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:06.590347 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" Sep 15 07:26:06.609815 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:06.609651 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5569887d4c-4hz22" podStartSLOduration=2.458118131 podStartE2EDuration="6.609622593s" totalImagesPullingTime="4.151504462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:06.608801627 +0000 UTC m=+76.920888254" watchObservedRunningTime="2026-09-15 07:26:06.609622593 +0000 UTC m=+76.921709210" Sep 15 07:26:09.172811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:09.172781 2582 scope.go:117] "RemoveContainer" containerID="0b9e62327dee91a6ee54a12a9ec21f354eef2fdb05e80cfaf7498e28c1670e9b" Sep 15 07:26:09.601603 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:09.601512 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:26:09.601747 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:09.601631 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" event={"ID":"8c4db370-fbbc-42b0-852d-9b33bae6bfbf","Type":"ContainerStarted","Data":"a2146bb0f405341ee5b39a4a09ce46157deb4df28707b5ee3e29974fc02debd6"} Sep 15 07:26:09.601920 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:09.601898 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:26:09.606480 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:09.606457 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" Sep 15 07:26:09.623432 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:09.623385 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-pq7qx" podStartSLOduration=48.13217972 podStartE2EDuration="55.623369607s" totalImagesPullingTime="7.491189887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:09.621890211 +0000 UTC m=+79.933976828" watchObservedRunningTime="2026-09-15 07:26:09.623369607 +0000 UTC m=+79.935456223" Sep 15 07:26:12.578996 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:12.578966 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-776vd" Sep 15 07:26:14.873624 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.873587 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8777r"] Sep 15 07:26:14.878042 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.878020 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:14.882192 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.882170 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 07:26:14.884478 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.884423 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 07:26:14.884478 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.884468 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 07:26:14.893016 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.892999 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b9qbs\"" Sep 15 07:26:14.893160 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:14.893146 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 07:26:15.030265 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030428 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3587893-1b14-46cb-8f67-84f39ce8e83f-metrics-client-ca\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030428 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-wtmp\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030428 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-root\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030428 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030407 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-textfile\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030589 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-tls\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030589 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clpnn\" (UniqueName: \"kubernetes.io/projected/a3587893-1b14-46cb-8f67-84f39ce8e83f-kube-api-access-clpnn\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030589 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-sys\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.030589 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.030557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131594 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131651 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3587893-1b14-46cb-8f67-84f39ce8e83f-metrics-client-ca\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131695 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-wtmp\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131723 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-root\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-textfile\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-tls\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clpnn\" (UniqueName: \"kubernetes.io/projected/a3587893-1b14-46cb-8f67-84f39ce8e83f-kube-api-access-clpnn\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131828 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-root\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131833 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-sys\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131879 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-sys\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.131905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131895 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.132274 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.131897 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-wtmp\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.132274 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.132121 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-textfile\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.132353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.132296 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3587893-1b14-46cb-8f67-84f39ce8e83f-metrics-client-ca\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.132353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.132296 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-accelerators-collector-config\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.134149 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.134128 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-tls\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.134258 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.134169 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3587893-1b14-46cb-8f67-84f39ce8e83f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.141136 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.141116 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clpnn\" (UniqueName: \"kubernetes.io/projected/a3587893-1b14-46cb-8f67-84f39ce8e83f-kube-api-access-clpnn\") pod \"node-exporter-8777r\" (UID: \"a3587893-1b14-46cb-8f67-84f39ce8e83f\") " pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.187539 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.187494 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8777r" Sep 15 07:26:15.200190 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:26:15.200159 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3587893_1b14_46cb_8f67_84f39ce8e83f.slice/crio-95ee602c4ab4ec9e159bc8950c7448e5532b6f71c649fb44612116923e731050 WatchSource:0}: Error finding container 95ee602c4ab4ec9e159bc8950c7448e5532b6f71c649fb44612116923e731050: Status 404 returned error can't find the container with id 95ee602c4ab4ec9e159bc8950c7448e5532b6f71c649fb44612116923e731050 Sep 15 07:26:15.624669 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:15.624633 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8777r" event={"ID":"a3587893-1b14-46cb-8f67-84f39ce8e83f","Type":"ContainerStarted","Data":"95ee602c4ab4ec9e159bc8950c7448e5532b6f71c649fb44612116923e731050"} Sep 15 07:26:16.241166 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:16.241128 2582 patch_prober.go:28] interesting pod/image-registry-6689ff4699-g87zb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 15 07:26:16.241547 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:16.241189 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" podUID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 15 07:26:16.629591 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:16.629558 2582 generic.go:356] "Generic (PLEG): container finished" podID="a3587893-1b14-46cb-8f67-84f39ce8e83f" containerID="89aa53ffb1d5170aa1e983a126fa3a188162ac42bf7e0d6f5d3da2554c819913" exitCode=0 Sep 15 07:26:16.629752 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:16.629609 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8777r" event={"ID":"a3587893-1b14-46cb-8f67-84f39ce8e83f","Type":"ContainerDied","Data":"89aa53ffb1d5170aa1e983a126fa3a188162ac42bf7e0d6f5d3da2554c819913"} Sep 15 07:26:17.635270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:17.635231 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8777r" event={"ID":"a3587893-1b14-46cb-8f67-84f39ce8e83f","Type":"ContainerStarted","Data":"822832270a312f77545ef7560e3cf352c9ec28f54605d055470d21e028ebffdc"} Sep 15 07:26:17.635716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:17.635296 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8777r" event={"ID":"a3587893-1b14-46cb-8f67-84f39ce8e83f","Type":"ContainerStarted","Data":"1341e8e469157c7f38a4085ade7d646ccf0462ac52dcfd58c0068fbb436ffb33"} Sep 15 07:26:17.661254 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:17.661201 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8777r" podStartSLOduration=2.777581687 podStartE2EDuration="3.661184748s" totalImagesPullingTime="820.768312ms" totalInitContainerRuntime="62.834749ms" isStatefulPod=true podCreationTimestamp="2026-09-15 07:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:17.659062224 +0000 UTC m=+87.971148843" watchObservedRunningTime="2026-09-15 07:26:17.661184748 +0000 UTC m=+87.973271365" Sep 15 07:26:19.511233 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:19.511205 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:26:23.990380 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:23.990337 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75dc98955d-w65w8"] Sep 15 07:26:23.994905 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:23.994882 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.000807 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.000784 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 15 07:26:24.001926 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.001907 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 15 07:26:24.002176 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.002152 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 15 07:26:24.002176 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.002171 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 15 07:26:24.002347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.002188 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qxjsw\"" Sep 15 07:26:24.002347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.002215 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 15 07:26:24.002347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.002236 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 15 07:26:24.002347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.002189 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 15 07:26:24.008904 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.008885 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 15 07:26:24.013165 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.013145 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dc98955d-w65w8"] Sep 15 07:26:24.100809 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100771 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-serving-cert\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.100986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100833 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-config\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.100986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-trusted-ca-bundle\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.100986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-oauth-serving-cert\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.100986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100933 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-service-ca\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.100986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-oauth-config\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.100986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.100987 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2tzk\" (UniqueName: \"kubernetes.io/projected/59daef61-9620-4bf9-9d1c-ba5a7656f90a-kube-api-access-n2tzk\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202317 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-trusted-ca-bundle\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202550 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-oauth-serving-cert\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202550 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202363 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-service-ca\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202550 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-oauth-config\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202550 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202432 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2tzk\" (UniqueName: \"kubernetes.io/projected/59daef61-9620-4bf9-9d1c-ba5a7656f90a-kube-api-access-n2tzk\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202550 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-serving-cert\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.202550 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.202548 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-config\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.203232 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.203204 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-service-ca\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.203348 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.203217 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-oauth-serving-cert\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.203391 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.203360 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-config\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.203634 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.203609 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-trusted-ca-bundle\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.204992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.204953 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-oauth-config\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.205201 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.205181 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-serving-cert\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.211947 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.211925 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2tzk\" (UniqueName: \"kubernetes.io/projected/59daef61-9620-4bf9-9d1c-ba5a7656f90a-kube-api-access-n2tzk\") pod \"console-75dc98955d-w65w8\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.306717 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.306629 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:24.587865 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.587794 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75dc98955d-w65w8"] Sep 15 07:26:24.590761 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:26:24.590732 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59daef61_9620_4bf9_9d1c_ba5a7656f90a.slice/crio-f3a211370a31f1dc7df6027eeea5a73012e489bdfa50bae7555ecf7c653413de WatchSource:0}: Error finding container f3a211370a31f1dc7df6027eeea5a73012e489bdfa50bae7555ecf7c653413de: Status 404 returned error can't find the container with id f3a211370a31f1dc7df6027eeea5a73012e489bdfa50bae7555ecf7c653413de Sep 15 07:26:24.662286 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:24.662252 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc98955d-w65w8" event={"ID":"59daef61-9620-4bf9-9d1c-ba5a7656f90a","Type":"ContainerStarted","Data":"f3a211370a31f1dc7df6027eeea5a73012e489bdfa50bae7555ecf7c653413de"} Sep 15 07:26:25.208141 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:25.208107 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6689ff4699-g87zb"] Sep 15 07:26:27.677147 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:27.677055 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc98955d-w65w8" event={"ID":"59daef61-9620-4bf9-9d1c-ba5a7656f90a","Type":"ContainerStarted","Data":"61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb"} Sep 15 07:26:27.696012 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:27.695952 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75dc98955d-w65w8" podStartSLOduration=1.89742506 podStartE2EDuration="4.695936869s" totalImagesPullingTime="2.798511809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:26:27.69485814 +0000 UTC m=+98.006944757" watchObservedRunningTime="2026-09-15 07:26:27.695936869 +0000 UTC m=+98.008023486" Sep 15 07:26:29.509798 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:29.509763 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xq7k7" Sep 15 07:26:34.307636 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:34.307601 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:34.308119 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:34.307669 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:34.312344 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:34.312321 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:34.706604 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:34.706568 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:26:43.738449 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:43.738417 2582 generic.go:356] "Generic (PLEG): container finished" podID="cf9beb80-892c-43b0-92df-8685f8c7f567" containerID="11d4310cb75bea77eeb7f885074d5aa6e9e602dc91d7044a6e124ed61f355751" exitCode=0 Sep 15 07:26:43.738923 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:43.738493 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5mlms" event={"ID":"cf9beb80-892c-43b0-92df-8685f8c7f567","Type":"ContainerDied","Data":"11d4310cb75bea77eeb7f885074d5aa6e9e602dc91d7044a6e124ed61f355751"} Sep 15 07:26:43.738997 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:43.738924 2582 scope.go:117] "RemoveContainer" containerID="11d4310cb75bea77eeb7f885074d5aa6e9e602dc91d7044a6e124ed61f355751" Sep 15 07:26:44.576261 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:44.576234 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffbfb48c4-bx7kt_5e800b6b-327a-4c28-bfb3-45e4ec352d3e/router/0.log" Sep 15 07:26:44.604494 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:44.604467 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zhz57_2199cd3e-575f-49ba-81ec-bb7085383b1a/serve-healthcheck-canary/0.log" Sep 15 07:26:44.743290 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:44.743256 2582 generic.go:356] "Generic (PLEG): container finished" podID="89358f35-b2bb-4e0d-9091-fdb1497c54c5" containerID="c929f5c33ef8eb76c0a6db5a524c46cd4800ea845576244310c9c597b322d479" exitCode=0 Sep 15 07:26:44.743739 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:44.743330 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" event={"ID":"89358f35-b2bb-4e0d-9091-fdb1497c54c5","Type":"ContainerDied","Data":"c929f5c33ef8eb76c0a6db5a524c46cd4800ea845576244310c9c597b322d479"} Sep 15 07:26:44.743739 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:44.743676 2582 scope.go:117] "RemoveContainer" containerID="c929f5c33ef8eb76c0a6db5a524c46cd4800ea845576244310c9c597b322d479" Sep 15 07:26:44.745285 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:44.745267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-5mlms" event={"ID":"cf9beb80-892c-43b0-92df-8685f8c7f567","Type":"ContainerStarted","Data":"5c49a4bc7549a4ca9363f6ddb0ee96979ffcf9f1e7f4a82eced18a3e44ee511f"} Sep 15 07:26:45.750900 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:45.750865 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-4fzjl" event={"ID":"89358f35-b2bb-4e0d-9091-fdb1497c54c5","Type":"ContainerStarted","Data":"4bf6bfba31c11134013a5717e1136161d1224bbb77fff122bd3ba6a5567ab84f"} Sep 15 07:26:50.235512 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.235459 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" podUID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" containerName="registry" containerID="cri-o://e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5" gracePeriod=30 Sep 15 07:26:50.484767 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.484739 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:26:50.601122 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601035 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-installation-pull-secrets\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601122 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601083 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-image-registry-private-configuration\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601122 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601110 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-trusted-ca\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601130 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-bound-sa-token\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601149 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftpjb\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-kube-api-access-ftpjb\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601170 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-certificates\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601198 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-ca-trust-extracted\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601218 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") pod \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\" (UID: \"f2ffe6c8-463a-4faf-b81c-abf31879d9d3\") " Sep 15 07:26:50.601728 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601694 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:26:50.601814 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.601783 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:26:50.603769 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.603741 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-kube-api-access-ftpjb" (OuterVolumeSpecName: "kube-api-access-ftpjb") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "kube-api-access-ftpjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:26:50.603885 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.603820 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:26:50.603956 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.603936 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:26:50.604083 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.604061 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:26:50.604248 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.604228 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:26:50.609874 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.609846 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f2ffe6c8-463a-4faf-b81c-abf31879d9d3" (UID: "f2ffe6c8-463a-4faf-b81c-abf31879d9d3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:26:50.701803 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701762 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-image-registry-private-configuration\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.701803 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701799 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-trusted-ca\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.702004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701813 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-bound-sa-token\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.702004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701824 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftpjb\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-kube-api-access-ftpjb\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.702004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701837 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-certificates\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.702004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701876 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-ca-trust-extracted\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.702004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701887 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.702004 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.701899 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2ffe6c8-463a-4faf-b81c-abf31879d9d3-installation-pull-secrets\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:26:50.770048 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.770013 2582 generic.go:356] "Generic (PLEG): container finished" podID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" containerID="e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5" exitCode=0 Sep 15 07:26:50.770214 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.770059 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" Sep 15 07:26:50.770214 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.770071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" event={"ID":"f2ffe6c8-463a-4faf-b81c-abf31879d9d3","Type":"ContainerDied","Data":"e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5"} Sep 15 07:26:50.770214 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.770136 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6689ff4699-g87zb" event={"ID":"f2ffe6c8-463a-4faf-b81c-abf31879d9d3","Type":"ContainerDied","Data":"b0a6867b1bf2027afd48a268594845d94b29fa5785af20d829fde9c90477dde4"} Sep 15 07:26:50.770214 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.770155 2582 scope.go:117] "RemoveContainer" containerID="e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5" Sep 15 07:26:50.779299 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.779280 2582 scope.go:117] "RemoveContainer" containerID="e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5" Sep 15 07:26:50.779581 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:26:50.779559 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5\": container with ID starting with e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5 not found: ID does not exist" containerID="e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5" Sep 15 07:26:50.779637 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.779589 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5"} err="failed to get container status \"e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5\": rpc error: code = NotFound desc = could not find container \"e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5\": container with ID starting with e766f165dcba2f7390cc0843209c2e1246690d1f92201c198122251c96312eb5 not found: ID does not exist" Sep 15 07:26:50.793613 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.793581 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6689ff4699-g87zb"] Sep 15 07:26:50.799563 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:50.799504 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6689ff4699-g87zb"] Sep 15 07:26:52.177234 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:52.177199 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" path="/var/lib/kubelet/pods/f2ffe6c8-463a-4faf-b81c-abf31879d9d3/volumes" Sep 15 07:26:54.794021 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:54.793989 2582 generic.go:356] "Generic (PLEG): container finished" podID="f40e5368-9f86-42ca-8127-c50b308b74da" containerID="44950e9a114ba48663a3374df0b554580d5f1e511f4f5d34c9ad322d962f9423" exitCode=0 Sep 15 07:26:54.794432 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:54.794041 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" event={"ID":"f40e5368-9f86-42ca-8127-c50b308b74da","Type":"ContainerDied","Data":"44950e9a114ba48663a3374df0b554580d5f1e511f4f5d34c9ad322d962f9423"} Sep 15 07:26:54.794432 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:54.794338 2582 scope.go:117] "RemoveContainer" containerID="44950e9a114ba48663a3374df0b554580d5f1e511f4f5d34c9ad322d962f9423" Sep 15 07:26:55.800628 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:26:55.800572 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-jpkvr" event={"ID":"f40e5368-9f86-42ca-8127-c50b308b74da","Type":"ContainerStarted","Data":"1511d717883942092d985ac217219e1e2158e52d831f89bb4b6882a44d05a3d2"} Sep 15 07:27:44.656328 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.656253 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b5f77f66-4btr9"] Sep 15 07:27:44.656878 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.656589 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" containerName="registry" Sep 15 07:27:44.656878 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.656603 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" containerName="registry" Sep 15 07:27:44.656878 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.656659 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ffe6c8-463a-4faf-b81c-abf31879d9d3" containerName="registry" Sep 15 07:27:44.659721 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.659698 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.672185 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.672159 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b5f77f66-4btr9"] Sep 15 07:27:44.819998 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.819964 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-serving-cert\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.820179 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.820019 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-service-ca\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.820179 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.820090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-oauth-config\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.820179 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.820134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-trusted-ca-bundle\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.820179 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.820150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5jpf\" (UniqueName: \"kubernetes.io/projected/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-kube-api-access-c5jpf\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.820334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.820206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-config\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.820334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.820230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-oauth-serving-cert\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921232 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921141 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-service-ca\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921232 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-oauth-config\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921232 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921225 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-trusted-ca-bundle\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921250 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5jpf\" (UniqueName: \"kubernetes.io/projected/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-kube-api-access-c5jpf\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-config\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921308 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-oauth-serving-cert\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.921503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.921344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-serving-cert\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.922051 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.922021 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-service-ca\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.922166 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.922123 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-config\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.922234 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.922206 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-trusted-ca-bundle\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.922234 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.922221 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-oauth-serving-cert\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.923730 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.923709 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-serving-cert\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.923802 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.923750 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-oauth-config\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.929925 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.929908 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5jpf\" (UniqueName: \"kubernetes.io/projected/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-kube-api-access-c5jpf\") pod \"console-56b5f77f66-4btr9\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:44.970523 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:44.970496 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:45.267070 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:45.267014 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b5f77f66-4btr9"] Sep 15 07:27:45.269397 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:27:45.269369 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b793f5_c4f0_4a2e_8e65_26acd7fdbc45.slice/crio-157fb3da7ae18ced7a91ce583ad8fac8770d4df4885414c66cc334873b90fd3c WatchSource:0}: Error finding container 157fb3da7ae18ced7a91ce583ad8fac8770d4df4885414c66cc334873b90fd3c: Status 404 returned error can't find the container with id 157fb3da7ae18ced7a91ce583ad8fac8770d4df4885414c66cc334873b90fd3c Sep 15 07:27:45.988061 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:45.988024 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b5f77f66-4btr9" event={"ID":"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45","Type":"ContainerStarted","Data":"b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91"} Sep 15 07:27:45.988460 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:45.988073 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b5f77f66-4btr9" event={"ID":"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45","Type":"ContainerStarted","Data":"157fb3da7ae18ced7a91ce583ad8fac8770d4df4885414c66cc334873b90fd3c"} Sep 15 07:27:46.008038 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:46.007973 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b5f77f66-4btr9" podStartSLOduration=2.007952547 podStartE2EDuration="2.007952547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:27:46.005316056 +0000 UTC m=+176.317402673" watchObservedRunningTime="2026-09-15 07:27:46.007952547 +0000 UTC m=+176.320039166" Sep 15 07:27:54.971594 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:54.971557 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:54.971987 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:54.971620 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:54.976348 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:54.976322 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:55.026480 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:55.026445 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:27:55.072843 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:27:55.072815 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75dc98955d-w65w8"] Sep 15 07:28:20.094796 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.094751 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75dc98955d-w65w8" podUID="59daef61-9620-4bf9-9d1c-ba5a7656f90a" containerName="console" containerID="cri-o://61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb" gracePeriod=15 Sep 15 07:28:20.332915 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.332892 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:28:20.406803 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406771 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-service-ca\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.406986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406816 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-oauth-serving-cert\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.406986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406859 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2tzk\" (UniqueName: \"kubernetes.io/projected/59daef61-9620-4bf9-9d1c-ba5a7656f90a-kube-api-access-n2tzk\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.406986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406881 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-oauth-config\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.406986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406899 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-trusted-ca-bundle\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.406986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406928 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-config\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.406986 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.406973 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-serving-cert\") pod \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\" (UID: \"59daef61-9620-4bf9-9d1c-ba5a7656f90a\") " Sep 15 07:28:20.407293 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.407202 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-service-ca" (OuterVolumeSpecName: "service-ca") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:28:20.407362 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.407319 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:28:20.407417 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.407361 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-config" (OuterVolumeSpecName: "console-config") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:28:20.407417 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.407398 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:28:20.409089 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.409064 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:28:20.409212 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.409109 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:28:20.409212 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.409135 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59daef61-9620-4bf9-9d1c-ba5a7656f90a-kube-api-access-n2tzk" (OuterVolumeSpecName: "kube-api-access-n2tzk") pod "59daef61-9620-4bf9-9d1c-ba5a7656f90a" (UID: "59daef61-9620-4bf9-9d1c-ba5a7656f90a"). InnerVolumeSpecName "kube-api-access-n2tzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:28:20.508228 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508192 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:20.508228 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508221 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-serving-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:20.508228 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508231 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-service-ca\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:20.508228 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508240 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-oauth-serving-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:20.508498 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508249 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2tzk\" (UniqueName: \"kubernetes.io/projected/59daef61-9620-4bf9-9d1c-ba5a7656f90a-kube-api-access-n2tzk\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:20.508498 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508257 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59daef61-9620-4bf9-9d1c-ba5a7656f90a-console-oauth-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:20.508498 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:20.508266 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59daef61-9620-4bf9-9d1c-ba5a7656f90a-trusted-ca-bundle\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:28:21.120014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.119980 2582 generic.go:356] "Generic (PLEG): container finished" podID="59daef61-9620-4bf9-9d1c-ba5a7656f90a" containerID="61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb" exitCode=0 Sep 15 07:28:21.120445 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.120026 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75dc98955d-w65w8" Sep 15 07:28:21.120445 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.120058 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc98955d-w65w8" event={"ID":"59daef61-9620-4bf9-9d1c-ba5a7656f90a","Type":"ContainerDied","Data":"61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb"} Sep 15 07:28:21.120445 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.120112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75dc98955d-w65w8" event={"ID":"59daef61-9620-4bf9-9d1c-ba5a7656f90a","Type":"ContainerDied","Data":"f3a211370a31f1dc7df6027eeea5a73012e489bdfa50bae7555ecf7c653413de"} Sep 15 07:28:21.120445 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.120139 2582 scope.go:117] "RemoveContainer" containerID="61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb" Sep 15 07:28:21.128375 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.128360 2582 scope.go:117] "RemoveContainer" containerID="61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb" Sep 15 07:28:21.128672 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:28:21.128653 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb\": container with ID starting with 61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb not found: ID does not exist" containerID="61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb" Sep 15 07:28:21.128742 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.128680 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb"} err="failed to get container status \"61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb\": rpc error: code = NotFound desc = could not find container \"61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb\": container with ID starting with 61ffb0a4874cb26eb7a8e3f0e67325e9457a0b2df05e58e1a0c23c57b99e91fb not found: ID does not exist" Sep 15 07:28:21.142520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.142485 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75dc98955d-w65w8"] Sep 15 07:28:21.146999 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:21.146976 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75dc98955d-w65w8"] Sep 15 07:28:22.176824 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:22.176787 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59daef61-9620-4bf9-9d1c-ba5a7656f90a" path="/var/lib/kubelet/pods/59daef61-9620-4bf9-9d1c-ba5a7656f90a/volumes" Sep 15 07:28:52.662807 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.662772 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b84744cc4-nt9c8"] Sep 15 07:28:52.663238 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.663052 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59daef61-9620-4bf9-9d1c-ba5a7656f90a" containerName="console" Sep 15 07:28:52.663238 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.663067 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59daef61-9620-4bf9-9d1c-ba5a7656f90a" containerName="console" Sep 15 07:28:52.663238 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.663126 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="59daef61-9620-4bf9-9d1c-ba5a7656f90a" containerName="console" Sep 15 07:28:52.667379 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.667353 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.685113 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.685083 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b84744cc4-nt9c8"] Sep 15 07:28:52.758116 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-oauth-config\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.758116 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-trusted-ca-bundle\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.758329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758139 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmncl\" (UniqueName: \"kubernetes.io/projected/07cf8a7f-1f41-4a53-982f-6970df4a8d85-kube-api-access-bmncl\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.758329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-service-ca\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.758329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-config\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.758329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-oauth-serving-cert\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.758483 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.758341 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-serving-cert\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859143 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-service-ca\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859143 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859146 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-config\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859331 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-oauth-serving-cert\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859331 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-serving-cert\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859420 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859383 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-oauth-config\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859476 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-trusted-ca-bundle\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859557 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859481 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmncl\" (UniqueName: \"kubernetes.io/projected/07cf8a7f-1f41-4a53-982f-6970df4a8d85-kube-api-access-bmncl\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.859975 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859946 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-service-ca\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.860089 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.859956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-config\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.860089 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.860080 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-oauth-serving-cert\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.860331 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.860305 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-trusted-ca-bundle\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.862139 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.862115 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-oauth-config\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.862329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.862309 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-serving-cert\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.868069 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.868047 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmncl\" (UniqueName: \"kubernetes.io/projected/07cf8a7f-1f41-4a53-982f-6970df4a8d85-kube-api-access-bmncl\") pod \"console-6b84744cc4-nt9c8\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:52.977288 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:52.977211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:28:53.249064 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:53.248994 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b84744cc4-nt9c8"] Sep 15 07:28:53.252295 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:28:53.252263 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cf8a7f_1f41_4a53_982f_6970df4a8d85.slice/crio-388991138a7be8848cc83c1b280089d8b675de8fbc7f8a31269b7d7522a45d9a WatchSource:0}: Error finding container 388991138a7be8848cc83c1b280089d8b675de8fbc7f8a31269b7d7522a45d9a: Status 404 returned error can't find the container with id 388991138a7be8848cc83c1b280089d8b675de8fbc7f8a31269b7d7522a45d9a Sep 15 07:28:54.237696 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:54.237647 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b84744cc4-nt9c8" event={"ID":"07cf8a7f-1f41-4a53-982f-6970df4a8d85","Type":"ContainerStarted","Data":"d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c"} Sep 15 07:28:54.238075 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:54.237717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b84744cc4-nt9c8" event={"ID":"07cf8a7f-1f41-4a53-982f-6970df4a8d85","Type":"ContainerStarted","Data":"388991138a7be8848cc83c1b280089d8b675de8fbc7f8a31269b7d7522a45d9a"} Sep 15 07:28:54.257890 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:28:54.257843 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b84744cc4-nt9c8" podStartSLOduration=2.257826634 podStartE2EDuration="2.257826634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:28:54.257303478 +0000 UTC m=+244.569390095" watchObservedRunningTime="2026-09-15 07:28:54.257826634 +0000 UTC m=+244.569913250" Sep 15 07:29:02.978280 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:02.978242 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:29:02.978776 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:02.978316 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:29:02.983407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:02.983378 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:29:03.273071 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:03.273000 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:29:03.329866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:03.329817 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b5f77f66-4btr9"] Sep 15 07:29:28.351300 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.351217 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56b5f77f66-4btr9" podUID="12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" containerName="console" containerID="cri-o://b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91" gracePeriod=15 Sep 15 07:29:28.586126 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.586105 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:29:28.747184 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747152 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-serving-cert\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747219 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-config\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747250 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-service-ca\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747277 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-oauth-serving-cert\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747299 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-oauth-config\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747318 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-trusted-ca-bundle\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747338 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5jpf\" (UniqueName: \"kubernetes.io/projected/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-kube-api-access-c5jpf\") pod \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\" (UID: \"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45\") " Sep 15 07:29:28.747866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747830 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-config" (OuterVolumeSpecName: "console-config") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:29:28.747866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747843 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:29:28.748018 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.747859 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-service-ca" (OuterVolumeSpecName: "service-ca") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:29:28.748072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.748004 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:29:28.749447 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.749427 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:29:28.749524 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.749447 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:29:28.749524 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.749502 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-kube-api-access-c5jpf" (OuterVolumeSpecName: "kube-api-access-c5jpf") pod "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" (UID: "12b793f5-c4f0-4a2e-8e65-26acd7fdbc45"). InnerVolumeSpecName "kube-api-access-c5jpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:29:28.848703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848662 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:28.848703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848696 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-service-ca\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:28.848703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848705 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-oauth-serving-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:28.848703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848714 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-oauth-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:28.848972 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848722 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-trusted-ca-bundle\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:28.848972 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848732 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5jpf\" (UniqueName: \"kubernetes.io/projected/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-kube-api-access-c5jpf\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:28.848972 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:28.848740 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45-console-serving-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:29:29.364519 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.364481 2582 generic.go:356] "Generic (PLEG): container finished" podID="12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" containerID="b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91" exitCode=0 Sep 15 07:29:29.364935 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.364543 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b5f77f66-4btr9" Sep 15 07:29:29.364935 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.364559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b5f77f66-4btr9" event={"ID":"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45","Type":"ContainerDied","Data":"b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91"} Sep 15 07:29:29.364935 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.364611 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b5f77f66-4btr9" event={"ID":"12b793f5-c4f0-4a2e-8e65-26acd7fdbc45","Type":"ContainerDied","Data":"157fb3da7ae18ced7a91ce583ad8fac8770d4df4885414c66cc334873b90fd3c"} Sep 15 07:29:29.364935 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.364631 2582 scope.go:117] "RemoveContainer" containerID="b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91" Sep 15 07:29:29.373091 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.373077 2582 scope.go:117] "RemoveContainer" containerID="b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91" Sep 15 07:29:29.373355 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:29:29.373340 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91\": container with ID starting with b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91 not found: ID does not exist" containerID="b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91" Sep 15 07:29:29.373393 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.373364 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91"} err="failed to get container status \"b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91\": rpc error: code = NotFound desc = could not find container \"b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91\": container with ID starting with b2fc12cdd2701fa36df2d6afc0d7fb3615065d819def312077acab043067ab91 not found: ID does not exist" Sep 15 07:29:29.385127 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.385102 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b5f77f66-4btr9"] Sep 15 07:29:29.390883 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:29.390860 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56b5f77f66-4btr9"] Sep 15 07:29:30.176742 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:30.176711 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" path="/var/lib/kubelet/pods/12b793f5-c4f0-4a2e-8e65-26acd7fdbc45/volumes" Sep 15 07:29:50.114914 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:50.114881 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:29:50.119845 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:50.119819 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:29:50.125236 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:29:50.125212 2582 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 07:31:46.214211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.214178 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6"] Sep 15 07:31:46.214687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.214437 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" containerName="console" Sep 15 07:31:46.214687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.214448 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" containerName="console" Sep 15 07:31:46.214687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.214508 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="12b793f5-c4f0-4a2e-8e65-26acd7fdbc45" containerName="console" Sep 15 07:31:46.217197 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.217181 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:31:46.220222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.220203 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 15 07:31:46.221427 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.221410 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-6xhwj\"" Sep 15 07:31:46.221525 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.221461 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 15 07:31:46.235392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.235370 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6"] Sep 15 07:31:46.295091 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.295053 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2n9w\" (UniqueName: \"kubernetes.io/projected/ecb56446-865d-41ad-bf91-040771f33d70-kube-api-access-h2n9w\") pod \"feast-operator-controller-manager-5d99cf7779-jk7n6\" (UID: \"ecb56446-865d-41ad-bf91-040771f33d70\") " pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:31:46.396221 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.396183 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2n9w\" (UniqueName: \"kubernetes.io/projected/ecb56446-865d-41ad-bf91-040771f33d70-kube-api-access-h2n9w\") pod \"feast-operator-controller-manager-5d99cf7779-jk7n6\" (UID: \"ecb56446-865d-41ad-bf91-040771f33d70\") " pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:31:46.405153 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.405128 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2n9w\" (UniqueName: \"kubernetes.io/projected/ecb56446-865d-41ad-bf91-040771f33d70-kube-api-access-h2n9w\") pod \"feast-operator-controller-manager-5d99cf7779-jk7n6\" (UID: \"ecb56446-865d-41ad-bf91-040771f33d70\") " pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:31:46.527720 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.527639 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:31:46.796216 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.796191 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6"] Sep 15 07:31:46.798353 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:31:46.798323 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb56446_865d_41ad_bf91_040771f33d70.slice/crio-0fb61b69b234536a7370cb05d312ff7ce12dd5c635e98dce97ff3933b254626e WatchSource:0}: Error finding container 0fb61b69b234536a7370cb05d312ff7ce12dd5c635e98dce97ff3933b254626e: Status 404 returned error can't find the container with id 0fb61b69b234536a7370cb05d312ff7ce12dd5c635e98dce97ff3933b254626e Sep 15 07:31:46.800284 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.800266 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 07:31:46.871520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:46.871485 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" event={"ID":"ecb56446-865d-41ad-bf91-040771f33d70","Type":"ContainerStarted","Data":"0fb61b69b234536a7370cb05d312ff7ce12dd5c635e98dce97ff3933b254626e"} Sep 15 07:31:49.891163 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:49.891126 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" event={"ID":"ecb56446-865d-41ad-bf91-040771f33d70","Type":"ContainerStarted","Data":"f0f7b46cdf1ac6c599c93e9cc2ca044523b9f10bb92dee47f3062909dbe64692"} Sep 15 07:31:49.891580 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:49.891347 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:31:49.907318 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:49.907270 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" podStartSLOduration=1.649770535 podStartE2EDuration="3.907253599s" totalImagesPullingTime="2.257483064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:31:49.90628515 +0000 UTC m=+420.218371766" watchObservedRunningTime="2026-09-15 07:31:49.907253599 +0000 UTC m=+420.219340266" Sep 15 07:31:58.974837 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:58.974804 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-664d97fd7d-xd8j7"] Sep 15 07:31:58.978319 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:58.978294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:58.989762 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:58.989737 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d97fd7d-xd8j7"] Sep 15 07:31:59.099070 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-oauth-config\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.099240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099079 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-service-ca\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.099240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099161 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-trusted-ca-bundle\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.099240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099190 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xz62\" (UniqueName: \"kubernetes.io/projected/4e1b62cd-38cc-4844-aca7-6bce1e65137e-kube-api-access-8xz62\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.099240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-serving-cert\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.099240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099234 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-config\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.099435 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.099251 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-oauth-serving-cert\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.199864 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.199829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-trusted-ca-bundle\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.199864 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.199868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xz62\" (UniqueName: \"kubernetes.io/projected/4e1b62cd-38cc-4844-aca7-6bce1e65137e-kube-api-access-8xz62\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200106 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.199903 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-serving-cert\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200106 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-config\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200106 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-oauth-serving-cert\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200260 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-oauth-config\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200260 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-service-ca\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200806 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200783 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-oauth-serving-cert\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.200941 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200924 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-service-ca\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.201005 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200925 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-trusted-ca-bundle\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.201005 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.200926 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-config\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.202463 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.202439 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-serving-cert\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.202573 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.202520 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e1b62cd-38cc-4844-aca7-6bce1e65137e-console-oauth-config\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.208839 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.208820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xz62\" (UniqueName: \"kubernetes.io/projected/4e1b62cd-38cc-4844-aca7-6bce1e65137e-kube-api-access-8xz62\") pod \"console-664d97fd7d-xd8j7\" (UID: \"4e1b62cd-38cc-4844-aca7-6bce1e65137e\") " pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.288518 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.288431 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:31:59.561962 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.561891 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-664d97fd7d-xd8j7"] Sep 15 07:31:59.928511 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.928477 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d97fd7d-xd8j7" event={"ID":"4e1b62cd-38cc-4844-aca7-6bce1e65137e","Type":"ContainerStarted","Data":"69efe50cb77487491ccccfbed966bcbc1376b3c7579ca10eb8188a506065e12a"} Sep 15 07:31:59.928703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.928565 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-664d97fd7d-xd8j7" event={"ID":"4e1b62cd-38cc-4844-aca7-6bce1e65137e","Type":"ContainerStarted","Data":"f6ca24d6f09893235ca4d057ad7c3af2164ee1d7e97d093bb67570a1aa64df49"} Sep 15 07:31:59.947231 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:31:59.947180 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-664d97fd7d-xd8j7" podStartSLOduration=1.94716461 podStartE2EDuration="1.94716461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:31:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:31:59.946108786 +0000 UTC m=+430.258195426" watchObservedRunningTime="2026-09-15 07:31:59.94716461 +0000 UTC m=+430.259251226" Sep 15 07:32:00.897645 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:00.897613 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:32:09.288688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:09.288652 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:32:09.289128 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:09.288710 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:32:09.293345 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:09.293321 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:32:09.969564 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:09.969519 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-664d97fd7d-xd8j7" Sep 15 07:32:10.051433 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:10.051403 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b84744cc4-nt9c8"] Sep 15 07:32:35.070413 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.070322 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b84744cc4-nt9c8" podUID="07cf8a7f-1f41-4a53-982f-6970df4a8d85" containerName="console" containerID="cri-o://d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c" gracePeriod=15 Sep 15 07:32:35.306765 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.306739 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:32:35.380211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380130 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-oauth-serving-cert\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380173 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-serving-cert\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380192 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmncl\" (UniqueName: \"kubernetes.io/projected/07cf8a7f-1f41-4a53-982f-6970df4a8d85-kube-api-access-bmncl\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380211 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-trusted-ca-bundle\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380494 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380290 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-oauth-config\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380494 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380314 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-service-ca\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380494 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380347 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-config\") pod \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\" (UID: \"07cf8a7f-1f41-4a53-982f-6970df4a8d85\") " Sep 15 07:32:35.380800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380762 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-service-ca" (OuterVolumeSpecName: "service-ca") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:32:35.380919 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380830 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:32:35.380919 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380836 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-config" (OuterVolumeSpecName: "console-config") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:32:35.381049 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.380927 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:32:35.382468 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.382446 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:32:35.382559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.382463 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07cf8a7f-1f41-4a53-982f-6970df4a8d85-kube-api-access-bmncl" (OuterVolumeSpecName: "kube-api-access-bmncl") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "kube-api-access-bmncl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:32:35.382559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.382473 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07cf8a7f-1f41-4a53-982f-6970df4a8d85" (UID: "07cf8a7f-1f41-4a53-982f-6970df4a8d85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:32:35.481162 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481125 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-oauth-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:35.481162 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481155 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-service-ca\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:35.481162 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481165 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-config\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:35.481392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481175 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-oauth-serving-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:35.481392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481183 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07cf8a7f-1f41-4a53-982f-6970df4a8d85-console-serving-cert\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:35.481392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481192 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmncl\" (UniqueName: \"kubernetes.io/projected/07cf8a7f-1f41-4a53-982f-6970df4a8d85-kube-api-access-bmncl\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:35.481392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:35.481200 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07cf8a7f-1f41-4a53-982f-6970df4a8d85-trusted-ca-bundle\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:32:36.060801 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.060767 2582 generic.go:356] "Generic (PLEG): container finished" podID="07cf8a7f-1f41-4a53-982f-6970df4a8d85" containerID="d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c" exitCode=0 Sep 15 07:32:36.060945 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.060812 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b84744cc4-nt9c8" Sep 15 07:32:36.060945 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.060826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b84744cc4-nt9c8" event={"ID":"07cf8a7f-1f41-4a53-982f-6970df4a8d85","Type":"ContainerDied","Data":"d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c"} Sep 15 07:32:36.060945 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.060870 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b84744cc4-nt9c8" event={"ID":"07cf8a7f-1f41-4a53-982f-6970df4a8d85","Type":"ContainerDied","Data":"388991138a7be8848cc83c1b280089d8b675de8fbc7f8a31269b7d7522a45d9a"} Sep 15 07:32:36.060945 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.060888 2582 scope.go:117] "RemoveContainer" containerID="d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c" Sep 15 07:32:36.069269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.069252 2582 scope.go:117] "RemoveContainer" containerID="d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c" Sep 15 07:32:36.069501 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:32:36.069482 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c\": container with ID starting with d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c not found: ID does not exist" containerID="d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c" Sep 15 07:32:36.069576 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.069509 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c"} err="failed to get container status \"d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c\": rpc error: code = NotFound desc = could not find container \"d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c\": container with ID starting with d70cbbc9cbcb1cd2f9e8548a2b3218169b676a03e8c159f54dbbcf401487685c not found: ID does not exist" Sep 15 07:32:36.081690 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.081668 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b84744cc4-nt9c8"] Sep 15 07:32:36.085281 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.085263 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b84744cc4-nt9c8"] Sep 15 07:32:36.177393 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:32:36.177363 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07cf8a7f-1f41-4a53-982f-6970df4a8d85" path="/var/lib/kubelet/pods/07cf8a7f-1f41-4a53-982f-6970df4a8d85/volumes" Sep 15 07:34:50.139201 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:34:50.139156 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:34:50.142073 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:34:50.142044 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:38:04.650355 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.650325 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-sf99c"] Sep 15 07:38:04.650899 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.650768 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07cf8a7f-1f41-4a53-982f-6970df4a8d85" containerName="console" Sep 15 07:38:04.650899 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.650788 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="07cf8a7f-1f41-4a53-982f-6970df4a8d85" containerName="console" Sep 15 07:38:04.650899 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.650858 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="07cf8a7f-1f41-4a53-982f-6970df4a8d85" containerName="console" Sep 15 07:38:04.653747 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.653727 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.656971 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.656952 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 15 07:38:04.656971 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.656961 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 07:38:04.658136 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.658116 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 07:38:04.658253 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.658134 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-j64rw\"" Sep 15 07:38:04.663069 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.663045 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-sf99c"] Sep 15 07:38:04.721715 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.721681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-postgresdata\") pod \"postgres-864846d4f5-sf99c\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.721924 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.721733 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl94f\" (UniqueName: \"kubernetes.io/projected/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-kube-api-access-vl94f\") pod \"postgres-864846d4f5-sf99c\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.822322 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.822290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-postgresdata\") pod \"postgres-864846d4f5-sf99c\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.822490 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.822342 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl94f\" (UniqueName: \"kubernetes.io/projected/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-kube-api-access-vl94f\") pod \"postgres-864846d4f5-sf99c\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.822689 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.822670 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-postgresdata\") pod \"postgres-864846d4f5-sf99c\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.832258 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.832229 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl94f\" (UniqueName: \"kubernetes.io/projected/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-kube-api-access-vl94f\") pod \"postgres-864846d4f5-sf99c\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:04.971493 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:04.971408 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:38:05.238202 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:05.238111 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-sf99c"] Sep 15 07:38:05.240889 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:38:05.240862 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded2c7cc6_5d67_4fa7_b4fd_1e88a162bc21.slice/crio-8655c8941e642d52fc321f3603f465c36f4044653c78cabd276d83f2f63524d9 WatchSource:0}: Error finding container 8655c8941e642d52fc321f3603f465c36f4044653c78cabd276d83f2f63524d9: Status 404 returned error can't find the container with id 8655c8941e642d52fc321f3603f465c36f4044653c78cabd276d83f2f63524d9 Sep 15 07:38:05.242694 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:05.242678 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 07:38:05.271475 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:05.271445 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-sf99c" event={"ID":"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21","Type":"ContainerStarted","Data":"8655c8941e642d52fc321f3603f465c36f4044653c78cabd276d83f2f63524d9"} Sep 15 07:38:10.294070 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:10.293988 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-sf99c" event={"ID":"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21","Type":"ContainerStarted","Data":"3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904"} Sep 15 07:38:10.309607 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:10.309564 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-sf99c" podStartSLOduration=1.6297374310000001 podStartE2EDuration="6.309549936s" totalImagesPullingTime="4.679812505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:38:10.308784183 +0000 UTC m=+800.620870801" watchObservedRunningTime="2026-09-15 07:38:10.309549936 +0000 UTC m=+800.621636550" Sep 15 07:38:40.130200 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.130164 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-mp2lz"] Sep 15 07:38:40.140124 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.140089 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:38:40.142866 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.142833 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-mp2lz"] Sep 15 07:38:40.143009 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.142983 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 15 07:38:40.143075 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.143012 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-x2r22\"" Sep 15 07:38:40.307710 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.307673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzptv\" (UniqueName: \"kubernetes.io/projected/4845612d-65ea-4021-9b58-b8816ea926e9-kube-api-access-bzptv\") pod \"feast-test-apply-mp2lz\" (UID: \"4845612d-65ea-4021-9b58-b8816ea926e9\") " pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:38:40.408198 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.408172 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzptv\" (UniqueName: \"kubernetes.io/projected/4845612d-65ea-4021-9b58-b8816ea926e9-kube-api-access-bzptv\") pod \"feast-test-apply-mp2lz\" (UID: \"4845612d-65ea-4021-9b58-b8816ea926e9\") " pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:38:40.417644 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.417620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzptv\" (UniqueName: \"kubernetes.io/projected/4845612d-65ea-4021-9b58-b8816ea926e9-kube-api-access-bzptv\") pod \"feast-test-apply-mp2lz\" (UID: \"4845612d-65ea-4021-9b58-b8816ea926e9\") " pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:38:40.449522 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.449496 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:38:40.717722 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:40.717645 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-mp2lz"] Sep 15 07:38:40.720938 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:38:40.720914 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4845612d_65ea_4021_9b58_b8816ea926e9.slice/crio-4e546cb40c17df903c645e88b3851fd9fbf3f6a5fb31f7e550a692c611db1bfa WatchSource:0}: Error finding container 4e546cb40c17df903c645e88b3851fd9fbf3f6a5fb31f7e550a692c611db1bfa: Status 404 returned error can't find the container with id 4e546cb40c17df903c645e88b3851fd9fbf3f6a5fb31f7e550a692c611db1bfa Sep 15 07:38:41.408507 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:41.408422 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-mp2lz" event={"ID":"4845612d-65ea-4021-9b58-b8816ea926e9","Type":"ContainerStarted","Data":"4e546cb40c17df903c645e88b3851fd9fbf3f6a5fb31f7e550a692c611db1bfa"} Sep 15 07:38:45.430329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:45.430294 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-mp2lz" event={"ID":"4845612d-65ea-4021-9b58-b8816ea926e9","Type":"ContainerStarted","Data":"4be2108439506130ac44355b4cd1ba03ab4c08442dc515090b9a583945557f10"} Sep 15 07:38:52.458185 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:52.458152 2582 generic.go:356] "Generic (PLEG): container finished" podID="4845612d-65ea-4021-9b58-b8816ea926e9" containerID="4be2108439506130ac44355b4cd1ba03ab4c08442dc515090b9a583945557f10" exitCode=0 Sep 15 07:38:52.458586 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:52.458219 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-mp2lz" event={"ID":"4845612d-65ea-4021-9b58-b8816ea926e9","Type":"ContainerDied","Data":"4be2108439506130ac44355b4cd1ba03ab4c08442dc515090b9a583945557f10"} Sep 15 07:38:53.464154 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:53.464116 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-mp2lz" event={"ID":"4845612d-65ea-4021-9b58-b8816ea926e9","Type":"ContainerStarted","Data":"e57417760aa70c7e2ed64a5e65140f049229ab9a892fbdd3d7e5bf6eeed8d0eb"} Sep 15 07:38:53.482685 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:38:53.482623 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-mp2lz" podStartSLOduration=2.290305274 podStartE2EDuration="13.482602707s" totalImagesPullingTime="4.566646375s" totalInitContainerRuntime="6.625651058s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:38:53.481735862 +0000 UTC m=+843.793822480" watchObservedRunningTime="2026-09-15 07:38:53.482602707 +0000 UTC m=+843.794689325" Sep 15 07:39:02.500675 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:02.500596 2582 generic.go:356] "Generic (PLEG): container finished" podID="4845612d-65ea-4021-9b58-b8816ea926e9" containerID="e57417760aa70c7e2ed64a5e65140f049229ab9a892fbdd3d7e5bf6eeed8d0eb" exitCode=0 Sep 15 07:39:02.500675 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:02.500672 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-mp2lz" event={"ID":"4845612d-65ea-4021-9b58-b8816ea926e9","Type":"ContainerDied","Data":"e57417760aa70c7e2ed64a5e65140f049229ab9a892fbdd3d7e5bf6eeed8d0eb"} Sep 15 07:39:03.638025 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:03.637998 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:39:03.683259 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:03.683220 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzptv\" (UniqueName: \"kubernetes.io/projected/4845612d-65ea-4021-9b58-b8816ea926e9-kube-api-access-bzptv\") pod \"4845612d-65ea-4021-9b58-b8816ea926e9\" (UID: \"4845612d-65ea-4021-9b58-b8816ea926e9\") " Sep 15 07:39:03.685413 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:03.685387 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4845612d-65ea-4021-9b58-b8816ea926e9-kube-api-access-bzptv" (OuterVolumeSpecName: "kube-api-access-bzptv") pod "4845612d-65ea-4021-9b58-b8816ea926e9" (UID: "4845612d-65ea-4021-9b58-b8816ea926e9"). InnerVolumeSpecName "kube-api-access-bzptv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:39:03.784513 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:03.784424 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzptv\" (UniqueName: \"kubernetes.io/projected/4845612d-65ea-4021-9b58-b8816ea926e9-kube-api-access-bzptv\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:39:04.509821 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:04.509750 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-mp2lz" Sep 15 07:39:04.509821 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:04.509772 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-mp2lz" event={"ID":"4845612d-65ea-4021-9b58-b8816ea926e9","Type":"ContainerDied","Data":"4e546cb40c17df903c645e88b3851fd9fbf3f6a5fb31f7e550a692c611db1bfa"} Sep 15 07:39:04.509821 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:04.509806 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e546cb40c17df903c645e88b3851fd9fbf3f6a5fb31f7e550a692c611db1bfa" Sep 15 07:39:04.684957 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:04.684928 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-mp2lz_4845612d-65ea-4021-9b58-b8816ea926e9/feast-0/0.log" Sep 15 07:39:04.691314 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:04.691274 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-mp2lz_4845612d-65ea-4021-9b58-b8816ea926e9/feast-1/0.log" Sep 15 07:39:41.879417 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:41.879381 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-mp2lz"] Sep 15 07:39:41.881573 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:41.881548 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-mp2lz"] Sep 15 07:39:41.889210 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:41.889185 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-sf99c"] Sep 15 07:39:41.889380 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:41.889359 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-sf99c" podUID="ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" containerName="postgres" containerID="cri-o://3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904" gracePeriod=30 Sep 15 07:39:42.132935 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.132880 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:39:42.178369 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.178337 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4845612d-65ea-4021-9b58-b8816ea926e9" path="/var/lib/kubelet/pods/4845612d-65ea-4021-9b58-b8816ea926e9/volumes" Sep 15 07:39:42.180304 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.180277 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl94f\" (UniqueName: \"kubernetes.io/projected/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-kube-api-access-vl94f\") pod \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " Sep 15 07:39:42.180432 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.180353 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-postgresdata\") pod \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\" (UID: \"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21\") " Sep 15 07:39:42.182247 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.182218 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-kube-api-access-vl94f" (OuterVolumeSpecName: "kube-api-access-vl94f") pod "ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" (UID: "ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21"). InnerVolumeSpecName "kube-api-access-vl94f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:39:42.209398 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.209369 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" (UID: "ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:39:42.281390 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.281356 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl94f\" (UniqueName: \"kubernetes.io/projected/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-kube-api-access-vl94f\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:39:42.281390 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.281384 2582 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21-postgresdata\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:39:42.660703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.660616 2582 generic.go:356] "Generic (PLEG): container finished" podID="ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" containerID="3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904" exitCode=0 Sep 15 07:39:42.660703 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.660667 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-sf99c" Sep 15 07:39:42.660966 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.660702 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-sf99c" event={"ID":"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21","Type":"ContainerDied","Data":"3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904"} Sep 15 07:39:42.660966 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.660747 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-sf99c" event={"ID":"ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21","Type":"ContainerDied","Data":"8655c8941e642d52fc321f3603f465c36f4044653c78cabd276d83f2f63524d9"} Sep 15 07:39:42.660966 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.660765 2582 scope.go:117] "RemoveContainer" containerID="3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904" Sep 15 07:39:42.669177 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.669160 2582 scope.go:117] "RemoveContainer" containerID="3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904" Sep 15 07:39:42.669481 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:39:42.669457 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904\": container with ID starting with 3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904 not found: ID does not exist" containerID="3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904" Sep 15 07:39:42.669544 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.669489 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904"} err="failed to get container status \"3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904\": rpc error: code = NotFound desc = could not find container \"3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904\": container with ID starting with 3d39009532d4129c1e44ac16fb6f8fed499847707b080453fef0b4220c58d904 not found: ID does not exist" Sep 15 07:39:42.685597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.685571 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-sf99c"] Sep 15 07:39:42.691349 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:42.691328 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-sf99c"] Sep 15 07:39:44.176685 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:44.176647 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" path="/var/lib/kubelet/pods/ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21/volumes" Sep 15 07:39:50.170545 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:50.170495 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:39:50.170974 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:39:50.170717 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:44:50.196831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:44:50.196799 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:44:50.198281 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:44:50.198255 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:44:50.227334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:44:50.227308 2582 scope.go:117] "RemoveContainer" containerID="4be2108439506130ac44355b4cd1ba03ab4c08442dc515090b9a583945557f10" Sep 15 07:45:50.239956 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:45:50.239923 2582 scope.go:117] "RemoveContainer" containerID="e57417760aa70c7e2ed64a5e65140f049229ab9a892fbdd3d7e5bf6eeed8d0eb" Sep 15 07:46:14.811269 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811236 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-2mltq"] Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811576 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4845612d-65ea-4021-9b58-b8816ea926e9" containerName="feast-1" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811591 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4845612d-65ea-4021-9b58-b8816ea926e9" containerName="feast-1" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811605 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4845612d-65ea-4021-9b58-b8816ea926e9" containerName="feast-0" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811611 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4845612d-65ea-4021-9b58-b8816ea926e9" containerName="feast-0" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811621 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" containerName="postgres" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811627 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" containerName="postgres" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811712 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2c7cc6-5d67-4fa7-b4fd-1e88a162bc21" containerName="postgres" Sep 15 07:46:14.813643 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.811738 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4845612d-65ea-4021-9b58-b8816ea926e9" containerName="feast-1" Sep 15 07:46:14.814559 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.814540 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:46:14.817662 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.817636 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 15 07:46:14.817778 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.817728 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-kqbgx\"" Sep 15 07:46:14.817830 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.817727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 15 07:46:14.826589 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.826565 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-2mltq"] Sep 15 07:46:14.873063 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.873020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfcl9\" (UniqueName: \"kubernetes.io/projected/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe-kube-api-access-mfcl9\") pod \"redis-69bbd798b6-2mltq\" (UID: \"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe\") " pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:46:14.974126 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.974085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfcl9\" (UniqueName: \"kubernetes.io/projected/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe-kube-api-access-mfcl9\") pod \"redis-69bbd798b6-2mltq\" (UID: \"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe\") " pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:46:14.982479 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:14.982452 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfcl9\" (UniqueName: \"kubernetes.io/projected/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe-kube-api-access-mfcl9\") pod \"redis-69bbd798b6-2mltq\" (UID: \"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe\") " pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:46:15.133788 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:15.133691 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:46:15.403193 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:15.402831 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-2mltq"] Sep 15 07:46:15.405539 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:46:15.405495 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e9983c6_3864_4a34_9ef7_d4e4cddd0ffe.slice/crio-41cf7a04659baaf5ed7e3b70ff0a63bc20025eb1060e6d694dc944274cdc3c7b WatchSource:0}: Error finding container 41cf7a04659baaf5ed7e3b70ff0a63bc20025eb1060e6d694dc944274cdc3c7b: Status 404 returned error can't find the container with id 41cf7a04659baaf5ed7e3b70ff0a63bc20025eb1060e6d694dc944274cdc3c7b Sep 15 07:46:15.407387 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:15.407372 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 07:46:16.144996 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:16.144964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" event={"ID":"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe","Type":"ContainerStarted","Data":"41cf7a04659baaf5ed7e3b70ff0a63bc20025eb1060e6d694dc944274cdc3c7b"} Sep 15 07:46:17.150023 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:17.149987 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" event={"ID":"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe","Type":"ContainerStarted","Data":"5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994"} Sep 15 07:46:17.166840 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:17.166783 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" podStartSLOduration=1.70787675 podStartE2EDuration="3.166765258s" totalImagesPullingTime="1.458888508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:46:17.165756309 +0000 UTC m=+1287.477842927" watchObservedRunningTime="2026-09-15 07:46:17.166765258 +0000 UTC m=+1287.478851874" Sep 15 07:46:20.224772 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.224740 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-j6zfj"] Sep 15 07:46:20.227973 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.227949 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.230492 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.230470 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 15 07:46:20.233700 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.233678 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-j6zfj"] Sep 15 07:46:20.322309 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.322275 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-postgresdata\") pod \"postgres-864846d4f5-j6zfj\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.322309 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.322310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c2cn\" (UniqueName: \"kubernetes.io/projected/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-kube-api-access-2c2cn\") pod \"postgres-864846d4f5-j6zfj\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.423501 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.423471 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-postgresdata\") pod \"postgres-864846d4f5-j6zfj\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.423664 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.423566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2cn\" (UniqueName: \"kubernetes.io/projected/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-kube-api-access-2c2cn\") pod \"postgres-864846d4f5-j6zfj\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.423819 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.423799 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-postgresdata\") pod \"postgres-864846d4f5-j6zfj\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.431972 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.431949 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c2cn\" (UniqueName: \"kubernetes.io/projected/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-kube-api-access-2c2cn\") pod \"postgres-864846d4f5-j6zfj\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.538954 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.538868 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:46:20.805995 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:20.805923 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-j6zfj"] Sep 15 07:46:20.810316 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:46:20.810284 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe347d6c_8e4b_4e03_81bd_35764cc2d4f7.slice/crio-2619d4f7f903d0051405cfb12400b1a7b2824b3cf0d0e54463f09cf92553e2e5 WatchSource:0}: Error finding container 2619d4f7f903d0051405cfb12400b1a7b2824b3cf0d0e54463f09cf92553e2e5: Status 404 returned error can't find the container with id 2619d4f7f903d0051405cfb12400b1a7b2824b3cf0d0e54463f09cf92553e2e5 Sep 15 07:46:21.165694 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:21.165654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" event={"ID":"be347d6c-8e4b-4e03-81bd-35764cc2d4f7","Type":"ContainerStarted","Data":"0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c"} Sep 15 07:46:21.165883 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:21.165710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" event={"ID":"be347d6c-8e4b-4e03-81bd-35764cc2d4f7","Type":"ContainerStarted","Data":"2619d4f7f903d0051405cfb12400b1a7b2824b3cf0d0e54463f09cf92553e2e5"} Sep 15 07:46:21.181184 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:46:21.181126 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" podStartSLOduration=1.181104447 podStartE2EDuration="1.181104447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:46:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:46:21.180182223 +0000 UTC m=+1291.492268839" watchObservedRunningTime="2026-09-15 07:46:21.181104447 +0000 UTC m=+1291.493191066" Sep 15 07:48:40.456074 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.456043 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6"] Sep 15 07:48:40.456641 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.456251 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" podUID="ecb56446-865d-41ad-bf91-040771f33d70" containerName="manager" containerID="cri-o://f0f7b46cdf1ac6c599c93e9cc2ca044523b9f10bb92dee47f3062909dbe64692" gracePeriod=10 Sep 15 07:48:40.684517 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.684483 2582 generic.go:356] "Generic (PLEG): container finished" podID="ecb56446-865d-41ad-bf91-040771f33d70" containerID="f0f7b46cdf1ac6c599c93e9cc2ca044523b9f10bb92dee47f3062909dbe64692" exitCode=0 Sep 15 07:48:40.684716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.684560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" event={"ID":"ecb56446-865d-41ad-bf91-040771f33d70","Type":"ContainerDied","Data":"f0f7b46cdf1ac6c599c93e9cc2ca044523b9f10bb92dee47f3062909dbe64692"} Sep 15 07:48:40.716553 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.716510 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:48:40.846085 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.846042 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2n9w\" (UniqueName: \"kubernetes.io/projected/ecb56446-865d-41ad-bf91-040771f33d70-kube-api-access-h2n9w\") pod \"ecb56446-865d-41ad-bf91-040771f33d70\" (UID: \"ecb56446-865d-41ad-bf91-040771f33d70\") " Sep 15 07:48:40.848195 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.848161 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecb56446-865d-41ad-bf91-040771f33d70-kube-api-access-h2n9w" (OuterVolumeSpecName: "kube-api-access-h2n9w") pod "ecb56446-865d-41ad-bf91-040771f33d70" (UID: "ecb56446-865d-41ad-bf91-040771f33d70"). InnerVolumeSpecName "kube-api-access-h2n9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:48:40.946932 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:40.946885 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2n9w\" (UniqueName: \"kubernetes.io/projected/ecb56446-865d-41ad-bf91-040771f33d70-kube-api-access-h2n9w\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:48:41.689576 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:41.689545 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" Sep 15 07:48:41.689576 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:41.689555 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6" event={"ID":"ecb56446-865d-41ad-bf91-040771f33d70","Type":"ContainerDied","Data":"0fb61b69b234536a7370cb05d312ff7ce12dd5c635e98dce97ff3933b254626e"} Sep 15 07:48:41.690043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:41.689610 2582 scope.go:117] "RemoveContainer" containerID="f0f7b46cdf1ac6c599c93e9cc2ca044523b9f10bb92dee47f3062909dbe64692" Sep 15 07:48:41.709599 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:41.709570 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6"] Sep 15 07:48:41.711641 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:41.711620 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5d99cf7779-jk7n6"] Sep 15 07:48:42.178342 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:42.178311 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecb56446-865d-41ad-bf91-040771f33d70" path="/var/lib/kubelet/pods/ecb56446-865d-41ad-bf91-040771f33d70/volumes" Sep 15 07:48:43.036500 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.036466 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-j6zfj"] Sep 15 07:48:43.036904 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.036644 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" podUID="be347d6c-8e4b-4e03-81bd-35764cc2d4f7" containerName="postgres" containerID="cri-o://0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c" gracePeriod=30 Sep 15 07:48:43.041060 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.041032 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-2mltq"] Sep 15 07:48:43.041243 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.041207 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" podUID="5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" containerName="redis" containerID="cri-o://5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994" gracePeriod=30 Sep 15 07:48:43.304590 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.304567 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:48:43.307313 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.307292 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:48:43.467689 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.467654 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c2cn\" (UniqueName: \"kubernetes.io/projected/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-kube-api-access-2c2cn\") pod \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " Sep 15 07:48:43.467873 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.467706 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-postgresdata\") pod \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\" (UID: \"be347d6c-8e4b-4e03-81bd-35764cc2d4f7\") " Sep 15 07:48:43.467873 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.467767 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfcl9\" (UniqueName: \"kubernetes.io/projected/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe-kube-api-access-mfcl9\") pod \"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe\" (UID: \"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe\") " Sep 15 07:48:43.470009 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.469973 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe-kube-api-access-mfcl9" (OuterVolumeSpecName: "kube-api-access-mfcl9") pod "5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" (UID: "5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe"). InnerVolumeSpecName "kube-api-access-mfcl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:48:43.470009 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.469982 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-kube-api-access-2c2cn" (OuterVolumeSpecName: "kube-api-access-2c2cn") pod "be347d6c-8e4b-4e03-81bd-35764cc2d4f7" (UID: "be347d6c-8e4b-4e03-81bd-35764cc2d4f7"). InnerVolumeSpecName "kube-api-access-2c2cn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:48:43.497426 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.497390 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "be347d6c-8e4b-4e03-81bd-35764cc2d4f7" (UID: "be347d6c-8e4b-4e03-81bd-35764cc2d4f7"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:48:43.568778 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.568685 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c2cn\" (UniqueName: \"kubernetes.io/projected/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-kube-api-access-2c2cn\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:48:43.568778 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.568719 2582 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/be347d6c-8e4b-4e03-81bd-35764cc2d4f7-postgresdata\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:48:43.568778 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.568733 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfcl9\" (UniqueName: \"kubernetes.io/projected/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe-kube-api-access-mfcl9\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:48:43.699993 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.699963 2582 generic.go:356] "Generic (PLEG): container finished" podID="be347d6c-8e4b-4e03-81bd-35764cc2d4f7" containerID="0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c" exitCode=0 Sep 15 07:48:43.700189 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.700013 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" Sep 15 07:48:43.700189 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.700047 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" event={"ID":"be347d6c-8e4b-4e03-81bd-35764cc2d4f7","Type":"ContainerDied","Data":"0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c"} Sep 15 07:48:43.700189 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.700083 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-j6zfj" event={"ID":"be347d6c-8e4b-4e03-81bd-35764cc2d4f7","Type":"ContainerDied","Data":"2619d4f7f903d0051405cfb12400b1a7b2824b3cf0d0e54463f09cf92553e2e5"} Sep 15 07:48:43.700189 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.700104 2582 scope.go:117] "RemoveContainer" containerID="0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c" Sep 15 07:48:43.701447 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.701410 2582 generic.go:356] "Generic (PLEG): container finished" podID="5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" containerID="5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994" exitCode=0 Sep 15 07:48:43.701593 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.701461 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" Sep 15 07:48:43.701593 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.701461 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" event={"ID":"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe","Type":"ContainerDied","Data":"5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994"} Sep 15 07:48:43.701593 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.701511 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-2mltq" event={"ID":"5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe","Type":"ContainerDied","Data":"41cf7a04659baaf5ed7e3b70ff0a63bc20025eb1060e6d694dc944274cdc3c7b"} Sep 15 07:48:43.708246 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.708221 2582 scope.go:117] "RemoveContainer" containerID="0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c" Sep 15 07:48:43.708581 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:48:43.708561 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c\": container with ID starting with 0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c not found: ID does not exist" containerID="0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c" Sep 15 07:48:43.708654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.708589 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c"} err="failed to get container status \"0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c\": rpc error: code = NotFound desc = could not find container \"0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c\": container with ID starting with 0ed8e7fe9c155cf5a5d3d5c2e57dd464952cf3af60393b02ebbc05cf0afce50c not found: ID does not exist" Sep 15 07:48:43.708654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.708606 2582 scope.go:117] "RemoveContainer" containerID="5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994" Sep 15 07:48:43.716180 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.716162 2582 scope.go:117] "RemoveContainer" containerID="5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994" Sep 15 07:48:43.716455 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:48:43.716435 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994\": container with ID starting with 5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994 not found: ID does not exist" containerID="5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994" Sep 15 07:48:43.716503 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.716463 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994"} err="failed to get container status \"5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994\": rpc error: code = NotFound desc = could not find container \"5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994\": container with ID starting with 5004d258d46c3eb68175b98353b510a2daa96712b8ea34e18235fd21020ea994 not found: ID does not exist" Sep 15 07:48:43.727573 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.727551 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-j6zfj"] Sep 15 07:48:43.731169 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.731149 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-j6zfj"] Sep 15 07:48:43.741746 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.741726 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-2mltq"] Sep 15 07:48:43.745215 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:43.745196 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-2mltq"] Sep 15 07:48:44.177681 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:44.177639 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" path="/var/lib/kubelet/pods/5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe/volumes" Sep 15 07:48:44.178161 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:44.178106 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be347d6c-8e4b-4e03-81bd-35764cc2d4f7" path="/var/lib/kubelet/pods/be347d6c-8e4b-4e03-81bd-35764cc2d4f7/volumes" Sep 15 07:48:51.814937 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.814892 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4"] Sep 15 07:48:51.815507 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815485 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecb56446-865d-41ad-bf91-040771f33d70" containerName="manager" Sep 15 07:48:51.815597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815511 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecb56446-865d-41ad-bf91-040771f33d70" containerName="manager" Sep 15 07:48:51.815597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815543 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" containerName="redis" Sep 15 07:48:51.815597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815552 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" containerName="redis" Sep 15 07:48:51.815597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815573 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be347d6c-8e4b-4e03-81bd-35764cc2d4f7" containerName="postgres" Sep 15 07:48:51.815597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815581 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="be347d6c-8e4b-4e03-81bd-35764cc2d4f7" containerName="postgres" Sep 15 07:48:51.815825 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815715 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecb56446-865d-41ad-bf91-040771f33d70" containerName="manager" Sep 15 07:48:51.815825 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815727 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="be347d6c-8e4b-4e03-81bd-35764cc2d4f7" containerName="postgres" Sep 15 07:48:51.815825 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.815744 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e9983c6-3864-4a34-9ef7-d4e4cddd0ffe" containerName="redis" Sep 15 07:48:51.819176 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.819153 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:48:51.822010 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.821989 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 15 07:48:51.823273 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.823255 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-q4l48\"" Sep 15 07:48:51.823381 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.823275 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 15 07:48:51.832307 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.832284 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4"] Sep 15 07:48:51.835356 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.835336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4wlm\" (UniqueName: \"kubernetes.io/projected/83a2bfd2-0a8f-40a1-b882-3e05c24be919-kube-api-access-h4wlm\") pod \"feast-operator-controller-manager-689b877b4b-vswn4\" (UID: \"83a2bfd2-0a8f-40a1-b882-3e05c24be919\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:48:51.935843 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.935808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wlm\" (UniqueName: \"kubernetes.io/projected/83a2bfd2-0a8f-40a1-b882-3e05c24be919-kube-api-access-h4wlm\") pod \"feast-operator-controller-manager-689b877b4b-vswn4\" (UID: \"83a2bfd2-0a8f-40a1-b882-3e05c24be919\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:48:51.953994 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:51.953960 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4wlm\" (UniqueName: \"kubernetes.io/projected/83a2bfd2-0a8f-40a1-b882-3e05c24be919-kube-api-access-h4wlm\") pod \"feast-operator-controller-manager-689b877b4b-vswn4\" (UID: \"83a2bfd2-0a8f-40a1-b882-3e05c24be919\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:48:52.129259 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:52.129168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:48:52.400627 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:52.400599 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4"] Sep 15 07:48:52.404492 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:48:52.404456 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a2bfd2_0a8f_40a1_b882_3e05c24be919.slice/crio-0f4ba794083020ab04e8c43ca44a5849228866761edb107113c39e5fa0019ecc WatchSource:0}: Error finding container 0f4ba794083020ab04e8c43ca44a5849228866761edb107113c39e5fa0019ecc: Status 404 returned error can't find the container with id 0f4ba794083020ab04e8c43ca44a5849228866761edb107113c39e5fa0019ecc Sep 15 07:48:52.737914 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:52.737827 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" event={"ID":"83a2bfd2-0a8f-40a1-b882-3e05c24be919","Type":"ContainerStarted","Data":"0f4ba794083020ab04e8c43ca44a5849228866761edb107113c39e5fa0019ecc"} Sep 15 07:48:55.751812 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:55.751770 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" event={"ID":"83a2bfd2-0a8f-40a1-b882-3e05c24be919","Type":"ContainerStarted","Data":"c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d"} Sep 15 07:48:55.752260 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:55.751886 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:48:55.771623 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:48:55.771571 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" podStartSLOduration=2.488615757 podStartE2EDuration="4.771556548s" totalImagesPullingTime="2.282940791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:48:55.769925646 +0000 UTC m=+1446.082012262" watchObservedRunningTime="2026-09-15 07:48:55.771556548 +0000 UTC m=+1446.083643192" Sep 15 07:49:06.757665 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:06.757636 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:49:08.836566 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.836512 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv"] Sep 15 07:49:08.840501 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.840477 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.843330 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843303 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 15 07:49:08.843446 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843383 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jbphj\"" Sep 15 07:49:08.843446 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843389 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 15 07:49:08.843446 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843442 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 15 07:49:08.843668 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843654 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 15 07:49:08.843766 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843751 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 07:49:08.843815 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.843803 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 07:49:08.853436 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.853405 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv"] Sep 15 07:49:08.864717 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.864683 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b938ef56-adff-4dc4-960a-8094b57c1375-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.864864 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.864728 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.864864 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.864805 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.864938 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.864861 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.864938 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.864890 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.864999 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.864945 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg26n\" (UniqueName: \"kubernetes.io/projected/b938ef56-adff-4dc4-960a-8094b57c1375-kube-api-access-sg26n\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966126 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966126 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg26n\" (UniqueName: \"kubernetes.io/projected/b938ef56-adff-4dc4-960a-8094b57c1375-kube-api-access-sg26n\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966185 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b938ef56-adff-4dc4-960a-8094b57c1375-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966233 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:49:08.966240 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:49:08.966318 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 15 07:49:08.966370 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:49:08.966346 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 15 07:49:08.966657 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:49:08.966348 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls podName:b938ef56-adff-4dc4-960a-8094b57c1375 nodeName:}" failed. No retries permitted until 2026-09-15 07:49:09.466327296 +0000 UTC m=+1459.778413896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-4bmmv" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375") : secret "feast-simple-feast-setup-offline-tls" not found Sep 15 07:49:08.966657 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:49:08.966409 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls podName:b938ef56-adff-4dc4-960a-8094b57c1375 nodeName:}" failed. No retries permitted until 2026-09-15 07:49:09.466391394 +0000 UTC m=+1459.778477995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-4bmmv" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375") : secret "feast-simple-feast-setup-registry-tls" not found Sep 15 07:49:08.966657 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:49:08.966423 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls podName:b938ef56-adff-4dc4-960a-8094b57c1375 nodeName:}" failed. No retries permitted until 2026-09-15 07:49:09.466417365 +0000 UTC m=+1459.778503960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls") pod "feast-simple-feast-setup-57576b8fcf-4bmmv" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375") : secret "feast-simple-feast-setup-online-tls" not found Sep 15 07:49:08.966765 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.966666 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b938ef56-adff-4dc4-960a-8094b57c1375-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.968613 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.968595 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:08.977745 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:08.977722 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg26n\" (UniqueName: \"kubernetes.io/projected/b938ef56-adff-4dc4-960a-8094b57c1375-kube-api-access-sg26n\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.471072 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.471033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.471230 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.471086 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.471230 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.471202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.473555 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.473502 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.473682 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.473662 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.473747 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.473662 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4bmmv\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:09.759123 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:09.759035 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:10.035360 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:10.035332 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv"] Sep 15 07:49:10.037415 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:49:10.037388 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb938ef56_adff_4dc4_960a_8094b57c1375.slice/crio-8f5d932dd5980c211744ba5688db5c5a2949ed67cba88b73940bcb064e35dc84 WatchSource:0}: Error finding container 8f5d932dd5980c211744ba5688db5c5a2949ed67cba88b73940bcb064e35dc84: Status 404 returned error can't find the container with id 8f5d932dd5980c211744ba5688db5c5a2949ed67cba88b73940bcb064e35dc84 Sep 15 07:49:10.818129 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:10.818089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"8f5d932dd5980c211744ba5688db5c5a2949ed67cba88b73940bcb064e35dc84"} Sep 15 07:49:22.873600 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:22.873560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"973180b9b1b538bcad2294e1765de1ad519ea0a972ea32768dba0a828020797f"} Sep 15 07:49:27.894659 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:27.894625 2582 generic.go:356] "Generic (PLEG): container finished" podID="b938ef56-adff-4dc4-960a-8094b57c1375" containerID="973180b9b1b538bcad2294e1765de1ad519ea0a972ea32768dba0a828020797f" exitCode=0 Sep 15 07:49:27.895119 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:27.894709 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"973180b9b1b538bcad2294e1765de1ad519ea0a972ea32768dba0a828020797f"} Sep 15 07:49:28.900900 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:28.900861 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"b0ff6dc63c0e0fcfcc593c4a79fd756c9e3d8bc006a297c498be68a9ed6ab5e0"} Sep 15 07:49:34.925076 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:34.925041 2582 generic.go:356] "Generic (PLEG): container finished" podID="b938ef56-adff-4dc4-960a-8094b57c1375" containerID="b0ff6dc63c0e0fcfcc593c4a79fd756c9e3d8bc006a297c498be68a9ed6ab5e0" exitCode=0 Sep 15 07:49:34.925443 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:34.925102 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"b0ff6dc63c0e0fcfcc593c4a79fd756c9e3d8bc006a297c498be68a9ed6ab5e0"} Sep 15 07:49:35.934791 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:35.934745 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"2591709627a61b52b7baaa131d4a5d4590f9ff148cc9afd42037665bf98fbf1a"} Sep 15 07:49:35.935351 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:35.934815 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"5db4b9332560da02e4337dbd9e750889f30ba3e62c92df605ac4c8d936a5bf03"} Sep 15 07:49:35.935351 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:35.934838 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"b7f56cd38254f6ae80c587f15a36080bd5dbf01737a505969712d9d52098ddb6"} Sep 15 07:49:35.935351 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:35.934859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerStarted","Data":"f18585611e25dfb3336ca8ebf32149d323f8410618e6f2f7bf5111eb784fea1d"} Sep 15 07:49:35.959756 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:35.959694 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podStartSLOduration=15.707241233 podStartE2EDuration="27.959671848s" totalImagesPullingTime="12.252430615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:49:35.957468499 +0000 UTC m=+1486.269555127" watchObservedRunningTime="2026-09-15 07:49:35.959671848 +0000 UTC m=+1486.271758466" Sep 15 07:49:36.760014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.759885 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:36.760014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.759967 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:36.760014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.759988 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:36.760342 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.760140 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:36.761959 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.761913 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 15 07:49:36.762195 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.761939 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 15 07:49:36.762306 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.761953 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused" Sep 15 07:49:36.762306 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:36.761980 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 15 07:49:39.760147 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760105 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:39.760744 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760717 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:39.760744 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760296 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 15 07:49:39.760932 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760329 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused" Sep 15 07:49:39.760932 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760488 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 15 07:49:39.761131 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760421 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 15 07:49:39.761213 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.760751 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:39.761213 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:39.761192 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:42.759804 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:42.759753 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused" Sep 15 07:49:42.760429 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:42.759753 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 15 07:49:42.760657 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:42.759757 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 15 07:49:42.760794 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:42.759778 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 15 07:49:45.761016 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.760797 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.761491 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.761103 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.761647 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.761626 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.761720 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.761709 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.766499 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.766474 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.982352 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.982322 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.982486 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.982379 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:45.984992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:45.984976 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:49:50.220967 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:50.220934 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:49:50.222858 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:49:50.222837 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:50:49.115882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.115850 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv"] Sep 15 07:50:49.116411 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.116121 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" containerID="cri-o://f18585611e25dfb3336ca8ebf32149d323f8410618e6f2f7bf5111eb784fea1d" gracePeriod=30 Sep 15 07:50:49.116411 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.116174 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" containerID="cri-o://2591709627a61b52b7baaa131d4a5d4590f9ff148cc9afd42037665bf98fbf1a" gracePeriod=30 Sep 15 07:50:49.116411 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.116165 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" containerID="cri-o://5db4b9332560da02e4337dbd9e750889f30ba3e62c92df605ac4c8d936a5bf03" gracePeriod=30 Sep 15 07:50:49.116411 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.116183 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" containerID="cri-o://b7f56cd38254f6ae80c587f15a36080bd5dbf01737a505969712d9d52098ddb6" gracePeriod=30 Sep 15 07:50:49.498082 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.498042 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk"] Sep 15 07:50:49.502646 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.502626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.505683 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.505659 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dxddf\"" Sep 15 07:50:49.513172 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.513146 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk"] Sep 15 07:50:49.537910 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.537871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.538133 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.537952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.538133 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.537990 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.538133 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.538056 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ppw\" (UniqueName: \"kubernetes.io/projected/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-kube-api-access-v2ppw\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.538133 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.538085 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.538133 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.538121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639429 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.639386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639429 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.639430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.639477 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ppw\" (UniqueName: \"kubernetes.io/projected/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-kube-api-access-v2ppw\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.639506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.639564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:50:49.639581 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.639604 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:50:49.639647 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls podName:b4cc15a0-56c2-4cd9-a06b-dc7f444567bb nodeName:}" failed. No retries permitted until 2026-09-15 07:50:50.139625651 +0000 UTC m=+1560.451712251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-hcvbk" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb") : secret "feast-simple-feast-setup-offline-tls" not found Sep 15 07:50:49.639719 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:50:49.639666 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 15 07:50:49.640053 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:50:49.639735 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls podName:b4cc15a0-56c2-4cd9-a06b-dc7f444567bb nodeName:}" failed. No retries permitted until 2026-09-15 07:50:50.139718137 +0000 UTC m=+1560.451804732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-hcvbk" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb") : secret "feast-simple-feast-setup-ui-tls" not found Sep 15 07:50:49.640053 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:50:49.639795 2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 15 07:50:49.640053 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:50:49.639824 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls podName:b4cc15a0-56c2-4cd9-a06b-dc7f444567bb nodeName:}" failed. No retries permitted until 2026-09-15 07:50:50.139813948 +0000 UTC m=+1560.451900543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls") pod "feast-simple-feast-setup-57576b8fcf-hcvbk" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb") : secret "feast-simple-feast-setup-online-tls" not found Sep 15 07:50:49.640053 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.640009 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.642181 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.642148 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:49.648912 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:49.648887 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ppw\" (UniqueName: \"kubernetes.io/projected/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-kube-api-access-v2ppw\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.145118 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.145087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.145602 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.145144 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.145602 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.145194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.147649 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.147625 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.147766 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.147625 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.147766 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.147724 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hcvbk\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.231241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.231207 2582 generic.go:356] "Generic (PLEG): container finished" podID="b938ef56-adff-4dc4-960a-8094b57c1375" containerID="2591709627a61b52b7baaa131d4a5d4590f9ff148cc9afd42037665bf98fbf1a" exitCode=0 Sep 15 07:50:50.231241 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.231232 2582 generic.go:356] "Generic (PLEG): container finished" podID="b938ef56-adff-4dc4-960a-8094b57c1375" containerID="b7f56cd38254f6ae80c587f15a36080bd5dbf01737a505969712d9d52098ddb6" exitCode=0 Sep 15 07:50:50.231452 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.231282 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"2591709627a61b52b7baaa131d4a5d4590f9ff148cc9afd42037665bf98fbf1a"} Sep 15 07:50:50.231452 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.231333 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"b7f56cd38254f6ae80c587f15a36080bd5dbf01737a505969712d9d52098ddb6"} Sep 15 07:50:50.416236 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.416205 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dxddf\"" Sep 15 07:50:50.424519 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.424494 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:50:50.698867 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:50.698771 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk"] Sep 15 07:50:50.701212 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:50:50.701181 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4cc15a0_56c2_4cd9_a06b_dc7f444567bb.slice/crio-09ad7efc7f655a49601bc301c56841a4d0eb39db7d2281cab6abfa6eea8da792 WatchSource:0}: Error finding container 09ad7efc7f655a49601bc301c56841a4d0eb39db7d2281cab6abfa6eea8da792: Status 404 returned error can't find the container with id 09ad7efc7f655a49601bc301c56841a4d0eb39db7d2281cab6abfa6eea8da792 Sep 15 07:50:51.237046 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:51.237007 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe"} Sep 15 07:50:51.237046 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:51.237050 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"09ad7efc7f655a49601bc301c56841a4d0eb39db7d2281cab6abfa6eea8da792"} Sep 15 07:50:55.982902 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:55.982851 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 15 07:50:55.983312 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:55.982862 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 15 07:50:56.257255 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:56.257223 2582 generic.go:356] "Generic (PLEG): container finished" podID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerID="68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe" exitCode=0 Sep 15 07:50:56.257421 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:56.257274 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe"} Sep 15 07:50:57.263786 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:50:57.263747 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472"} Sep 15 07:51:02.289303 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:02.289267 2582 generic.go:356] "Generic (PLEG): container finished" podID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerID="9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472" exitCode=0 Sep 15 07:51:02.289741 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:02.289340 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472"} Sep 15 07:51:03.299386 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:03.299340 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b"} Sep 15 07:51:03.299871 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:03.299398 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e"} Sep 15 07:51:03.299871 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:03.299419 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9"} Sep 15 07:51:03.299871 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:03.299436 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerStarted","Data":"fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5"} Sep 15 07:51:03.326588 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:03.326503 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podStartSLOduration=14.326480337 podStartE2EDuration="14.326480337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:51:03.323838237 +0000 UTC m=+1573.635924856" watchObservedRunningTime="2026-09-15 07:51:03.326480337 +0000 UTC m=+1573.638566957" Sep 15 07:51:05.425120 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.425085 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:05.425719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.425699 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:05.425841 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.425830 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:05.426177 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.426161 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:05.427606 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.427575 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Sep 15 07:51:05.427782 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.427595 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 15 07:51:05.427888 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.427654 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused" Sep 15 07:51:05.427888 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.427688 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 07:51:05.982980 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.982933 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 15 07:51:05.983301 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:05.982964 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 15 07:51:08.425461 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:08.425420 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 15 07:51:08.426076 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:08.425417 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused" Sep 15 07:51:08.426210 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:08.425417 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Sep 15 07:51:08.426210 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:08.425417 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 07:51:10.425334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:10.425290 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:10.425719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:10.425353 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:10.425719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:10.425367 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:10.425719 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:10.425381 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.426414 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.426376 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.426829 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.426548 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.426899 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.426878 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.427259 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.427242 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.427369 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.427359 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.427673 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.427656 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:11.431674 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:11.431658 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:12.351922 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:12.351889 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:51:15.982824 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:15.982775 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 15 07:51:15.985244 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:15.982796 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 15 07:51:15.985244 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:15.982945 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:51:15.985244 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:15.983024 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:51:19.378220 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.378133 2582 generic.go:356] "Generic (PLEG): container finished" podID="b938ef56-adff-4dc4-960a-8094b57c1375" containerID="5db4b9332560da02e4337dbd9e750889f30ba3e62c92df605ac4c8d936a5bf03" exitCode=137 Sep 15 07:51:19.378220 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.378159 2582 generic.go:356] "Generic (PLEG): container finished" podID="b938ef56-adff-4dc4-960a-8094b57c1375" containerID="f18585611e25dfb3336ca8ebf32149d323f8410618e6f2f7bf5111eb784fea1d" exitCode=137 Sep 15 07:51:19.378220 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.378192 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"5db4b9332560da02e4337dbd9e750889f30ba3e62c92df605ac4c8d936a5bf03"} Sep 15 07:51:19.378652 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.378223 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"f18585611e25dfb3336ca8ebf32149d323f8410618e6f2f7bf5111eb784fea1d"} Sep 15 07:51:19.764450 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.764426 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:51:19.917839 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.917810 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls\") pod \"b938ef56-adff-4dc4-960a-8094b57c1375\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " Sep 15 07:51:19.918043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.917859 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b938ef56-adff-4dc4-960a-8094b57c1375-feast-data\") pod \"b938ef56-adff-4dc4-960a-8094b57c1375\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " Sep 15 07:51:19.918043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.917901 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg26n\" (UniqueName: \"kubernetes.io/projected/b938ef56-adff-4dc4-960a-8094b57c1375-kube-api-access-sg26n\") pod \"b938ef56-adff-4dc4-960a-8094b57c1375\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " Sep 15 07:51:19.918043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.917937 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-ui-tls\") pod \"b938ef56-adff-4dc4-960a-8094b57c1375\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " Sep 15 07:51:19.918043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.917966 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls\") pod \"b938ef56-adff-4dc4-960a-8094b57c1375\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " Sep 15 07:51:19.918043 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.918002 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls\") pod \"b938ef56-adff-4dc4-960a-8094b57c1375\" (UID: \"b938ef56-adff-4dc4-960a-8094b57c1375\") " Sep 15 07:51:19.918523 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.918493 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b938ef56-adff-4dc4-960a-8094b57c1375-feast-data" (OuterVolumeSpecName: "feast-data") pod "b938ef56-adff-4dc4-960a-8094b57c1375" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:51:19.920340 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.920305 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls" (OuterVolumeSpecName: "online-tls") pod "b938ef56-adff-4dc4-960a-8094b57c1375" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:51:19.920340 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.920321 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b938ef56-adff-4dc4-960a-8094b57c1375-kube-api-access-sg26n" (OuterVolumeSpecName: "kube-api-access-sg26n") pod "b938ef56-adff-4dc4-960a-8094b57c1375" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375"). InnerVolumeSpecName "kube-api-access-sg26n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:51:19.920340 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.920316 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b938ef56-adff-4dc4-960a-8094b57c1375" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:51:19.920517 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.920470 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b938ef56-adff-4dc4-960a-8094b57c1375" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:51:19.920517 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:19.920506 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b938ef56-adff-4dc4-960a-8094b57c1375" (UID: "b938ef56-adff-4dc4-960a-8094b57c1375"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:51:20.019654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.019619 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b938ef56-adff-4dc4-960a-8094b57c1375-feast-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:51:20.019654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.019646 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg26n\" (UniqueName: \"kubernetes.io/projected/b938ef56-adff-4dc4-960a-8094b57c1375-kube-api-access-sg26n\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:51:20.019654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.019656 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-ui-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:51:20.019654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.019665 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-offline-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:51:20.019994 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.019674 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-online-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:51:20.019994 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.019681 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b938ef56-adff-4dc4-960a-8094b57c1375-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:51:20.384647 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.384613 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" event={"ID":"b938ef56-adff-4dc4-960a-8094b57c1375","Type":"ContainerDied","Data":"8f5d932dd5980c211744ba5688db5c5a2949ed67cba88b73940bcb064e35dc84"} Sep 15 07:51:20.385028 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.384672 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv" Sep 15 07:51:20.385028 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.384672 2582 scope.go:117] "RemoveContainer" containerID="2591709627a61b52b7baaa131d4a5d4590f9ff148cc9afd42037665bf98fbf1a" Sep 15 07:51:20.393340 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.393317 2582 scope.go:117] "RemoveContainer" containerID="5db4b9332560da02e4337dbd9e750889f30ba3e62c92df605ac4c8d936a5bf03" Sep 15 07:51:20.401968 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.401950 2582 scope.go:117] "RemoveContainer" containerID="b7f56cd38254f6ae80c587f15a36080bd5dbf01737a505969712d9d52098ddb6" Sep 15 07:51:20.404421 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.404398 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv"] Sep 15 07:51:20.408135 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.408112 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4bmmv"] Sep 15 07:51:20.410171 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.410156 2582 scope.go:117] "RemoveContainer" containerID="f18585611e25dfb3336ca8ebf32149d323f8410618e6f2f7bf5111eb784fea1d" Sep 15 07:51:20.417118 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.417101 2582 scope.go:117] "RemoveContainer" containerID="b0ff6dc63c0e0fcfcc593c4a79fd756c9e3d8bc006a297c498be68a9ed6ab5e0" Sep 15 07:51:20.423956 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:20.423939 2582 scope.go:117] "RemoveContainer" containerID="973180b9b1b538bcad2294e1765de1ad519ea0a972ea32768dba0a828020797f" Sep 15 07:51:22.177309 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:51:22.177276 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" path="/var/lib/kubelet/pods/b938ef56-adff-4dc4-960a-8094b57c1375/volumes" Sep 15 07:52:14.583131 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583097 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7"] Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583410 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583422 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583431 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583437 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583445 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583451 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583460 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="feast-init" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583465 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="feast-init" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583481 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583486 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583494 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="feast-apply" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583500 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="feast-apply" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583566 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="online" Sep 15 07:52:14.583572 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583576 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="ui" Sep 15 07:52:14.583981 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583583 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="registry" Sep 15 07:52:14.583981 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.583589 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b938ef56-adff-4dc4-960a-8094b57c1375" containerName="offline" Sep 15 07:52:14.586827 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.586811 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.589731 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.589703 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 15 07:52:14.589874 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.589777 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 15 07:52:14.589874 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.589787 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 15 07:52:14.590022 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.590006 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 15 07:52:14.590104 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.590088 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 15 07:52:14.590161 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.590145 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 15 07:52:14.590161 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.590156 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-n49cl\"" Sep 15 07:52:14.600334 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.600310 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7"] Sep 15 07:52:14.754438 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.754401 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.754672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.754457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c741885f-15e2-4656-a17e-e7de0f7c6ae3-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.754672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.754589 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsf6w\" (UniqueName: \"kubernetes.io/projected/c741885f-15e2-4656-a17e-e7de0f7c6ae3-kube-api-access-gsf6w\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.754672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.754637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c741885f-15e2-4656-a17e-e7de0f7c6ae3-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.754672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.754659 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.754839 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.754692 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855603 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855484 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c741885f-15e2-4656-a17e-e7de0f7c6ae3-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855603 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855574 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsf6w\" (UniqueName: \"kubernetes.io/projected/c741885f-15e2-4656-a17e-e7de0f7c6ae3-kube-api-access-gsf6w\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855830 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c741885f-15e2-4656-a17e-e7de0f7c6ae3-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855830 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855634 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855830 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855659 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855830 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855711 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.855830 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:52:14.855778 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 07:52:14.856112 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.855849 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c741885f-15e2-4656-a17e-e7de0f7c6ae3-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.856112 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:52:14.855856 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls podName:c741885f-15e2-4656-a17e-e7de0f7c6ae3 nodeName:}" failed. No retries permitted until 2026-09-15 07:52:15.355833245 +0000 UTC m=+1645.667919857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 07:52:14.856262 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.856244 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c741885f-15e2-4656-a17e-e7de0f7c6ae3-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.858120 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.858098 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.858215 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.858191 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:14.866818 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:14.866797 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsf6w\" (UniqueName: \"kubernetes.io/projected/c741885f-15e2-4656-a17e-e7de0f7c6ae3-kube-api-access-gsf6w\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:15.360635 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:15.360596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:15.363073 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:15.363048 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-r6nz7\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:15.501202 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:15.501170 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:15.776402 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:15.776378 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7"] Sep 15 07:52:15.777592 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:52:15.777572 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc741885f_15e2_4656_a17e_e7de0f7c6ae3.slice/crio-f9a6955fed34af6861da8bc54bc0250af438c0af3419f4ac93a514b458fe50af WatchSource:0}: Error finding container f9a6955fed34af6861da8bc54bc0250af438c0af3419f4ac93a514b458fe50af: Status 404 returned error can't find the container with id f9a6955fed34af6861da8bc54bc0250af438c0af3419f4ac93a514b458fe50af Sep 15 07:52:16.610749 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:16.610714 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerStarted","Data":"844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6"} Sep 15 07:52:16.610922 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:16.610762 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerStarted","Data":"f9a6955fed34af6861da8bc54bc0250af438c0af3419f4ac93a514b458fe50af"} Sep 15 07:52:21.632941 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:21.632903 2582 generic.go:356] "Generic (PLEG): container finished" podID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerID="844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6" exitCode=0 Sep 15 07:52:21.633322 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:21.632974 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerDied","Data":"844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6"} Sep 15 07:52:22.638949 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:22.638916 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerStarted","Data":"905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f"} Sep 15 07:52:40.711592 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:40.711557 2582 generic.go:356] "Generic (PLEG): container finished" podID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerID="905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f" exitCode=0 Sep 15 07:52:40.712032 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:40.711624 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerDied","Data":"905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f"} Sep 15 07:52:41.720924 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:41.720888 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerStarted","Data":"7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543"} Sep 15 07:52:41.721398 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:41.720938 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerStarted","Data":"435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8"} Sep 15 07:52:41.721398 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:41.720952 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerStarted","Data":"72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004"} Sep 15 07:52:41.745768 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:41.745710 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podStartSLOduration=27.745687907 podStartE2EDuration="27.745687907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:52:41.742520574 +0000 UTC m=+1672.054607190" watchObservedRunningTime="2026-09-15 07:52:41.745687907 +0000 UTC m=+1672.057774524" Sep 15 07:52:42.501545 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:42.501424 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:42.501545 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:42.501478 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:42.501545 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:42.501495 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:42.503119 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:42.503079 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused" Sep 15 07:52:42.503119 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:42.503100 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused" Sep 15 07:52:42.503347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:42.503121 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 15 07:52:45.501994 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:45.501956 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:45.502465 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:45.502348 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:45.502465 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:45.502227 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused" Sep 15 07:52:45.502465 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:45.502278 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 15 07:52:45.502668 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:45.502372 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:45.502668 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:45.502246 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused" Sep 15 07:52:48.501613 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:48.501578 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused" Sep 15 07:52:48.501613 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:48.501598 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 15 07:52:48.502668 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:48.502642 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:48.503446 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:48.503423 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:51.502304 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:51.502272 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:51.503171 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:51.503148 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:52.101516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:52.101482 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:52:53.390047 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:52:53.390019 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:53:54.962671 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:54.962632 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7"] Sep 15 07:53:54.963211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:54.962923 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" containerID="cri-o://72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004" gracePeriod=30 Sep 15 07:53:54.963211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:54.963026 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" containerID="cri-o://7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543" gracePeriod=30 Sep 15 07:53:54.963211 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:54.963107 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="offline" containerID="cri-o://435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8" gracePeriod=30 Sep 15 07:53:55.104087 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:55.104047 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk"] Sep 15 07:53:55.104372 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:55.104329 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="registry" containerID="cri-o://fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5" gracePeriod=30 Sep 15 07:53:55.104479 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:55.104424 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" containerID="cri-o://a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b" gracePeriod=30 Sep 15 07:53:55.104479 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:55.104430 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="offline" containerID="cri-o://57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e" gracePeriod=30 Sep 15 07:53:55.104615 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:55.104428 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" containerID="cri-o://5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9" gracePeriod=30 Sep 15 07:53:56.027908 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.027877 2582 generic.go:356] "Generic (PLEG): container finished" podID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerID="a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b" exitCode=0 Sep 15 07:53:56.027908 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.027901 2582 generic.go:356] "Generic (PLEG): container finished" podID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerID="5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9" exitCode=0 Sep 15 07:53:56.028261 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.027947 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b"} Sep 15 07:53:56.028261 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.027987 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9"} Sep 15 07:53:56.030557 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.030517 2582 generic.go:356] "Generic (PLEG): container finished" podID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerID="7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543" exitCode=0 Sep 15 07:53:56.030557 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.030552 2582 generic.go:356] "Generic (PLEG): container finished" podID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerID="72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004" exitCode=0 Sep 15 07:53:56.030714 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.030557 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerDied","Data":"7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543"} Sep 15 07:53:56.030714 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:53:56.030604 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerDied","Data":"72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004"} Sep 15 07:54:01.427342 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:01.427280 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Sep 15 07:54:01.503802 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:01.503755 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused" Sep 15 07:54:02.349868 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:02.349820 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 07:54:02.771741 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:02.771695 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 15 07:54:11.427458 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:11.427414 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Sep 15 07:54:11.502783 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:11.502742 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused" Sep 15 07:54:12.348956 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:12.348917 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 07:54:12.771679 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:12.771636 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 15 07:54:21.427335 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:21.427290 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused" Sep 15 07:54:21.427850 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:21.427441 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:54:21.503725 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:21.503684 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused" Sep 15 07:54:21.503891 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:21.503803 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:54:22.349343 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:22.349299 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 15 07:54:22.349555 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:22.349428 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:54:22.771603 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:22.771563 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Sep 15 07:54:22.772239 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:22.772224 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:54:25.148752 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.148731 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:54:25.150515 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.150495 2582 generic.go:356] "Generic (PLEG): container finished" podID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerID="435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8" exitCode=137 Sep 15 07:54:25.150630 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.150559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerDied","Data":"435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8"} Sep 15 07:54:25.150630 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.150605 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" event={"ID":"c741885f-15e2-4656-a17e-e7de0f7c6ae3","Type":"ContainerDied","Data":"f9a6955fed34af6861da8bc54bc0250af438c0af3419f4ac93a514b458fe50af"} Sep 15 07:54:25.150716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.150655 2582 scope.go:117] "RemoveContainer" containerID="7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543" Sep 15 07:54:25.153870 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.153852 2582 generic.go:356] "Generic (PLEG): container finished" podID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerID="57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e" exitCode=137 Sep 15 07:54:25.153952 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.153899 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e"} Sep 15 07:54:25.223446 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.223419 2582 scope.go:117] "RemoveContainer" containerID="435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8" Sep 15 07:54:25.231324 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.231300 2582 scope.go:117] "RemoveContainer" containerID="72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004" Sep 15 07:54:25.238968 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.238947 2582 scope.go:117] "RemoveContainer" containerID="905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f" Sep 15 07:54:25.245828 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.245812 2582 scope.go:117] "RemoveContainer" containerID="844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6" Sep 15 07:54:25.252799 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.252781 2582 scope.go:117] "RemoveContainer" containerID="7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543" Sep 15 07:54:25.253049 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:25.253031 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543\": container with ID starting with 7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543 not found: ID does not exist" containerID="7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543" Sep 15 07:54:25.253124 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253068 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543"} err="failed to get container status \"7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543\": rpc error: code = NotFound desc = could not find container \"7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543\": container with ID starting with 7382549c6f4c4e08168149840a05f8aefc59b8aa4a65acae746c12f7b4304543 not found: ID does not exist" Sep 15 07:54:25.253124 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253095 2582 scope.go:117] "RemoveContainer" containerID="435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8" Sep 15 07:54:25.253344 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:25.253327 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8\": container with ID starting with 435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8 not found: ID does not exist" containerID="435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8" Sep 15 07:54:25.253392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253350 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8"} err="failed to get container status \"435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8\": rpc error: code = NotFound desc = could not find container \"435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8\": container with ID starting with 435a0fbd76fa8ba74e03bebc4be1e466256dc586297f5190102f3f005f0dedd8 not found: ID does not exist" Sep 15 07:54:25.253392 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253365 2582 scope.go:117] "RemoveContainer" containerID="72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004" Sep 15 07:54:25.253588 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:25.253571 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004\": container with ID starting with 72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004 not found: ID does not exist" containerID="72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004" Sep 15 07:54:25.253658 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253596 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004"} err="failed to get container status \"72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004\": rpc error: code = NotFound desc = could not find container \"72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004\": container with ID starting with 72a30b0cdc8f31110fbed8eec79a15e0032b060e611b812c3e5213a52c573004 not found: ID does not exist" Sep 15 07:54:25.253658 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253615 2582 scope.go:117] "RemoveContainer" containerID="905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f" Sep 15 07:54:25.253846 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:25.253830 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f\": container with ID starting with 905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f not found: ID does not exist" containerID="905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f" Sep 15 07:54:25.253884 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253851 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f"} err="failed to get container status \"905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f\": rpc error: code = NotFound desc = could not find container \"905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f\": container with ID starting with 905e2d18341a1ccab1a49da4e345f679d1fec55d3eb2685569beb1a06aa6188f not found: ID does not exist" Sep 15 07:54:25.253884 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.253865 2582 scope.go:117] "RemoveContainer" containerID="844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6" Sep 15 07:54:25.254078 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:25.254061 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6\": container with ID starting with 844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6 not found: ID does not exist" containerID="844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6" Sep 15 07:54:25.254122 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.254082 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6"} err="failed to get container status \"844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6\": rpc error: code = NotFound desc = could not find container \"844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6\": container with ID starting with 844002d0e99a9ef71446afb56feaccab4c5726b651ece379bc54be62332ee2c6 not found: ID does not exist" Sep 15 07:54:25.337448 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337415 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsf6w\" (UniqueName: \"kubernetes.io/projected/c741885f-15e2-4656-a17e-e7de0f7c6ae3-kube-api-access-gsf6w\") pod \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " Sep 15 07:54:25.337448 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337452 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-online-tls\") pod \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " Sep 15 07:54:25.337710 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337474 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c741885f-15e2-4656-a17e-e7de0f7c6ae3-registry-tls\") pod \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " Sep 15 07:54:25.337710 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337520 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-ui-tls\") pod \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " Sep 15 07:54:25.337710 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337579 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls\") pod \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " Sep 15 07:54:25.337710 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337605 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c741885f-15e2-4656-a17e-e7de0f7c6ae3-feast-data\") pod \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\" (UID: \"c741885f-15e2-4656-a17e-e7de0f7c6ae3\") " Sep 15 07:54:25.338034 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.337999 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c741885f-15e2-4656-a17e-e7de0f7c6ae3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c741885f-15e2-4656-a17e-e7de0f7c6ae3" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 07:54:25.338203 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.338183 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c741885f-15e2-4656-a17e-e7de0f7c6ae3-feast-data" (OuterVolumeSpecName: "feast-data") pod "c741885f-15e2-4656-a17e-e7de0f7c6ae3" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:54:25.340370 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.340338 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-online-tls" (OuterVolumeSpecName: "online-tls") pod "c741885f-15e2-4656-a17e-e7de0f7c6ae3" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.340454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.340373 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c741885f-15e2-4656-a17e-e7de0f7c6ae3" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.340454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.340398 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c741885f-15e2-4656-a17e-e7de0f7c6ae3-kube-api-access-gsf6w" (OuterVolumeSpecName: "kube-api-access-gsf6w") pod "c741885f-15e2-4656-a17e-e7de0f7c6ae3" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3"). InnerVolumeSpecName "kube-api-access-gsf6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:54:25.340454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.340397 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c741885f-15e2-4656-a17e-e7de0f7c6ae3" (UID: "c741885f-15e2-4656-a17e-e7de0f7c6ae3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.438454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.438421 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-offline-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.438454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.438448 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c741885f-15e2-4656-a17e-e7de0f7c6ae3-feast-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.438454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.438458 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsf6w\" (UniqueName: \"kubernetes.io/projected/c741885f-15e2-4656-a17e-e7de0f7c6ae3-kube-api-access-gsf6w\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.438706 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.438468 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-online-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.438706 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.438477 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c741885f-15e2-4656-a17e-e7de0f7c6ae3-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.438706 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.438485 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c741885f-15e2-4656-a17e-e7de0f7c6ae3-ui-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.740031 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740001 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:54:25.740367 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740341 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-registry-tls\") pod \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " Sep 15 07:54:25.740432 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740376 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls\") pod \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " Sep 15 07:54:25.740432 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740397 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-feast-data\") pod \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " Sep 15 07:54:25.740558 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740519 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls\") pod \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " Sep 15 07:54:25.740619 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740594 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2ppw\" (UniqueName: \"kubernetes.io/projected/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-kube-api-access-v2ppw\") pod \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " Sep 15 07:54:25.740680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740660 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls\") pod \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\" (UID: \"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb\") " Sep 15 07:54:25.740961 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.740932 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-feast-data" (OuterVolumeSpecName: "feast-data") pod "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:54:25.742462 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.742435 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.742585 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.742471 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls" (OuterVolumeSpecName: "online-tls") pod "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.742585 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.742481 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-kube-api-access-v2ppw" (OuterVolumeSpecName: "kube-api-access-v2ppw") pod "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb"). InnerVolumeSpecName "kube-api-access-v2ppw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:54:25.742778 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.742764 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.742867 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.742850 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" (UID: "b4cc15a0-56c2-4cd9-a06b-dc7f444567bb"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:54:25.841578 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.841546 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-ui-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.841578 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.841571 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.841578 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.841581 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-offline-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.841800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.841590 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-feast-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.841800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.841597 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-online-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:25.841800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:25.841605 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2ppw\" (UniqueName: \"kubernetes.io/projected/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb-kube-api-access-v2ppw\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:26.160956 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.160920 2582 generic.go:356] "Generic (PLEG): container finished" podID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerID="fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5" exitCode=137 Sep 15 07:54:26.161367 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.160962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5"} Sep 15 07:54:26.161367 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.160992 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" Sep 15 07:54:26.161367 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.161019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk" event={"ID":"b4cc15a0-56c2-4cd9-a06b-dc7f444567bb","Type":"ContainerDied","Data":"09ad7efc7f655a49601bc301c56841a4d0eb39db7d2281cab6abfa6eea8da792"} Sep 15 07:54:26.161367 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.161043 2582 scope.go:117] "RemoveContainer" containerID="a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b" Sep 15 07:54:26.162277 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.162062 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7" Sep 15 07:54:26.169082 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.169062 2582 scope.go:117] "RemoveContainer" containerID="57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e" Sep 15 07:54:26.182552 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.182500 2582 scope.go:117] "RemoveContainer" containerID="5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9" Sep 15 07:54:26.190556 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.190523 2582 scope.go:117] "RemoveContainer" containerID="fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5" Sep 15 07:54:26.193912 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.193890 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk"] Sep 15 07:54:26.196958 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.196926 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hcvbk"] Sep 15 07:54:26.198807 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.198783 2582 scope.go:117] "RemoveContainer" containerID="9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472" Sep 15 07:54:26.208009 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.207983 2582 scope.go:117] "RemoveContainer" containerID="68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe" Sep 15 07:54:26.208684 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.208664 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7"] Sep 15 07:54:26.211369 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.211351 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-r6nz7"] Sep 15 07:54:26.215507 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.215491 2582 scope.go:117] "RemoveContainer" containerID="a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b" Sep 15 07:54:26.215765 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:26.215745 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b\": container with ID starting with a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b not found: ID does not exist" containerID="a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b" Sep 15 07:54:26.215846 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.215777 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b"} err="failed to get container status \"a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b\": rpc error: code = NotFound desc = could not find container \"a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b\": container with ID starting with a8180cbd55addd838a5b20a47077a0bd2e7f68b301b7f14a6f1351916f28e95b not found: ID does not exist" Sep 15 07:54:26.215846 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.215804 2582 scope.go:117] "RemoveContainer" containerID="57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e" Sep 15 07:54:26.216061 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:26.216045 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e\": container with ID starting with 57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e not found: ID does not exist" containerID="57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e" Sep 15 07:54:26.216124 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.216070 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e"} err="failed to get container status \"57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e\": rpc error: code = NotFound desc = could not find container \"57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e\": container with ID starting with 57f5cc10be783a8db9a7ef79ce98c095d5c0397384c23a7b0dab3ffd8523c58e not found: ID does not exist" Sep 15 07:54:26.216124 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.216092 2582 scope.go:117] "RemoveContainer" containerID="5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9" Sep 15 07:54:26.216344 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:26.216326 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9\": container with ID starting with 5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9 not found: ID does not exist" containerID="5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9" Sep 15 07:54:26.216385 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.216349 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9"} err="failed to get container status \"5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9\": rpc error: code = NotFound desc = could not find container \"5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9\": container with ID starting with 5cdb6b59a9b718ba99b0222b777a97c448fe46828930940de731f71756ecfae9 not found: ID does not exist" Sep 15 07:54:26.216385 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.216364 2582 scope.go:117] "RemoveContainer" containerID="fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5" Sep 15 07:54:26.216621 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:26.216599 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5\": container with ID starting with fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5 not found: ID does not exist" containerID="fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5" Sep 15 07:54:26.216671 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.216628 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5"} err="failed to get container status \"fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5\": rpc error: code = NotFound desc = could not find container \"fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5\": container with ID starting with fefedd9c18164a2e1419e5db3bd80c442bdbfdcf73921679ea4e044b47ae8eb5 not found: ID does not exist" Sep 15 07:54:26.216671 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.216643 2582 scope.go:117] "RemoveContainer" containerID="9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472" Sep 15 07:54:26.216990 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:26.216972 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472\": container with ID starting with 9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472 not found: ID does not exist" containerID="9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472" Sep 15 07:54:26.217064 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.217005 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472"} err="failed to get container status \"9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472\": rpc error: code = NotFound desc = could not find container \"9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472\": container with ID starting with 9afd90feadecb1a342e6c4d47f3c3e5e4250a7a7d8418f1d7f730cc56be3b472 not found: ID does not exist" Sep 15 07:54:26.217064 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.217023 2582 scope.go:117] "RemoveContainer" containerID="68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe" Sep 15 07:54:26.217368 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:26.217351 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe\": container with ID starting with 68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe not found: ID does not exist" containerID="68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe" Sep 15 07:54:26.217429 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:26.217373 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe"} err="failed to get container status \"68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe\": rpc error: code = NotFound desc = could not find container \"68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe\": container with ID starting with 68e8007af9e58b12f8b4db7d85e0f48ddcfb1ef4dfddb2f4783c4382e8faf9fe not found: ID does not exist" Sep 15 07:54:28.176892 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:28.176858 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" path="/var/lib/kubelet/pods/b4cc15a0-56c2-4cd9-a06b-dc7f444567bb/volumes" Sep 15 07:54:28.177468 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:28.177455 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" path="/var/lib/kubelet/pods/c741885f-15e2-4656-a17e-e7de0f7c6ae3/volumes" Sep 15 07:54:43.540374 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:43.540280 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4"] Sep 15 07:54:43.540900 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:43.540519 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" podUID="83a2bfd2-0a8f-40a1-b882-3e05c24be919" containerName="manager" containerID="cri-o://c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d" gracePeriod=10 Sep 15 07:54:43.783125 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:43.783093 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:54:43.883795 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:43.883703 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4wlm\" (UniqueName: \"kubernetes.io/projected/83a2bfd2-0a8f-40a1-b882-3e05c24be919-kube-api-access-h4wlm\") pod \"83a2bfd2-0a8f-40a1-b882-3e05c24be919\" (UID: \"83a2bfd2-0a8f-40a1-b882-3e05c24be919\") " Sep 15 07:54:43.885783 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:43.885753 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83a2bfd2-0a8f-40a1-b882-3e05c24be919-kube-api-access-h4wlm" (OuterVolumeSpecName: "kube-api-access-h4wlm") pod "83a2bfd2-0a8f-40a1-b882-3e05c24be919" (UID: "83a2bfd2-0a8f-40a1-b882-3e05c24be919"). InnerVolumeSpecName "kube-api-access-h4wlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:54:43.984945 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:43.984911 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4wlm\" (UniqueName: \"kubernetes.io/projected/83a2bfd2-0a8f-40a1-b882-3e05c24be919-kube-api-access-h4wlm\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:54:44.228868 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.228826 2582 generic.go:356] "Generic (PLEG): container finished" podID="83a2bfd2-0a8f-40a1-b882-3e05c24be919" containerID="c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d" exitCode=0 Sep 15 07:54:44.229039 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.228872 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" Sep 15 07:54:44.229039 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.228886 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" event={"ID":"83a2bfd2-0a8f-40a1-b882-3e05c24be919","Type":"ContainerDied","Data":"c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d"} Sep 15 07:54:44.229039 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.228936 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4" event={"ID":"83a2bfd2-0a8f-40a1-b882-3e05c24be919","Type":"ContainerDied","Data":"0f4ba794083020ab04e8c43ca44a5849228866761edb107113c39e5fa0019ecc"} Sep 15 07:54:44.229039 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.228965 2582 scope.go:117] "RemoveContainer" containerID="c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d" Sep 15 07:54:44.236745 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.236721 2582 scope.go:117] "RemoveContainer" containerID="c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d" Sep 15 07:54:44.237027 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:54:44.237007 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d\": container with ID starting with c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d not found: ID does not exist" containerID="c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d" Sep 15 07:54:44.237080 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.237037 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d"} err="failed to get container status \"c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d\": rpc error: code = NotFound desc = could not find container \"c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d\": container with ID starting with c419ae263309cd38ef45e7a8f5eae7978db48975bfb750536c880aac172d173d not found: ID does not exist" Sep 15 07:54:44.244787 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.244765 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4"] Sep 15 07:54:44.251635 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:44.251613 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-vswn4"] Sep 15 07:54:46.176710 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:46.176675 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83a2bfd2-0a8f-40a1-b882-3e05c24be919" path="/var/lib/kubelet/pods/83a2bfd2-0a8f-40a1-b882-3e05c24be919/volumes" Sep 15 07:54:48.389240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389188 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t"] Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389447 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="feast-apply" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389457 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="feast-apply" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389467 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389472 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389479 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389485 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389493 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389500 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389507 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="feast-init" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389513 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="feast-init" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389521 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="registry" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389548 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="registry" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389561 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="feast-init" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389566 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="feast-init" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389571 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="offline" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389576 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="offline" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389583 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="offline" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389588 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="offline" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389593 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389597 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389603 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83a2bfd2-0a8f-40a1-b882-3e05c24be919" containerName="manager" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389608 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="83a2bfd2-0a8f-40a1-b882-3e05c24be919" containerName="manager" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389616 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="feast-apply" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389620 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="feast-apply" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389677 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="online" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389685 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="offline" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389691 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="ui" Sep 15 07:54:48.389680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389697 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="offline" Sep 15 07:54:48.391002 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389703 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="ui" Sep 15 07:54:48.391002 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389710 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c741885f-15e2-4656-a17e-e7de0f7c6ae3" containerName="online" Sep 15 07:54:48.391002 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389719 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="83a2bfd2-0a8f-40a1-b882-3e05c24be919" containerName="manager" Sep 15 07:54:48.391002 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.389727 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4cc15a0-56c2-4cd9-a06b-dc7f444567bb" containerName="registry" Sep 15 07:54:48.392511 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.392491 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:54:48.395407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.395384 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 15 07:54:48.395407 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.395384 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 15 07:54:48.396632 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.396605 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-q4l48\"" Sep 15 07:54:48.399329 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.399269 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t"] Sep 15 07:54:48.419893 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.419855 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbls\" (UniqueName: \"kubernetes.io/projected/672c7bcd-bd4c-4aaa-91d7-f25aa55195c4-kube-api-access-xsbls\") pod \"feast-operator-controller-manager-689b877b4b-8997t\" (UID: \"672c7bcd-bd4c-4aaa-91d7-f25aa55195c4\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:54:48.520738 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.520699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbls\" (UniqueName: \"kubernetes.io/projected/672c7bcd-bd4c-4aaa-91d7-f25aa55195c4-kube-api-access-xsbls\") pod \"feast-operator-controller-manager-689b877b4b-8997t\" (UID: \"672c7bcd-bd4c-4aaa-91d7-f25aa55195c4\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:54:48.531659 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.531631 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbls\" (UniqueName: \"kubernetes.io/projected/672c7bcd-bd4c-4aaa-91d7-f25aa55195c4-kube-api-access-xsbls\") pod \"feast-operator-controller-manager-689b877b4b-8997t\" (UID: \"672c7bcd-bd4c-4aaa-91d7-f25aa55195c4\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:54:48.704098 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.704063 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:54:48.973975 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:48.973930 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t"] Sep 15 07:54:48.976178 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:54:48.976149 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672c7bcd_bd4c_4aaa_91d7_f25aa55195c4.slice/crio-7490a8cbd6869cf1f14ecff0b6aba2aed4f2a043ae2785fa0dcd6bffda8f0234 WatchSource:0}: Error finding container 7490a8cbd6869cf1f14ecff0b6aba2aed4f2a043ae2785fa0dcd6bffda8f0234: Status 404 returned error can't find the container with id 7490a8cbd6869cf1f14ecff0b6aba2aed4f2a043ae2785fa0dcd6bffda8f0234 Sep 15 07:54:49.248672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:49.248587 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" event={"ID":"672c7bcd-bd4c-4aaa-91d7-f25aa55195c4","Type":"ContainerStarted","Data":"34da72b9719c0697ed68e9d35c743619db4cfc4bc863359dc167bdc07ac932f5"} Sep 15 07:54:49.248672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:49.248642 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" event={"ID":"672c7bcd-bd4c-4aaa-91d7-f25aa55195c4","Type":"ContainerStarted","Data":"7490a8cbd6869cf1f14ecff0b6aba2aed4f2a043ae2785fa0dcd6bffda8f0234"} Sep 15 07:54:49.248672 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:49.248674 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:54:49.266226 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:49.266173 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" podStartSLOduration=1.2661475819999999 podStartE2EDuration="1.266147582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:54:49.265784557 +0000 UTC m=+1799.577871174" watchObservedRunningTime="2026-09-15 07:54:49.266147582 +0000 UTC m=+1799.578234198" Sep 15 07:54:50.243709 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:50.243684 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:54:50.246053 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:54:50.246028 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:55:00.254377 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:00.254348 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8997t" Sep 15 07:55:05.686560 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.686509 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc"] Sep 15 07:55:05.690117 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.690095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.693055 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.693032 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 07:55:05.693055 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.693047 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 15 07:55:05.693308 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.693166 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 15 07:55:05.693308 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.693291 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 15 07:55:05.693556 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.693317 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 07:55:05.693556 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.693315 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 15 07:55:05.694435 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.694418 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7zjbd\"" Sep 15 07:55:05.703353 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.703331 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc"] Sep 15 07:55:05.763047 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.763010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.763047 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.763048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.763270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.763074 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls4tx\" (UniqueName: \"kubernetes.io/projected/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-kube-api-access-ls4tx\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.763270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.763099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.763270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.763176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.763270 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.763228 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864200 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864200 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864200 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864221 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls4tx\" (UniqueName: \"kubernetes.io/projected/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-kube-api-access-ls4tx\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864454 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.864780 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.864757 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.866829 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.866798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.866938 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.866801 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.867215 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.867194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.867253 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.867194 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:05.872960 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:05.872942 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls4tx\" (UniqueName: \"kubernetes.io/projected/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-kube-api-access-ls4tx\") pod \"feast-simple-feast-setup-57576b8fcf-cc4kc\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:06.010846 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:06.010754 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:06.286368 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:06.286337 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc"] Sep 15 07:55:06.288406 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:55:06.288379 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod861c0ffc_e384_4abc_8ff1_b1124d43f7ee.slice/crio-42a9d0b062480844002e9cb1e65cafbacc15f9d66d9738d9b9b159e8be17411b WatchSource:0}: Error finding container 42a9d0b062480844002e9cb1e65cafbacc15f9d66d9738d9b9b159e8be17411b: Status 404 returned error can't find the container with id 42a9d0b062480844002e9cb1e65cafbacc15f9d66d9738d9b9b159e8be17411b Sep 15 07:55:06.318384 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:06.318353 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"42a9d0b062480844002e9cb1e65cafbacc15f9d66d9738d9b9b159e8be17411b"} Sep 15 07:55:07.323717 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:07.323679 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649"} Sep 15 07:55:11.340355 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:11.340312 2582 generic.go:356] "Generic (PLEG): container finished" podID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerID="dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649" exitCode=0 Sep 15 07:55:11.340823 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:11.340384 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649"} Sep 15 07:55:12.345867 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:12.345829 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62"} Sep 15 07:55:17.365922 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:17.365889 2582 generic.go:356] "Generic (PLEG): container finished" podID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerID="41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62" exitCode=0 Sep 15 07:55:17.366354 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:17.365963 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62"} Sep 15 07:55:18.376286 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:18.376243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d"} Sep 15 07:55:18.376800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:18.376308 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63"} Sep 15 07:55:18.376800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:18.376334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944"} Sep 15 07:55:18.376800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:18.376354 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerStarted","Data":"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf"} Sep 15 07:55:18.403396 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:18.403329 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podStartSLOduration=13.403291342 podStartE2EDuration="13.403291342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:55:18.399299067 +0000 UTC m=+1828.711385696" watchObservedRunningTime="2026-09-15 07:55:18.403291342 +0000 UTC m=+1828.715377962" Sep 15 07:55:21.011455 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.011414 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:21.011964 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.011478 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:21.011964 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.011501 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:21.011964 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.011519 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:21.013645 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.013568 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 07:55:21.013645 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.013572 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused" Sep 15 07:55:21.013844 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.013624 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused" Sep 15 07:55:21.013844 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:21.013760 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 07:55:24.011831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:24.011778 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused" Sep 15 07:55:24.011831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:24.011834 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 07:55:24.012415 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:24.011782 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused" Sep 15 07:55:24.012415 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:24.011842 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused" Sep 15 07:55:26.011471 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:26.011432 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:26.011921 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:26.011507 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:26.011921 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:26.011559 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:26.011921 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:26.011572 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.011815 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.011785 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.012283 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.012125 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.012347 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.012287 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.017011 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.016985 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.423222 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.423193 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.423418 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.423255 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.423418 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.423291 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:55:27.425811 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:55:27.425788 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:56:29.974230 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:29.974191 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc"] Sep 15 07:56:29.976896 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:29.974472 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="registry" containerID="cri-o://d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf" gracePeriod=30 Sep 15 07:56:29.976896 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:29.974519 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" containerID="cri-o://4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d" gracePeriod=30 Sep 15 07:56:29.976896 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:29.974559 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="offline" containerID="cri-o://89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63" gracePeriod=30 Sep 15 07:56:29.976896 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:29.975826 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" containerID="cri-o://46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944" gracePeriod=30 Sep 15 07:56:30.374932 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.374834 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr"] Sep 15 07:56:30.378701 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.378675 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.381508 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.381482 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-btt5r\"" Sep 15 07:56:30.390573 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.390522 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr"] Sep 15 07:56:30.549858 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.549809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.550053 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.549878 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ac8911-956b-470f-973e-e786df6d4997-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.550053 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.549919 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.550053 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.549983 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.550053 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.550026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdt8b\" (UniqueName: \"kubernetes.io/projected/63ac8911-956b-470f-973e-e786df6d4997-kube-api-access-wdt8b\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.550253 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.550067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651092 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651092 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdt8b\" (UniqueName: \"kubernetes.io/projected/63ac8911-956b-470f-973e-e786df6d4997-kube-api-access-wdt8b\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651352 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651120 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651352 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651159 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651352 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ac8911-956b-470f-973e-e786df6d4997-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651352 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651204 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.651728 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.651701 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ac8911-956b-470f-973e-e786df6d4997-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.653965 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.653933 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.654084 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.654048 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.654150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.654051 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.654150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.654107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.661143 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.661096 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdt8b\" (UniqueName: \"kubernetes.io/projected/63ac8911-956b-470f-973e-e786df6d4997-kube-api-access-wdt8b\") pod \"feast-simple-feast-setup-57576b8fcf-pwckr\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.677824 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.677791 2582 generic.go:356] "Generic (PLEG): container finished" podID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerID="4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d" exitCode=0 Sep 15 07:56:30.677966 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.677840 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d"} Sep 15 07:56:30.689721 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.689693 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:30.972157 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:30.972124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr"] Sep 15 07:56:30.974727 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:56:30.974699 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63ac8911_956b_470f_973e_e786df6d4997.slice/crio-9eaa261720fafe85542cc0911b688ece78a8196ebca3e150aae37cbe6a8a6fc6 WatchSource:0}: Error finding container 9eaa261720fafe85542cc0911b688ece78a8196ebca3e150aae37cbe6a8a6fc6: Status 404 returned error can't find the container with id 9eaa261720fafe85542cc0911b688ece78a8196ebca3e150aae37cbe6a8a6fc6 Sep 15 07:56:31.683181 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:31.683140 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa"} Sep 15 07:56:31.683408 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:31.683198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"9eaa261720fafe85542cc0911b688ece78a8196ebca3e150aae37cbe6a8a6fc6"} Sep 15 07:56:31.686458 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:31.686431 2582 generic.go:356] "Generic (PLEG): container finished" podID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerID="46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944" exitCode=0 Sep 15 07:56:31.686597 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:31.686479 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944"} Sep 15 07:56:36.707052 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:36.707015 2582 generic.go:356] "Generic (PLEG): container finished" podID="63ac8911-956b-470f-973e-e786df6d4997" containerID="2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa" exitCode=0 Sep 15 07:56:36.707433 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:36.707089 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa"} Sep 15 07:56:37.422906 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:37.422852 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused" Sep 15 07:56:37.423113 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:37.422865 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 07:56:37.713240 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:37.713155 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c"} Sep 15 07:56:42.735654 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:42.735618 2582 generic.go:356] "Generic (PLEG): container finished" podID="63ac8911-956b-470f-973e-e786df6d4997" containerID="e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c" exitCode=0 Sep 15 07:56:42.736060 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:42.735691 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c"} Sep 15 07:56:43.745956 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:43.745918 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9"} Sep 15 07:56:43.746439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:43.745981 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100"} Sep 15 07:56:43.746439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:43.746003 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0"} Sep 15 07:56:43.746439 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:43.746023 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerStarted","Data":"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c"} Sep 15 07:56:43.772671 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:43.772598 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podStartSLOduration=13.772576087000001 podStartE2EDuration="13.772576087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:56:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:56:43.771191932 +0000 UTC m=+1914.083278550" watchObservedRunningTime="2026-09-15 07:56:43.772576087 +0000 UTC m=+1914.084662708" Sep 15 07:56:45.690064 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.690013 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:45.690581 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.690080 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:45.691516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.690928 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:45.691516 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.690961 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:45.692136 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.692102 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 07:56:45.692136 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.692110 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused" Sep 15 07:56:45.692323 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.692140 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused" Sep 15 07:56:45.692323 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:45.692246 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused" Sep 15 07:56:47.423469 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:47.423398 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 07:56:47.424112 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:47.423586 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused" Sep 15 07:56:48.691471 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:48.691420 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 07:56:48.691996 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:48.691653 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused" Sep 15 07:56:48.691996 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:48.691887 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused" Sep 15 07:56:48.691996 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:48.691941 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.36:6571: connect: connection refused" Sep 15 07:56:50.690831 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:50.690776 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:50.691321 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:50.690843 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:50.691321 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:50.690863 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:50.691321 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:50.690874 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.691217 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.691178 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.691752 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.691400 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.692021 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.691994 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.692107 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.692081 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.692158 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.692131 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.696727 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.696701 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.788581 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.788554 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:51.791230 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:51.791206 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 07:56:57.423405 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:57.423358 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused" Sep 15 07:56:57.423909 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:57.423377 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused" Sep 15 07:56:57.423909 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:57.423489 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:56:57.423909 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:56:57.423578 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:57:00.628813 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.628787 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:57:00.716252 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.716212 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-offline-tls\") pod \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " Sep 15 07:57:00.716252 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.716252 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls4tx\" (UniqueName: \"kubernetes.io/projected/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-kube-api-access-ls4tx\") pod \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " Sep 15 07:57:00.716520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.716289 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-ui-tls\") pod \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " Sep 15 07:57:00.716520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.716333 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-registry-tls\") pod \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " Sep 15 07:57:00.716520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.716361 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-feast-data\") pod \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " Sep 15 07:57:00.716520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.716413 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-online-tls\") pod \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\" (UID: \"861c0ffc-e384-4abc-8ff1-b1124d43f7ee\") " Sep 15 07:57:00.717078 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.717038 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-feast-data" (OuterVolumeSpecName: "feast-data") pod "861c0ffc-e384-4abc-8ff1-b1124d43f7ee" (UID: "861c0ffc-e384-4abc-8ff1-b1124d43f7ee"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 07:57:00.718769 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.718733 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-online-tls" (OuterVolumeSpecName: "online-tls") pod "861c0ffc-e384-4abc-8ff1-b1124d43f7ee" (UID: "861c0ffc-e384-4abc-8ff1-b1124d43f7ee"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:57:00.718769 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.718747 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "861c0ffc-e384-4abc-8ff1-b1124d43f7ee" (UID: "861c0ffc-e384-4abc-8ff1-b1124d43f7ee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:57:00.718769 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.718733 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-kube-api-access-ls4tx" (OuterVolumeSpecName: "kube-api-access-ls4tx") pod "861c0ffc-e384-4abc-8ff1-b1124d43f7ee" (UID: "861c0ffc-e384-4abc-8ff1-b1124d43f7ee"). InnerVolumeSpecName "kube-api-access-ls4tx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 07:57:00.718992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.718893 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "861c0ffc-e384-4abc-8ff1-b1124d43f7ee" (UID: "861c0ffc-e384-4abc-8ff1-b1124d43f7ee"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:57:00.718992 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.718915 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "861c0ffc-e384-4abc-8ff1-b1124d43f7ee" (UID: "861c0ffc-e384-4abc-8ff1-b1124d43f7ee"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 07:57:00.817196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.817099 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-offline-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:57:00.817196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.817134 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls4tx\" (UniqueName: \"kubernetes.io/projected/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-kube-api-access-ls4tx\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:57:00.817196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.817144 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-ui-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:57:00.817196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.817154 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:57:00.817196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.817163 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-feast-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:57:00.817196 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.817172 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/861c0ffc-e384-4abc-8ff1-b1124d43f7ee-online-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 07:57:00.825213 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825176 2582 generic.go:356] "Generic (PLEG): container finished" podID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerID="89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63" exitCode=137 Sep 15 07:57:00.825213 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825204 2582 generic.go:356] "Generic (PLEG): container finished" podID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerID="d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf" exitCode=137 Sep 15 07:57:00.825437 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825229 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63"} Sep 15 07:57:00.825437 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825254 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" Sep 15 07:57:00.825437 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825271 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf"} Sep 15 07:57:00.825437 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825290 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc" event={"ID":"861c0ffc-e384-4abc-8ff1-b1124d43f7ee","Type":"ContainerDied","Data":"42a9d0b062480844002e9cb1e65cafbacc15f9d66d9738d9b9b159e8be17411b"} Sep 15 07:57:00.825437 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.825313 2582 scope.go:117] "RemoveContainer" containerID="4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d" Sep 15 07:57:00.834172 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.834153 2582 scope.go:117] "RemoveContainer" containerID="89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63" Sep 15 07:57:00.841951 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.841933 2582 scope.go:117] "RemoveContainer" containerID="46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944" Sep 15 07:57:00.848700 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.848674 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc"] Sep 15 07:57:00.850126 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.850112 2582 scope.go:117] "RemoveContainer" containerID="d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf" Sep 15 07:57:00.854166 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.854145 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cc4kc"] Sep 15 07:57:00.859893 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.859875 2582 scope.go:117] "RemoveContainer" containerID="41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62" Sep 15 07:57:00.867456 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.867437 2582 scope.go:117] "RemoveContainer" containerID="dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649" Sep 15 07:57:00.874499 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.874460 2582 scope.go:117] "RemoveContainer" containerID="4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d" Sep 15 07:57:00.874805 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:00.874786 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d\": container with ID starting with 4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d not found: ID does not exist" containerID="4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d" Sep 15 07:57:00.874878 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.874819 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d"} err="failed to get container status \"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d\": rpc error: code = NotFound desc = could not find container \"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d\": container with ID starting with 4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d not found: ID does not exist" Sep 15 07:57:00.874878 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.874844 2582 scope.go:117] "RemoveContainer" containerID="89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63" Sep 15 07:57:00.875119 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:00.875102 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63\": container with ID starting with 89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63 not found: ID does not exist" containerID="89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63" Sep 15 07:57:00.875156 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875130 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63"} err="failed to get container status \"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63\": rpc error: code = NotFound desc = could not find container \"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63\": container with ID starting with 89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63 not found: ID does not exist" Sep 15 07:57:00.875156 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875147 2582 scope.go:117] "RemoveContainer" containerID="46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944" Sep 15 07:57:00.875368 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:00.875351 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944\": container with ID starting with 46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944 not found: ID does not exist" containerID="46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944" Sep 15 07:57:00.875429 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875378 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944"} err="failed to get container status \"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944\": rpc error: code = NotFound desc = could not find container \"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944\": container with ID starting with 46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944 not found: ID does not exist" Sep 15 07:57:00.875429 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875400 2582 scope.go:117] "RemoveContainer" containerID="d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf" Sep 15 07:57:00.875667 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:00.875645 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf\": container with ID starting with d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf not found: ID does not exist" containerID="d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf" Sep 15 07:57:00.875716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875678 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf"} err="failed to get container status \"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf\": rpc error: code = NotFound desc = could not find container \"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf\": container with ID starting with d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf not found: ID does not exist" Sep 15 07:57:00.875716 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875700 2582 scope.go:117] "RemoveContainer" containerID="41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62" Sep 15 07:57:00.875935 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:00.875914 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62\": container with ID starting with 41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62 not found: ID does not exist" containerID="41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62" Sep 15 07:57:00.876014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875942 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62"} err="failed to get container status \"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62\": rpc error: code = NotFound desc = could not find container \"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62\": container with ID starting with 41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62 not found: ID does not exist" Sep 15 07:57:00.876014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.875963 2582 scope.go:117] "RemoveContainer" containerID="dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649" Sep 15 07:57:00.876198 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:00.876174 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649\": container with ID starting with dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649 not found: ID does not exist" containerID="dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649" Sep 15 07:57:00.876249 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876194 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649"} err="failed to get container status \"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649\": rpc error: code = NotFound desc = could not find container \"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649\": container with ID starting with dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649 not found: ID does not exist" Sep 15 07:57:00.876249 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876206 2582 scope.go:117] "RemoveContainer" containerID="4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d" Sep 15 07:57:00.876467 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876448 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d"} err="failed to get container status \"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d\": rpc error: code = NotFound desc = could not find container \"4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d\": container with ID starting with 4b78d604c30fd1b5c0439127823e12e6b1bf3e37cbeac408f3d40ba6d00f337d not found: ID does not exist" Sep 15 07:57:00.876517 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876467 2582 scope.go:117] "RemoveContainer" containerID="89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63" Sep 15 07:57:00.876744 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876725 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63"} err="failed to get container status \"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63\": rpc error: code = NotFound desc = could not find container \"89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63\": container with ID starting with 89b6fa73c51cdc1cc8520788d151b3932fc0c13f4f8dbbbce1c8abf47513af63 not found: ID does not exist" Sep 15 07:57:00.876807 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876745 2582 scope.go:117] "RemoveContainer" containerID="46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944" Sep 15 07:57:00.876985 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876967 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944"} err="failed to get container status \"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944\": rpc error: code = NotFound desc = could not find container \"46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944\": container with ID starting with 46a6378cf3761370ca878af1cf9eb60eef158b61f5a0a0e4fa4043305130a944 not found: ID does not exist" Sep 15 07:57:00.877029 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.876986 2582 scope.go:117] "RemoveContainer" containerID="d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf" Sep 15 07:57:00.877219 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.877198 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf"} err="failed to get container status \"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf\": rpc error: code = NotFound desc = could not find container \"d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf\": container with ID starting with d2a5d8a0988772df1ee708362db80b2a2408d3e890cbe72d1bc861dedeed35cf not found: ID does not exist" Sep 15 07:57:00.877305 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.877219 2582 scope.go:117] "RemoveContainer" containerID="41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62" Sep 15 07:57:00.877492 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.877474 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62"} err="failed to get container status \"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62\": rpc error: code = NotFound desc = could not find container \"41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62\": container with ID starting with 41a9f23e7a2b812762c0855cd911dc0cbaca53bc08ffcb73dcaf67cc7a86db62 not found: ID does not exist" Sep 15 07:57:00.877552 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.877495 2582 scope.go:117] "RemoveContainer" containerID="dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649" Sep 15 07:57:00.877727 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:00.877711 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649"} err="failed to get container status \"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649\": rpc error: code = NotFound desc = could not find container \"dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649\": container with ID starting with dfc72f348f46e193a07f7b094d9e85b2ce6fb887a85e6019f32e21bdbbce7649 not found: ID does not exist" Sep 15 07:57:02.177934 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:02.177903 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" path="/var/lib/kubelet/pods/861c0ffc-e384-4abc-8ff1-b1124d43f7ee/volumes" Sep 15 07:57:53.192695 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.192658 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk"] Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.192952 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="offline" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.192964 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="offline" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.192981 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="feast-init" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.192990 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="feast-init" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.192999 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="registry" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193004 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="registry" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193011 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193016 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193030 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="feast-apply" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193035 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="feast-apply" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193044 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193067 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193123 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="registry" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193132 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="online" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193146 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="ui" Sep 15 07:57:53.193186 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.193151 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="861c0ffc-e384-4abc-8ff1-b1124d43f7ee" containerName="offline" Sep 15 07:57:53.197688 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.197670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.200625 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.200604 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 15 07:57:53.200773 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.200727 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 15 07:57:53.200840 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.200772 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 15 07:57:53.200840 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.200782 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9jk5r\"" Sep 15 07:57:53.200840 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.200789 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 15 07:57:53.201094 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.201079 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 15 07:57:53.201145 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.201126 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 15 07:57:53.207882 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.207862 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk"] Sep 15 07:57:53.215823 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.215796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.215957 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.215839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bspzj\" (UniqueName: \"kubernetes.io/projected/de15c4f8-1bf1-488f-aef9-c4339d72b60c-kube-api-access-bspzj\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.215957 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.215882 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.215957 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.215903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/de15c4f8-1bf1-488f-aef9-c4339d72b60c-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.216134 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.215967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.216134 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.216015 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de15c4f8-1bf1-488f-aef9-c4339d72b60c-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.316968 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.316937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de15c4f8-1bf1-488f-aef9-c4339d72b60c-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.316982 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.317011 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bspzj\" (UniqueName: \"kubernetes.io/projected/de15c4f8-1bf1-488f-aef9-c4339d72b60c-kube-api-access-bspzj\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.317036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.317057 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/de15c4f8-1bf1-488f-aef9-c4339d72b60c-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317150 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.317095 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317150 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:53.317147 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 15 07:57:53.317421 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:53.317184 2582 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 07:57:53.317421 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:53.317229 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls podName:de15c4f8-1bf1-488f-aef9-c4339d72b60c nodeName:}" failed. No retries permitted until 2026-09-15 07:57:53.817208119 +0000 UTC m=+1984.129294731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 15 07:57:53.317421 ip-10-0-139-67 kubenswrapper[2582]: E0915 07:57:53.317247 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls podName:de15c4f8-1bf1-488f-aef9-c4339d72b60c nodeName:}" failed. No retries permitted until 2026-09-15 07:57:53.81723818 +0000 UTC m=+1984.129324774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 07:57:53.317421 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.317370 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de15c4f8-1bf1-488f-aef9-c4339d72b60c-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.317761 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.317741 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/de15c4f8-1bf1-488f-aef9-c4339d72b60c-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.319480 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.319466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.328680 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.328658 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bspzj\" (UniqueName: \"kubernetes.io/projected/de15c4f8-1bf1-488f-aef9-c4339d72b60c-kube-api-access-bspzj\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.820144 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.820099 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.820348 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.820163 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.822611 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.822579 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:53.822611 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:53.822601 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-vpbvk\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:54.107351 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:54.107257 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:57:54.386014 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:54.385987 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk"] Sep 15 07:57:54.386942 ip-10-0-139-67 kubenswrapper[2582]: W0915 07:57:54.386906 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde15c4f8_1bf1_488f_aef9_c4339d72b60c.slice/crio-a1c806c6cdd632d4f164f16805facbb94cf5b4c97cbcaf23cb64d9f2d8bd540f WatchSource:0}: Error finding container a1c806c6cdd632d4f164f16805facbb94cf5b4c97cbcaf23cb64d9f2d8bd540f: Status 404 returned error can't find the container with id a1c806c6cdd632d4f164f16805facbb94cf5b4c97cbcaf23cb64d9f2d8bd540f Sep 15 07:57:55.035739 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:55.035700 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerStarted","Data":"4c62ba847735b86882db3200f3ccce8017bdf85f20df3ac9fe50c13e4d06cb6f"} Sep 15 07:57:55.035739 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:57:55.035746 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerStarted","Data":"a1c806c6cdd632d4f164f16805facbb94cf5b4c97cbcaf23cb64d9f2d8bd540f"} Sep 15 07:58:00.058779 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:00.058746 2582 generic.go:356] "Generic (PLEG): container finished" podID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerID="4c62ba847735b86882db3200f3ccce8017bdf85f20df3ac9fe50c13e4d06cb6f" exitCode=0 Sep 15 07:58:00.059202 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:00.058826 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerDied","Data":"4c62ba847735b86882db3200f3ccce8017bdf85f20df3ac9fe50c13e4d06cb6f"} Sep 15 07:58:01.064761 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:01.064722 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerStarted","Data":"ecf1c7b1c8fafdc1050c47a1ee276788aa5cc6fc63fd2024b244c96b43199019"} Sep 15 07:58:20.144173 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:20.144137 2582 generic.go:356] "Generic (PLEG): container finished" podID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerID="ecf1c7b1c8fafdc1050c47a1ee276788aa5cc6fc63fd2024b244c96b43199019" exitCode=0 Sep 15 07:58:20.144592 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:20.144207 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerDied","Data":"ecf1c7b1c8fafdc1050c47a1ee276788aa5cc6fc63fd2024b244c96b43199019"} Sep 15 07:58:21.153071 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:21.153031 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerStarted","Data":"3a9b3ce9a8dfb65e568379bdfec90850b038be56f1d12d634ab3b79e50197d67"} Sep 15 07:58:21.153620 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:21.153091 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerStarted","Data":"0e5cf990fa12d9131f392ccf12680aac3d818e7627c6e982280c6fab32e99f10"} Sep 15 07:58:21.153620 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:21.153110 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerStarted","Data":"f4498c4fc4e78c1cd37e1addbf271c9de341e29923eb534032c14090260c30bd"} Sep 15 07:58:21.186520 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:21.186465 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podStartSLOduration=28.186448092 podStartE2EDuration="28.186448092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 07:57:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 07:58:21.185108128 +0000 UTC m=+2011.497194780" watchObservedRunningTime="2026-09-15 07:58:21.186448092 +0000 UTC m=+2011.498534708" Sep 15 07:58:24.107574 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.107496 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:24.107574 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.107571 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:24.108121 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.107591 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:24.108121 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.107605 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:24.108121 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.107620 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:24.108121 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.107635 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:24.109760 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.109719 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused" Sep 15 07:58:24.109908 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.109750 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused" Sep 15 07:58:24.109908 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:24.109735 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused" Sep 15 07:58:27.108038 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:27.107995 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.37:8816: connect: connection refused" Sep 15 07:58:27.108541 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:27.108051 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused" Sep 15 07:58:27.108541 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:27.107995 2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused" Sep 15 07:58:30.108767 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:30.108737 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:30.109154 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:30.108866 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:30.109508 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:30.109485 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:30.109641 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:30.109624 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:30.972985 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:30.972956 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:32.030974 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:32.030940 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 07:58:55.111687 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:58:55.111639 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 15 07:59:33.472949 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.472862 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk"] Sep 15 07:59:33.473472 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.473135 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" containerID="cri-o://f4498c4fc4e78c1cd37e1addbf271c9de341e29923eb534032c14090260c30bd" gracePeriod=30 Sep 15 07:59:33.473472 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.473286 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" containerID="cri-o://3a9b3ce9a8dfb65e568379bdfec90850b038be56f1d12d634ab3b79e50197d67" gracePeriod=30 Sep 15 07:59:33.473472 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.473424 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="offline" containerID="cri-o://0e5cf990fa12d9131f392ccf12680aac3d818e7627c6e982280c6fab32e99f10" gracePeriod=30 Sep 15 07:59:33.637800 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.637766 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr"] Sep 15 07:59:33.638036 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.638010 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="registry" containerID="cri-o://d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c" gracePeriod=30 Sep 15 07:59:33.638132 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.638059 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="offline" containerID="cri-o://4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100" gracePeriod=30 Sep 15 07:59:33.638132 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.638064 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" containerID="cri-o://a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0" gracePeriod=30 Sep 15 07:59:33.638248 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:33.638067 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" containerID="cri-o://7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9" gracePeriod=30 Sep 15 07:59:34.452566 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:34.452519 2582 generic.go:356] "Generic (PLEG): container finished" podID="63ac8911-956b-470f-973e-e786df6d4997" containerID="7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9" exitCode=0 Sep 15 07:59:34.452678 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:34.452559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9"} Sep 15 07:59:34.455091 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:34.455069 2582 generic.go:356] "Generic (PLEG): container finished" podID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerID="3a9b3ce9a8dfb65e568379bdfec90850b038be56f1d12d634ab3b79e50197d67" exitCode=0 Sep 15 07:59:34.455091 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:34.455087 2582 generic.go:356] "Generic (PLEG): container finished" podID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerID="f4498c4fc4e78c1cd37e1addbf271c9de341e29923eb534032c14090260c30bd" exitCode=0 Sep 15 07:59:34.455223 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:34.455109 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerDied","Data":"3a9b3ce9a8dfb65e568379bdfec90850b038be56f1d12d634ab3b79e50197d67"} Sep 15 07:59:34.455223 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:34.455132 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerDied","Data":"f4498c4fc4e78c1cd37e1addbf271c9de341e29923eb534032c14090260c30bd"} Sep 15 07:59:35.461690 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:35.461662 2582 generic.go:356] "Generic (PLEG): container finished" podID="63ac8911-956b-470f-973e-e786df6d4997" containerID="a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0" exitCode=0 Sep 15 07:59:35.462061 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:35.461729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0"} Sep 15 07:59:40.109422 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:40.109376 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused" Sep 15 07:59:41.201725 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:41.201676 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused" Sep 15 07:59:41.788761 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:41.788710 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused" Sep 15 07:59:41.788943 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:41.788717 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 07:59:50.109883 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:50.109829 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused" Sep 15 07:59:50.269362 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:50.269335 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:59:50.272349 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:50.272324 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 07:59:51.201462 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:51.201417 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused" Sep 15 07:59:51.788248 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:51.788202 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused" Sep 15 07:59:51.788248 ip-10-0-139-67 kubenswrapper[2582]: I0915 07:59:51.788233 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 08:00:00.109774 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:00.109727 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.37:8443: connect: connection refused" Sep 15 08:00:00.110316 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:00.109912 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 08:00:01.201451 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:01.201401 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.37:6567/health\": dial tcp 10.132.0.37:6567: connect: connection refused" Sep 15 08:00:01.201862 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:01.201573 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 08:00:01.788972 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:01.788921 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused" Sep 15 08:00:01.789186 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:01.788928 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused" Sep 15 08:00:01.789186 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:01.789049 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 08:00:01.789186 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:01.789154 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 08:00:03.575131 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:03.575100 2582 generic.go:356] "Generic (PLEG): container finished" podID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerID="0e5cf990fa12d9131f392ccf12680aac3d818e7627c6e982280c6fab32e99f10" exitCode=137 Sep 15 08:00:03.575512 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:03.575182 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerDied","Data":"0e5cf990fa12d9131f392ccf12680aac3d818e7627c6e982280c6fab32e99f10"} Sep 15 08:00:04.129307 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.129281 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 08:00:04.202852 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.202815 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-online-tls\") pod \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " Sep 15 08:00:04.203044 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.202866 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/de15c4f8-1bf1-488f-aef9-c4339d72b60c-registry-tls\") pod \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " Sep 15 08:00:04.203044 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.202891 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls\") pod \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " Sep 15 08:00:04.203044 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.203007 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bspzj\" (UniqueName: \"kubernetes.io/projected/de15c4f8-1bf1-488f-aef9-c4339d72b60c-kube-api-access-bspzj\") pod \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " Sep 15 08:00:04.203217 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.203093 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de15c4f8-1bf1-488f-aef9-c4339d72b60c-feast-data\") pod \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " Sep 15 08:00:04.203217 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.203126 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls\") pod \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\" (UID: \"de15c4f8-1bf1-488f-aef9-c4339d72b60c\") " Sep 15 08:00:04.203325 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.203274 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de15c4f8-1bf1-488f-aef9-c4339d72b60c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "de15c4f8-1bf1-488f-aef9-c4339d72b60c" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 08:00:04.203436 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.203414 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/de15c4f8-1bf1-488f-aef9-c4339d72b60c-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.203659 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.203632 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de15c4f8-1bf1-488f-aef9-c4339d72b60c-feast-data" (OuterVolumeSpecName: "feast-data") pod "de15c4f8-1bf1-488f-aef9-c4339d72b60c" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 08:00:04.205475 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.205437 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "de15c4f8-1bf1-488f-aef9-c4339d72b60c" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.205608 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.205512 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de15c4f8-1bf1-488f-aef9-c4339d72b60c-kube-api-access-bspzj" (OuterVolumeSpecName: "kube-api-access-bspzj") pod "de15c4f8-1bf1-488f-aef9-c4339d72b60c" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c"). InnerVolumeSpecName "kube-api-access-bspzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 08:00:04.205608 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.205522 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-online-tls" (OuterVolumeSpecName: "online-tls") pod "de15c4f8-1bf1-488f-aef9-c4339d72b60c" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.205713 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.205619 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "de15c4f8-1bf1-488f-aef9-c4339d72b60c" (UID: "de15c4f8-1bf1-488f-aef9-c4339d72b60c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.284428 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.284403 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 08:00:04.303928 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.303895 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-online-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.303928 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.303923 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-ui-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.303928 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.303932 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bspzj\" (UniqueName: \"kubernetes.io/projected/de15c4f8-1bf1-488f-aef9-c4339d72b60c-kube-api-access-bspzj\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.304139 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.303941 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de15c4f8-1bf1-488f-aef9-c4339d72b60c-feast-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.304139 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.303951 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de15c4f8-1bf1-488f-aef9-c4339d72b60c-offline-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.404702 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.404666 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-registry-tls\") pod \"63ac8911-956b-470f-973e-e786df6d4997\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " Sep 15 08:00:04.404702 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.404700 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-offline-tls\") pod \"63ac8911-956b-470f-973e-e786df6d4997\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " Sep 15 08:00:04.404918 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.404728 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ac8911-956b-470f-973e-e786df6d4997-feast-data\") pod \"63ac8911-956b-470f-973e-e786df6d4997\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " Sep 15 08:00:04.404918 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.404777 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdt8b\" (UniqueName: \"kubernetes.io/projected/63ac8911-956b-470f-973e-e786df6d4997-kube-api-access-wdt8b\") pod \"63ac8911-956b-470f-973e-e786df6d4997\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " Sep 15 08:00:04.404918 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.404815 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-ui-tls\") pod \"63ac8911-956b-470f-973e-e786df6d4997\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " Sep 15 08:00:04.404918 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.404833 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-online-tls\") pod \"63ac8911-956b-470f-973e-e786df6d4997\" (UID: \"63ac8911-956b-470f-973e-e786df6d4997\") " Sep 15 08:00:04.405299 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.405267 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ac8911-956b-470f-973e-e786df6d4997-feast-data" (OuterVolumeSpecName: "feast-data") pod "63ac8911-956b-470f-973e-e786df6d4997" (UID: "63ac8911-956b-470f-973e-e786df6d4997"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 08:00:04.407081 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.407050 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "63ac8911-956b-470f-973e-e786df6d4997" (UID: "63ac8911-956b-470f-973e-e786df6d4997"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.407169 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.407073 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-online-tls" (OuterVolumeSpecName: "online-tls") pod "63ac8911-956b-470f-973e-e786df6d4997" (UID: "63ac8911-956b-470f-973e-e786df6d4997"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.407169 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.407088 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "63ac8911-956b-470f-973e-e786df6d4997" (UID: "63ac8911-956b-470f-973e-e786df6d4997"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.407336 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.407317 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "63ac8911-956b-470f-973e-e786df6d4997" (UID: "63ac8911-956b-470f-973e-e786df6d4997"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 08:00:04.407427 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.407333 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ac8911-956b-470f-973e-e786df6d4997-kube-api-access-wdt8b" (OuterVolumeSpecName: "kube-api-access-wdt8b") pod "63ac8911-956b-470f-973e-e786df6d4997" (UID: "63ac8911-956b-470f-973e-e786df6d4997"). InnerVolumeSpecName "kube-api-access-wdt8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 08:00:04.505867 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.505826 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdt8b\" (UniqueName: \"kubernetes.io/projected/63ac8911-956b-470f-973e-e786df6d4997-kube-api-access-wdt8b\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.505867 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.505859 2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-ui-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.505867 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.505870 2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-online-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.506098 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.505881 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-registry-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.506098 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.505889 2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/63ac8911-956b-470f-973e-e786df6d4997-offline-tls\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.506098 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.505896 2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/63ac8911-956b-470f-973e-e786df6d4997-feast-data\") on node \"ip-10-0-139-67.ec2.internal\" DevicePath \"\"" Sep 15 08:00:04.581679 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.581604 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" Sep 15 08:00:04.582114 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.581600 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk" event={"ID":"de15c4f8-1bf1-488f-aef9-c4339d72b60c","Type":"ContainerDied","Data":"a1c806c6cdd632d4f164f16805facbb94cf5b4c97cbcaf23cb64d9f2d8bd540f"} Sep 15 08:00:04.582114 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.581744 2582 scope.go:117] "RemoveContainer" containerID="3a9b3ce9a8dfb65e568379bdfec90850b038be56f1d12d634ab3b79e50197d67" Sep 15 08:00:04.584941 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.584918 2582 generic.go:356] "Generic (PLEG): container finished" podID="63ac8911-956b-470f-973e-e786df6d4997" containerID="4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100" exitCode=137 Sep 15 08:00:04.584941 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.584939 2582 generic.go:356] "Generic (PLEG): container finished" podID="63ac8911-956b-470f-973e-e786df6d4997" containerID="d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c" exitCode=137 Sep 15 08:00:04.585079 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.584976 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100"} Sep 15 08:00:04.585079 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.585005 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c"} Sep 15 08:00:04.585079 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.585007 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" Sep 15 08:00:04.585079 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.585022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr" event={"ID":"63ac8911-956b-470f-973e-e786df6d4997","Type":"ContainerDied","Data":"9eaa261720fafe85542cc0911b688ece78a8196ebca3e150aae37cbe6a8a6fc6"} Sep 15 08:00:04.590828 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.590807 2582 scope.go:117] "RemoveContainer" containerID="0e5cf990fa12d9131f392ccf12680aac3d818e7627c6e982280c6fab32e99f10" Sep 15 08:00:04.598963 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.598944 2582 scope.go:117] "RemoveContainer" containerID="f4498c4fc4e78c1cd37e1addbf271c9de341e29923eb534032c14090260c30bd" Sep 15 08:00:04.606272 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.606245 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk"] Sep 15 08:00:04.607837 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.607792 2582 scope.go:117] "RemoveContainer" containerID="ecf1c7b1c8fafdc1050c47a1ee276788aa5cc6fc63fd2024b244c96b43199019" Sep 15 08:00:04.609995 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.609973 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-vpbvk"] Sep 15 08:00:04.616314 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.616280 2582 scope.go:117] "RemoveContainer" containerID="4c62ba847735b86882db3200f3ccce8017bdf85f20df3ac9fe50c13e4d06cb6f" Sep 15 08:00:04.623644 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.623407 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr"] Sep 15 08:00:04.628187 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.628167 2582 scope.go:117] "RemoveContainer" containerID="7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9" Sep 15 08:00:04.630295 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.630265 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-pwckr"] Sep 15 08:00:04.637230 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.637201 2582 scope.go:117] "RemoveContainer" containerID="4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100" Sep 15 08:00:04.645323 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.645304 2582 scope.go:117] "RemoveContainer" containerID="a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0" Sep 15 08:00:04.652713 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.652693 2582 scope.go:117] "RemoveContainer" containerID="d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c" Sep 15 08:00:04.660402 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.660383 2582 scope.go:117] "RemoveContainer" containerID="e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c" Sep 15 08:00:04.668318 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.668289 2582 scope.go:117] "RemoveContainer" containerID="2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa" Sep 15 08:00:04.675623 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.675599 2582 scope.go:117] "RemoveContainer" containerID="7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9" Sep 15 08:00:04.675942 ip-10-0-139-67 kubenswrapper[2582]: E0915 08:00:04.675921 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9\": container with ID starting with 7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9 not found: ID does not exist" containerID="7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9" Sep 15 08:00:04.675995 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.675953 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9"} err="failed to get container status \"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9\": rpc error: code = NotFound desc = could not find container \"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9\": container with ID starting with 7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9 not found: ID does not exist" Sep 15 08:00:04.675995 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.675974 2582 scope.go:117] "RemoveContainer" containerID="4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100" Sep 15 08:00:04.676228 ip-10-0-139-67 kubenswrapper[2582]: E0915 08:00:04.676211 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100\": container with ID starting with 4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100 not found: ID does not exist" containerID="4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100" Sep 15 08:00:04.676266 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.676235 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100"} err="failed to get container status \"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100\": rpc error: code = NotFound desc = could not find container \"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100\": container with ID starting with 4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100 not found: ID does not exist" Sep 15 08:00:04.676266 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.676256 2582 scope.go:117] "RemoveContainer" containerID="a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0" Sep 15 08:00:04.676497 ip-10-0-139-67 kubenswrapper[2582]: E0915 08:00:04.676479 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0\": container with ID starting with a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0 not found: ID does not exist" containerID="a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0" Sep 15 08:00:04.676566 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.676501 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0"} err="failed to get container status \"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0\": rpc error: code = NotFound desc = could not find container \"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0\": container with ID starting with a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0 not found: ID does not exist" Sep 15 08:00:04.676566 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.676544 2582 scope.go:117] "RemoveContainer" containerID="d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c" Sep 15 08:00:04.676777 ip-10-0-139-67 kubenswrapper[2582]: E0915 08:00:04.676757 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c\": container with ID starting with d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c not found: ID does not exist" containerID="d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c" Sep 15 08:00:04.676852 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.676786 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c"} err="failed to get container status \"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c\": rpc error: code = NotFound desc = could not find container \"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c\": container with ID starting with d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c not found: ID does not exist" Sep 15 08:00:04.676852 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.676808 2582 scope.go:117] "RemoveContainer" containerID="e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c" Sep 15 08:00:04.677037 ip-10-0-139-67 kubenswrapper[2582]: E0915 08:00:04.677022 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c\": container with ID starting with e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c not found: ID does not exist" containerID="e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c" Sep 15 08:00:04.677077 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677041 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c"} err="failed to get container status \"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c\": rpc error: code = NotFound desc = could not find container \"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c\": container with ID starting with e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c not found: ID does not exist" Sep 15 08:00:04.677077 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677053 2582 scope.go:117] "RemoveContainer" containerID="2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa" Sep 15 08:00:04.677241 ip-10-0-139-67 kubenswrapper[2582]: E0915 08:00:04.677227 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa\": container with ID starting with 2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa not found: ID does not exist" containerID="2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa" Sep 15 08:00:04.677287 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677244 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa"} err="failed to get container status \"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa\": rpc error: code = NotFound desc = could not find container \"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa\": container with ID starting with 2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa not found: ID does not exist" Sep 15 08:00:04.677287 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677255 2582 scope.go:117] "RemoveContainer" containerID="7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9" Sep 15 08:00:04.677469 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677449 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9"} err="failed to get container status \"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9\": rpc error: code = NotFound desc = could not find container \"7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9\": container with ID starting with 7ca7fd39dcaf737f9057b481ba7f6e9d6455c11287fa7b1a28d58e3b725d6df9 not found: ID does not exist" Sep 15 08:00:04.677589 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677471 2582 scope.go:117] "RemoveContainer" containerID="4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100" Sep 15 08:00:04.677735 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677712 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100"} err="failed to get container status \"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100\": rpc error: code = NotFound desc = could not find container \"4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100\": container with ID starting with 4cc82296736b511a6fd658412b79b343c12b20d525b72f6057628c7507dcd100 not found: ID does not exist" Sep 15 08:00:04.677802 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677736 2582 scope.go:117] "RemoveContainer" containerID="a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0" Sep 15 08:00:04.677923 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677908 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0"} err="failed to get container status \"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0\": rpc error: code = NotFound desc = could not find container \"a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0\": container with ID starting with a2980aab11e98c1389936ad363e10d83bda96e5c30ffb50beaa4aa8025a14ac0 not found: ID does not exist" Sep 15 08:00:04.677966 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.677923 2582 scope.go:117] "RemoveContainer" containerID="d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c" Sep 15 08:00:04.678113 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.678100 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c"} err="failed to get container status \"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c\": rpc error: code = NotFound desc = could not find container \"d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c\": container with ID starting with d4f36555c20b8d5c9e2e89c69232d02b9656494fdda67c49ca41be698e38b25c not found: ID does not exist" Sep 15 08:00:04.678148 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.678113 2582 scope.go:117] "RemoveContainer" containerID="e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c" Sep 15 08:00:04.678280 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.678266 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c"} err="failed to get container status \"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c\": rpc error: code = NotFound desc = could not find container \"e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c\": container with ID starting with e676c82dad655b1685aebe634c47c4fe4c471a857aecfd9ee4c515ce19dc2e4c not found: ID does not exist" Sep 15 08:00:04.678280 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.678279 2582 scope.go:117] "RemoveContainer" containerID="2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa" Sep 15 08:00:04.678473 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:04.678453 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa"} err="failed to get container status \"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa\": rpc error: code = NotFound desc = could not find container \"2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa\": container with ID starting with 2af8dcb184e7b396e72b661a48de202ccf632ea41b5c7e136f2d48e8b790f2fa not found: ID does not exist" Sep 15 08:00:06.177216 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:06.177186 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ac8911-956b-470f-973e-e786df6d4997" path="/var/lib/kubelet/pods/63ac8911-956b-470f-973e-e786df6d4997/volumes" Sep 15 08:00:06.177813 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:06.177799 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" path="/var/lib/kubelet/pods/de15c4f8-1bf1-488f-aef9-c4339d72b60c/volumes" Sep 15 08:00:43.201940 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.201859 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2wd7/must-gather-4p5tr"] Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202160 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202172 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202186 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="registry" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202192 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="registry" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202198 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="feast-init" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202203 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="feast-init" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202209 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="offline" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202214 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="offline" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202223 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="feast-apply" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202229 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="feast-apply" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202236 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="feast-init" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202242 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="feast-init" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202251 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="offline" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202256 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="offline" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202262 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202267 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202274 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202279 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202285 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="feast-apply" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202290 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="feast-apply" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202298 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202303 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202346 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="online" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202353 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="ui" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202359 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="registry" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202366 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="offline" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202371 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ac8911-956b-470f-973e-e786df6d4997" containerName="ui" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202377 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="online" Sep 15 08:00:43.202390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.202383 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="de15c4f8-1bf1-488f-aef9-c4339d72b60c" containerName="offline" Sep 15 08:00:43.205329 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.205305 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.205544 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.205503 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9zx\" (UniqueName: \"kubernetes.io/projected/bf3efddf-f0d5-4dbc-b634-6e6b529b1e58-kube-api-access-lt9zx\") pod \"must-gather-4p5tr\" (UID: \"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58\") " pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.205640 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.205574 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf3efddf-f0d5-4dbc-b634-6e6b529b1e58-must-gather-output\") pod \"must-gather-4p5tr\" (UID: \"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58\") " pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.208439 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.208421 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2wd7\"/\"kube-root-ca.crt\"" Sep 15 08:00:43.209657 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.209639 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2wd7\"/\"default-dockercfg-p2kfg\"" Sep 15 08:00:43.209726 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.209662 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2wd7\"/\"openshift-service-ca.crt\"" Sep 15 08:00:43.214800 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.214776 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2wd7/must-gather-4p5tr"] Sep 15 08:00:43.306401 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.306369 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9zx\" (UniqueName: \"kubernetes.io/projected/bf3efddf-f0d5-4dbc-b634-6e6b529b1e58-kube-api-access-lt9zx\") pod \"must-gather-4p5tr\" (UID: \"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58\") " pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.306401 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.306405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf3efddf-f0d5-4dbc-b634-6e6b529b1e58-must-gather-output\") pod \"must-gather-4p5tr\" (UID: \"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58\") " pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.306723 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.306708 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf3efddf-f0d5-4dbc-b634-6e6b529b1e58-must-gather-output\") pod \"must-gather-4p5tr\" (UID: \"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58\") " pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.316441 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.316412 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9zx\" (UniqueName: \"kubernetes.io/projected/bf3efddf-f0d5-4dbc-b634-6e6b529b1e58-kube-api-access-lt9zx\") pod \"must-gather-4p5tr\" (UID: \"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58\") " pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.528655 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.528568 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2wd7/must-gather-4p5tr" Sep 15 08:00:43.799035 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.798949 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2wd7/must-gather-4p5tr"] Sep 15 08:00:43.801932 ip-10-0-139-67 kubenswrapper[2582]: W0915 08:00:43.801903 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf3efddf_f0d5_4dbc_b634_6e6b529b1e58.slice/crio-65870837ca8f8612241366229543664c3458b6653dc69516e4284a3cb3c3d918 WatchSource:0}: Error finding container 65870837ca8f8612241366229543664c3458b6653dc69516e4284a3cb3c3d918: Status 404 returned error can't find the container with id 65870837ca8f8612241366229543664c3458b6653dc69516e4284a3cb3c3d918 Sep 15 08:00:43.803863 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:43.803843 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 08:00:44.737209 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:44.737181 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2wd7/must-gather-4p5tr" event={"ID":"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58","Type":"ContainerStarted","Data":"65870837ca8f8612241366229543664c3458b6653dc69516e4284a3cb3c3d918"} Sep 15 08:00:45.742734 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:45.742695 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2wd7/must-gather-4p5tr" event={"ID":"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58","Type":"ContainerStarted","Data":"3f3e4f50479a2be59e5b08a781aeb1574fbc91ad67d91d257eef0d510f417a81"} Sep 15 08:00:45.743110 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:45.742747 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2wd7/must-gather-4p5tr" event={"ID":"bf3efddf-f0d5-4dbc-b634-6e6b529b1e58","Type":"ContainerStarted","Data":"059e1337585372755a6b10255f8cb8aafd0dd57e09d3aa825cf88f971aacbd0b"} Sep 15 08:00:45.761799 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:45.761748 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2wd7/must-gather-4p5tr" podStartSLOduration=1.852377266 podStartE2EDuration="2.761730146s" totalImagesPullingTime="909.35288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 08:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:00:45.759579433 +0000 UTC m=+2156.071666052" watchObservedRunningTime="2026-09-15 08:00:45.761730146 +0000 UTC m=+2156.073816762" Sep 15 08:00:45.995605 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:45.995510 2582 ???:1] "http: TLS handshake error from 10.0.139.67:45938: EOF" Sep 15 08:00:46.000828 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:46.000804 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nknkw_e419fef2-f661-402e-995e-284a565c061f/global-pull-secret-syncer/0.log" Sep 15 08:00:46.277353 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:46.277277 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tsj97_17f9cd36-7b93-4b1b-ad11-0c668bb49d78/konnectivity-agent/0.log" Sep 15 08:00:46.377883 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:46.377846 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-67.ec2.internal_0416777f4ade93d73bec1fcbd4b5ca9b/haproxy/0.log" Sep 15 08:00:50.166303 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:50.166262 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-g4795_5f8a6ea6-2f70-431a-8cb1-3f910555b5f9/cluster-monitoring-operator/0.log" Sep 15 08:00:50.429290 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:50.429206 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8777r_a3587893-1b14-46cb-8f67-84f39ce8e83f/node-exporter/0.log" Sep 15 08:00:50.449322 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:50.449293 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8777r_a3587893-1b14-46cb-8f67-84f39ce8e83f/kube-rbac-proxy/0.log" Sep 15 08:00:50.471119 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:50.471085 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8777r_a3587893-1b14-46cb-8f67-84f39ce8e83f/init-textfile/0.log" Sep 15 08:00:52.328134 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:52.328093 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-52gbg_df8db835-dfab-4801-983d-b81d7f57e09d/networking-console-plugin/0.log" Sep 15 08:00:52.722798 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:52.722762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/2.log" Sep 15 08:00:52.727823 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:52.727793 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-pq7qx_8c4db370-fbbc-42b0-852d-9b33bae6bfbf/console-operator/3.log" Sep 15 08:00:53.036003 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.035895 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6"] Sep 15 08:00:53.041337 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.041309 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.045966 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.045938 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6"] Sep 15 08:00:53.095867 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.095824 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfp7\" (UniqueName: \"kubernetes.io/projected/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-kube-api-access-kdfp7\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.096064 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.095909 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-sys\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.096064 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.096009 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-lib-modules\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.096203 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.096069 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-proc\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.096203 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.096119 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-podres\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.122959 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.122930 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-664d97fd7d-xd8j7_4e1b62cd-38cc-4844-aca7-6bce1e65137e/console/0.log" Sep 15 08:00:53.196925 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.196879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-lib-modules\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197125 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.196959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-proc\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197125 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197009 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-podres\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197125 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfp7\" (UniqueName: \"kubernetes.io/projected/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-kube-api-access-kdfp7\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197125 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-sys\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197125 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-proc\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197125 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197093 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-lib-modules\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197451 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197203 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-sys\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.197451 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.197222 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-podres\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.206019 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.205964 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfp7\" (UniqueName: \"kubernetes.io/projected/fd05cf1a-a3e6-44ab-ba78-edcd63bc9985-kube-api-access-kdfp7\") pod \"perf-node-gather-daemonset-pdpg6\" (UID: \"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985\") " pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.355991 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.355903 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.651153 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.651128 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-6sbsl_f1ff0b49-45a2-41eb-a0f5-6ef9213473a2/volume-data-source-validator/0.log" Sep 15 08:00:53.660057 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.660022 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6"] Sep 15 08:00:53.663831 ip-10-0-139-67 kubenswrapper[2582]: W0915 08:00:53.663787 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd05cf1a_a3e6_44ab_ba78_edcd63bc9985.slice/crio-3f159d14eeb7645c5885df90305d3d7af8791eef0500c0be5ddf955c354df4a5 WatchSource:0}: Error finding container 3f159d14eeb7645c5885df90305d3d7af8791eef0500c0be5ddf955c354df4a5: Status 404 returned error can't find the container with id 3f159d14eeb7645c5885df90305d3d7af8791eef0500c0be5ddf955c354df4a5 Sep 15 08:00:53.786745 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.786713 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" event={"ID":"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985","Type":"ContainerStarted","Data":"7b579f3a215ac112a4612c02355cf482f479f82da39369a1bf5904c7a5649ce8"} Sep 15 08:00:53.786909 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.786771 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" event={"ID":"fd05cf1a-a3e6-44ab-ba78-edcd63bc9985","Type":"ContainerStarted","Data":"3f159d14eeb7645c5885df90305d3d7af8791eef0500c0be5ddf955c354df4a5"} Sep 15 08:00:53.786909 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.786839 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:00:53.804493 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:53.804444 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" podStartSLOduration=0.804429533 podStartE2EDuration="804.429533ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 08:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 08:00:53.802216566 +0000 UTC m=+2164.114303187" watchObservedRunningTime="2026-09-15 08:00:53.804429533 +0000 UTC m=+2164.116516150" Sep 15 08:00:54.362841 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:54.362814 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-776vd_a300c8b2-2756-4435-9669-d71f2344876c/dns/0.log" Sep 15 08:00:54.381081 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:54.381038 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-776vd_a300c8b2-2756-4435-9669-d71f2344876c/kube-rbac-proxy/0.log" Sep 15 08:00:54.527145 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:54.527118 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hxspg_978eb2dd-421d-48f8-bd57-0796552681c6/dns-node-resolver/0.log" Sep 15 08:00:54.913129 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:54.913098 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cbtnf_810e9712-e1cf-4c1f-872c-c2e8a75c5a7e/node-ca/0.log" Sep 15 08:00:55.595764 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:55.595735 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-ffbfb48c4-bx7kt_5e800b6b-327a-4c28-bfb3-45e4ec352d3e/router/0.log" Sep 15 08:00:55.936660 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:55.936628 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zhz57_2199cd3e-575f-49ba-81ec-bb7085383b1a/serve-healthcheck-canary/0.log" Sep 15 08:00:56.244493 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:56.244422 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-5mlms_cf9beb80-892c-43b0-92df-8685f8c7f567/insights-operator/0.log" Sep 15 08:00:56.245116 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:56.245095 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-5mlms_cf9beb80-892c-43b0-92df-8685f8c7f567/insights-operator/1.log" Sep 15 08:00:56.386669 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:56.386644 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x95qw_a147f55f-988b-42f8-adbc-28b3b5a66e73/kube-rbac-proxy/0.log" Sep 15 08:00:56.407040 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:56.407015 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x95qw_a147f55f-988b-42f8-adbc-28b3b5a66e73/exporter/0.log" Sep 15 08:00:56.426542 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:56.426495 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x95qw_a147f55f-988b-42f8-adbc-28b3b5a66e73/extractor/0.log" Sep 15 08:00:59.802561 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:00:59.802520 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2wd7/perf-node-gather-daemonset-pdpg6" Sep 15 08:01:00.594902 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:00.594872 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jpkvr_f40e5368-9f86-42ca-8127-c50b308b74da/kube-storage-version-migrator-operator/1.log" Sep 15 08:01:00.595590 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:00.595569 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-jpkvr_f40e5368-9f86-42ca-8127-c50b308b74da/kube-storage-version-migrator-operator/0.log" Sep 15 08:01:01.609206 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.609140 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/kube-multus-additional-cni-plugins/0.log" Sep 15 08:01:01.633390 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.633348 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/egress-router-binary-copy/0.log" Sep 15 08:01:01.654054 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.653995 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/cni-plugins/0.log" Sep 15 08:01:01.675221 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.675153 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/bond-cni-plugin/0.log" Sep 15 08:01:01.695462 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.695371 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/routeoverride-cni/0.log" Sep 15 08:01:01.716408 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.716377 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/whereabouts-cni-bincopy/0.log" Sep 15 08:01:01.737093 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.737064 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrjjc_22e7418c-dd5c-4380-9847-b675ff57f53a/whereabouts-cni/0.log" Sep 15 08:01:01.960660 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:01.960632 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lwwwm_84fb872a-2638-4a08-acc0-ffcd38d64979/kube-multus/0.log" Sep 15 08:01:02.088180 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:02.088148 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2m5h_5d209bf2-2892-4cac-8930-be58fc4fef6e/network-metrics-daemon/0.log" Sep 15 08:01:02.109222 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:02.109187 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m2m5h_5d209bf2-2892-4cac-8930-be58fc4fef6e/kube-rbac-proxy/0.log" Sep 15 08:01:03.290076 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.290040 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/ovn-controller/0.log" Sep 15 08:01:03.308914 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.308883 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/ovn-acl-logging/0.log" Sep 15 08:01:03.333155 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.333127 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/kube-rbac-proxy-node/0.log" Sep 15 08:01:03.359259 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.359232 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/kube-rbac-proxy-ovn-metrics/0.log" Sep 15 08:01:03.376962 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.376934 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/northd/0.log" Sep 15 08:01:03.397053 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.397029 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/nbdb/0.log" Sep 15 08:01:03.420301 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.420268 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/sbdb/0.log" Sep 15 08:01:03.465412 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:03.465384 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zjk5k_bfa0ff87-e79c-4363-81dc-8ad6a48304a5/ovnkube-controller/0.log" Sep 15 08:01:04.389440 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:04.389400 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-kjq4x_7c6fd379-3cbd-4daa-a53e-cafeb557377c/check-endpoints/0.log" Sep 15 08:01:04.456953 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:04.456924 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xq7k7_c0483747-ec7d-4b7c-9121-4c766485e1d2/network-check-target-container/0.log" Sep 15 08:01:05.256725 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:05.256647 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-m57gx_6efa5091-b46e-47cd-8a5d-9a52420398c4/iptables-alerter/0.log" Sep 15 08:01:05.882446 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:05.882416 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zgxs9_8f019d3d-0435-4d08-8161-d3bd5dc437f7/tuned/0.log" Sep 15 08:01:07.385441 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:07.385410 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-x6v58_d9891b26-ef68-45fc-a8d4-a41e4674c14c/cluster-samples-operator/0.log" Sep 15 08:01:07.400632 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:07.400609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-x6v58_d9891b26-ef68-45fc-a8d4-a41e4674c14c/cluster-samples-operator-watch/0.log" Sep 15 08:01:08.270072 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:08.270047 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-4fzjl_89358f35-b2bb-4e0d-9091-fdb1497c54c5/service-ca-operator/1.log" Sep 15 08:01:08.271016 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:08.270993 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-4fzjl_89358f35-b2bb-4e0d-9091-fdb1497c54c5/service-ca-operator/0.log" Sep 15 08:01:08.952028 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:08.951988 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f6pzv_a7ada9b7-90b8-4c79-ac4c-d3488ee50af7/csi-driver/0.log" Sep 15 08:01:08.971238 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:08.971212 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f6pzv_a7ada9b7-90b8-4c79-ac4c-d3488ee50af7/csi-node-driver-registrar/0.log" Sep 15 08:01:09.002782 ip-10-0-139-67 kubenswrapper[2582]: I0915 08:01:09.002752 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-f6pzv_a7ada9b7-90b8-4c79-ac4c-d3488ee50af7/csi-liveness-probe/0.log"